Model-Based Testing for Objective Fidelity Evaluation of Engineering and Research Flight Simulators

Simulator fidelity has been defined as the conformance of a flight simulator to the characteristics of the real aircraft. Objective fidelity evaluation is an engineering approach that attacks the fidelity problem with comparison of simulator and the actual system behavior over some quantitative measures. Testing can be pronounced as the fundamental mean for this comparison. From the utilization perspective, flight simulators are classified as research, engineering and training simulators. Research simulators are both test beds for flight simulator research and computational tools for flight systems and human factors research. Engineering simulators are used for systems development and training simulators are utilized for flight training. While training simulators are subject to rare or few upgrades or modifications in their lifespan, engineering simulators are under occasional and research simulators are under frequent change. The test cases to evaluate the fidelity of training simulators are guided by standards whereas for engineering and research simulators, test cases may present a great variation depending on the scope of change and the use case. These two characteristics of engineering and research simulators, combined with the complexity of today’s aircrafts necessitate new methodologies for efficient and effective testing. Model-Based Testing (MBT) targets flexibility and adaptability via utilization of models for specification of test cases and proposes workflows for automatic test case generation. The paper presents an MBT approach for objective fidelity evaluation of engineering and research simulators. The proposed approach is exercised with an infrastructure implementation and an example case study. Thus, evidences are collected that indicate increased efficiency and an effective test process.

[1]  Sunjoo K. Advani,et al.  Design of the DLR AVES Research Flight Simulator , 2013 .

[2]  Junwei Han,et al.  An Automated Test System for Flight Simulator Fidelity Evaluation , 2009, J. Comput..

[3]  Max Mulder,et al.  Using the SIMONA Research Simulator for Human-machine Interaction Research , 2003 .

[4]  Thorsten Pawletta,et al.  Model-based testing approach for MATLAB/simulink using system entity structure and experimental frames , 2015, SpringSim.

[5]  Paul Soukup,et al.  The NASA 747-400 Flight Simulator: A National Resource for Aviation Safety , 1996 .

[6]  Bernard P. Zeigler,et al.  Theory of Modeling and Simulation: Integrating Discrete Event and Continuous Complex Dynamic Systems , 2000 .

[7]  Mamadou Kaba Traoré,et al.  Capturing the dual relationship between simulation models and their context , 2006, Simul. Model. Pract. Theory.

[8]  Justyna Zander-Nowicka,et al.  Model-based Testing of Real-Time Embedded Systems in the Automotive Domain , 2009 .

[9]  Pieter J. Mosterman,et al.  A Taxonomy of Model-Based Testing for Embedded Systems from Multiple Industry Domains , 2011 .

[10]  Thorsten Pawletta,et al.  Ontology-Assisted System Modeling and Simulation within MATLAB/Simulink , 2014, Simul. Notes Eur..

[11]  Larry Apfelbaum,et al.  Model Based Testing , 1997 .

[12]  Junwei Han,et al.  Flight Simulator Fidelity Evaluation Automated Test System Analysis , 2008, 2008 International Workshop on Education Technology and Training & 2008 International Workshop on Geoscience and Remote Sensing.

[13]  Thorsten Pawletta,et al.  Ontology for Objective Flight Simulator Fidelity Evaluation , 2014 .

[14]  David Braun,et al.  Universal Automated Flight Simulator Fidelity Test System , 2004 .

[15]  Albert Rehmann,et al.  A Handbook of Flight Simulation Fidelity Requirements for Human Factors Research. , 1995 .

[16]  Gareth D. Padfield,et al.  The Use of Flight Simulation for Research and Teaching in Academia. , 2006 .

[17]  P. Saager.  Real-Time Hardware-in-the-Loop Simulation for 'ATTAS' and 'ATTHeS' Advanced Technology Flight Test Vehicles. , 1990 .

[18]  Michael Blum,et al.  Design of a Hexapod Motion Cueing System for the NASA Ames Vertical Motion Simulator , 2002 .

[19]  R. Marshall Smith.  A Description of the Cockpit Motion Facility and the Research Flight Deck Simulator , 2000 .

[20]  Claudia S. Frydman,et al.  Adapting model-based testing techniques to DEVS models validation , 2012, SpringSim.

[21]  Bernard P. Zeigler,et al.  Modeling & Simulation-Based Data Engineering: Introducing Pragmatics into Ontologies for Net-Centric Information Exchange , 2007 .

[22]  Tiauw Hiong Go,et al.  SIMULATOR FIDELITY CONSIDERATIONS FOR TRAINING AND EVALUATION OF TODAY'S AIRLINE PILOTS , 2001 .

[23]  S. Klaes.  ATTAS Ground Based System Simulator - An Update , 2000 .