A virtual reality flight simulator for human factors engineering

This research presents a virtual reality flight simulator (VRFS) that combines the advantages of desktop simulations and hardware mock-ups, i.e., the flexibility of a desktop flight simulation with the level of immersion close to a full flight simulator. In contrast to similar existing virtual reality flight simulators, the presented system focuses on human factors (HF) engineering and is used for evaluating flight decks in an early phase of the design process. Hence, HF tools that are based on HF methods have been integrated; applying these methods requires collecting objective (e.g., eye tracking, physiological data, head and finger movements) as well as subjective data (e.g., questionnaires). In this paper, three user studies are presented that demonstrate the application of the integrated HF methods and the general usability of the system. These studies have been conducted as part of human–machine interface (HMI) development projects and range from basic cognitive research to HMI evaluations using realistic scenarios. The user studies indicate that HF engineering with the help of this system is possible and a feasible alternative to other means of evaluation. Yet, the abilities are limited due to technological and physiological constraints. This is why the scope of the VRFS lies between desktop simulations and a full hardware mock-up and cannot replace either of those. However, the presented studies show that the system can provide reliable information on the interaction with HMI. Thus, it is a reliable low-cost addition in the early development process of cockpit human machine interaction technologies when it comes to HF evaluations.

[1]  Turgay Aslandere,et al.  A Generic Virtual Reality Flight Simulator , 2014 .

[2]  Matthias Oberhauser,et al.  HUD symbology evaluation in a virtual reality flight simulation , 2014 .

[3]  Mehmet Ilker Berkman,et al.  Eye Tracking in Virtual Reality , 2018, Encyclopedia of Computer Graphics and Games.

[4]  John E. Deaton,et al.  AVIATION RESEARCH AND DEVELOPMENT: A FRAMEWORK FOR THE EFFECTIVE PRACTICE OF HUMAN FACTORS, OR "WHAT YOUR MENTOR NEVER TOLD YOU ABOUT A CAREER IN HUMAN FACTORS...". IN: HANDBOOK OF AVIATION HUMAN FACTORS , 1999 .

[5]  Eugenia M. Kolasinski,et al.  Simulator Sickness in Virtual Environments. , 1995 .

[6]  R. Malcolm.  The Malcolm horizon: History and future , 1984 .

[7]  Kurt Landau,et al.  Ergonomic software tools in product and workplace design : a review of recent developments in human modeling and other design aids , 2000 .

[8]  Kai-Uwe Doer,et al.  VIRTUAL COCKPIT SIMULATION FOR PILOT TRAINING , 2001 .

[9]  A. Kingstone,et al.  Topic: Cognition , 2003 .

[10]  Uwe Klingauf,et al.  Virtual-Reality as a Future Training Medium for Civilian Flight Procedure Training , 2008 .

[11]  Turgay Aslandere,et al.  Virtual hand-button interaction in a generic virtual reality flight simulator , 2015, 2015 IEEE Aerospace Conference.

[12]  Uwe Klingauf,et al.  Interaktionsmechanismen zur Verbesserung der Mensch-Maschine-Schnittstelle am Beispiel eines virtuellen Flugsimulators , 2005 .

[13]  V. David Hopkin,et al.  Underpinnings of System Evaluation , 2016 .

[14]  Axel Hillebrand,et al.  Bridging the Gap Between Desktop Research and Full Flight Simulators for Human Factors Research , 2015, HCI.

[15]  I Yavrucuk,et al.  A low cost flight simulator using virtual reality tools , 2008, IEEE Aerospace and Electronic Systems Magazine.

[16]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[17]  Odest Chadwicke Jenkins,et al.  Rosbridge: ROS for Non-ROS Users , 2011, ISRR.

[18]  Axel Hillebrand,et al.  A new method to assess pilots' allocation of visual attention using a head-up display , 2012 .

[19]  John A. Wise,et al.  Measurement in Aviation Systems , 2016 .

[20]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[21]  R L Helmreich,et al.  The evolution of Crew Resource Management training in commercial aviation. , 1999, The International journal of aviation psychology.

[22]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[23]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[24]  Hubert Hugo Hilf.  Einführung in die Arbeitswissenschaft , 1964 .

[25]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[26]  David A. Southard,et al.  Transformations for stereoscopic visual simulation , 1992, Comput. Graph..

[27]  Christopher D. Wickens,et al.  Situation Awareness and Workload in Aviation , 2002 .

[28]  Axel Hillebrand,et al.  ATTENDO Method for the Assessment of Visual Attention Allocation in Two-dimensional Spaces , 2013 .

[29]  Domain independent visual attention assessment in stereoscopic displays , 2014 .

[30]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .