Pocket-size augmented reality system for flight control

Head-up displays (HUDs) have become common equipment in aircraft cockpits. One of the uses of HUDs is to provide a specific visual interface for pilots in the form of what is called a "tunnel-in-the-sky" (i.e. 3D geometry for the navigation path displayed on a flat screen). According to recent studies the "tunnel-in-the-sky" approach does not provide crucial advantages in comparison with more traditional methods of presenting navigation information to pilots. Our research considers a stereoscopic version of the 3D "tunnel-in-the-sky" realized as an augmented reality (AR) pocket-size system with see-through light-weight AR glasses. The system consists of low-cost items and does not suffer from the drawbacks tied with existing synthetic/enhanced vision systems for pilots. The results of the experiments with desktop simulators of different AR pilot's interfaces (2D, 3D and stereo 3D conditions) proved the effectiveness of the proposed stereo AR solution. A flight test of the prototype of the developed AR system was carried out on Cessna 172 aircraft and is showed in the accompanying video.

[1]  Jorma Laaksonen,et al.  An augmented reality interface to contextual information , 2011, Virtual Reality.

[2]  G. Inalhan,et al.  Flight deck automation support with dynamic 4D trajectory management for ACAS: AUTOFLY-Aid , 2012, 2012 Integrated Communications, Navigation and Surveillance Conference.

[3]  Walter A. Johnson,et al.  HUD Symbology for Surface Operations: Command Guidance vs. Situation Guidance Formats , 2002 .

[4]  Max Mulder,et al.  Predictive Landing Guidance in Synthetic Vision Displays , 2011 .

[5]  Randall E. Bailey,et al.  Evaluation of head-worn display concepts for commercial aircraft taxi operations , 2007, SPIE Defense + Commercial Sensing.

[6]  Andrew K. Barrows,et al.  Alaskan flight trials of a synthetic vision system for instrument landings of a piston twin aircraft , 1999, Defense, Security, and Sensing.

[7]  Andrew K. Barrows,et al.  Flight Testing WAAS for Use in Closely Spaced Parallel Approaches , 1999 .

[8]  Marinus M. van Paassen,et al.  Predictive Landing Guidance in Synthetic Vision Displays , 2009 .

[9]  Hugh F. Durrant-Whyte,et al.  Simultaneous map building and localization for an autonomous mobile robot , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[10]  Steven J. Landry.  Aviation display dynamics and flight domain in pilot perceptions of display clutter , 2012 .

[11]  Peter C. Cheeseman,et al.  Estimating uncertain spatial relationships in robotics , 1986, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[12]  Anthony D. Andre,et al.  Situation Awareness in an Augmented Reality Cockpit: Design, Viewpoints and Cognitive Glue , 2005 .

[13]  Florian Holzapfel,et al.  Predictor-Tunnel Display and Direct Force Control for Improving Flight Path Control , 2008 .

[14]  Hujun Bao,et al.  MRStudio: A mixed reality display system for aircraft cockpit , 2011, 2011 IEEE International Symposium on VR Innovation.

[15]  Fan Xiao,et al.  The Omnidirectional Attention Funnel: A Dynamic 3D Cursor for Mobile Augmented Reality Systems , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[16]  Lawrence J. Prinzel,et al.  Head-Up Displays and Attention Capture , 2004 .

[17]  Reinhold Behringer,et al.  Vision-based augmented reality for pilot guidance in airport runways and taxiways , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.