Fusion of Synthetic and Enhanced Vision for All-Weather Commercial Aviation Operations

NASA is developing revolutionary crew-vehicle interface technologies that strive to proactively overcome aircraft safety barriers that would otherwise constrain the full realization of the next-generation air transportation system. A piloted simulation experiment was conducted to evaluate the complementary use of Synthetic and Enhanced Vision technologies. Specific focus was placed on new techniques for integration and/or fusion of Enhanced and Synthetic Vision and its impact within a two-crew flight deck during low visibility approach and landing operations. Overall, the experimental data showed that significant improvements in situation awareness, without concomitant increases in workload and display clutter, could be provided by the integration and/or fusion of synthetic and enhanced vision technologies for the pilot-flying and the pilot-not-flying. During non-normal operations, the ability of the crew to handle substantial navigational errors and runway incursions were not adversely impacted by the display concepts although the addition of Enhanced Vision did not, unto itself, provide an improvement in runway incursion detection.

[1]  Russell V. Parrish,et al.  Evaluation of Alternate Concepts for Synthetic Vision Flight Displays With Weather- Penetrating Sensor Image Inserts During Simulated Landing Approaches , 2003 .

[2]  Jens Schiefele,et al.  Human factors flight trial analysis for 3D SVS: part II , 2005, SPIE Defense + Commercial Sensing.

[3]  Wright-Patterson Afb,et al.  FLYING COMPLEX APPROACHES USING A HEAD-UP DISPLAY: EFFECTS OF VISIBILITY AND DISPLAY TYPE , 1999 .

[4]  Kenneth R. Boff,et al.  Engineering data compendium : human perception and performance , 1988 .

[5]  Timothy J. Etherington,et al.  Terminal area operations with enhanced and synthetic vision: experience in the Boeing technology demonstrator , 2003, SPIE Defense + Commercial Sensing.

[6]  D. R. Jones,et al.  Runway incursion prevention system-demonstration and testing at the Dallas/Fort Worth International Airport , 2001, 20th DASC. 20th Digital Avionics Systems Conference (Cat. No.01CH37219).

[7]  M. Endsley.  Situation Awareness In Aviation Systems , 1999 .

[8]  James A. Jeske,et al.  Flight Path Synthesis and HUD Scaling for V/STOL Terminal Area Operations , 1995 .

[9]  C D Wickens,et al.  Head-Up Displays: Effect of Clutter, Display Intensity, and Display Location on Pilot Performance , 1998 .

[10]  W. R. Jones,et al.  The NASA approach to realize a sensor enhanced-synthetic vision system (SE-SVS) [aircraft displays] , 2002, Proceedings. The 21st Digital Avionics Systems Conference.

[11]  Becky L. Hooey,et al.  IMPROVING EVALUATION AND SYSTEM DESIGN THROUGH THE USE OF OFF-NOMINAL TESTING: A METHODOLOGY FOR SCENARIO DEVELOPMENT , 2003 .

[12]  Steven D. Young,et al.  Utilization of GPS surface reflected signals to provide aircraft altitude verification for SVS , 2005, SPIE Defense + Commercial Sensing.

[13]  Haag Maarten Uijt de,et al.  Flight Test Results of a Synthetic Vision Elevation Database Integrity Monitor , 2001 .

[14]  Randall E. Bailey,et al.  CFIT prevention using synthetic vision , 2003, SPIE Defense + Commercial Sensing.

[15]  Michael A. Vidulich,et al.  Testing a Subjective Metric of Situation Awareness , 1991 .

[16]  Bernd Korn,et al.  Crew coordination issues of EVS approaches , 2004, SPIE Defense + Commercial Sensing.

[17]  Randall E. Bailey,et al.  Synthetic Vision Enhances Situation Awareness and RNP Capabilities for Terrain-Challenged Approaches , 2003 .

[18]  Michael P. Snow,et al.  Human Factors in Head-Up Synthetic Vision Displays , 2001 .

[19]  Randall E. Bailey,et al.  Flight testing an integrated synthetic vision system , 2005, SPIE Defense + Commercial Sensing.

[20]  Albert J. Ahumada,et al.  Engineering a visual system for seeing through fog , 1992 .

[21]  G.J.M. Koeners,et al.  Integration of imaging sensor data into a synthetic vision display , 2004, The 23rd Digital Avionics Systems Conference (IEEE Cat. No.04CH37576).

[22]  T. Schnell,et al.  Flight simulator evaluation of an integrated synthetic and enhanced vision system for terrain avoidance , 2005, 24th Digital Avionics Systems Conference.

[23]  Craig,et al.  Flight Test of a Helmet-Mounted, Enhanced and Synthetic Vision System for Rotorcraft Operations , 2002 .

[24]  Jacques Verly.  Enhanced and Synthetic Vision 2000 , 2000 .

[25]  Teresa L. Mann,et al.  Autonomous Landing Guidance Concept - The Effects of Video and Symbology Dynamics on Pilot Performance , 1987 .

[26]  Lawrence L Ames,et al.  Revision and Verification of a Seven-Point Workload Estimate Scale , 1993 .

[27]  S. Young,et al.  On the development of in-flight autonomous integrity monitoring of stored geo-spatial data using forward-looking remote sensing technology , 2005 .

[28]  Colin E. Reese,et al.  Comparison of additive image fusion vs. feature-level image fusion techniques for enhanced night driving , 2003, SPIE Optics + Photonics.

[29]  Christopher D. Wickens,et al.  Display Formatting Techniques for Improving Situation Awareness in the Aircraft Cockpit , 1991 .

[30]  Ronald V. Kruk,et al.  Feature Detection Performance with Fused Synthetic and Sensor Images , 1999 .

[31]  Randall E. Bailey,et al.  Pathway design effects on synthetic vision head-up displays , 2004, SPIE Defense + Commercial Sensing.

[32]  Randall E. Bailey,et al.  Flight test comparison between enhanced vision (FLIR) and synthetic vision systems , 2005, SPIE Defense + Commercial Sensing.