Pilot interface considerations using high level information fusion

Since the development of the “Pilot's Associate” by the Defense Advanced Research Projects Agency (DARPA) for rotorcraft in the 1990s, there has been a focus on developing intelligent aviation user interfaces. A common theme extending from these efforts includes advances in data and sensor fusion. Data from sensors, when combined, is termed low-level information fusion (LLIF). The ability for a user to make sense and interact with the data is termed High-Level Information Fusion (HLIF). Safe flight requires the pilot to be able to utilize various avionics results and warnings to rapidly respond to impending situations. Context-sensitive aiding is an important element in supporting aircraft pilots in complex, dangerous, or demanding environments. In this paper, we explore an illusionary effect to foster the continued discussion on man-machine interface that can utilize HLIF developments. The application of LLIF-HLIF estimation methods are shown as methods towards assisting a pilot to recover from spatial disorientation.

[1]  Bob Cheung,et al.  Spatial disorientation: more than just illusion. , 2013, Aviation, space, and environmental medicine.

[2]  Olga Mendoza-Schrock,et al.  Video image registration evaluation for a layered sensing environment , 2009, Proceedings of the IEEE 2009 National Aerospace & Electronics Conference (NAECON).

[3]  Akademisk Avhandling,et al.  Transparency for Future Semi-Automated Systems , 2014 .

[4]  Erik Blasch,et al.  Measures of effectiveness for high-level fusion , 2010, 2010 13th International Conference on Information Fusion.

[5]  Erik Blasch,et al.  Level 5 (User Refinement) issues supporting Information Fusion Management , 2006, 2006 9th International Conference on Information Fusion.

[6]  Marco A. Solano,et al.  Enterprise data architecture principles for High-Level Multi-Int fusion: A pragmatic guide for implementing a heterogeneous data exploitation framework , 2012, 2012 15th International Conference on Information Fusion.

[7]  Lauro Snidaro,et al.  Integration of contextual information for tracking refinement , 2011, 14th International Conference on Information Fusion.

[8]  Erik Blasch,et al.  Towards unbiased evaluation of uncertainty reasoning: The URREF ontology , 2012, 2012 15th International Conference on Information Fusion.

[9]  Zhonghai Wang,et al.  Surveillance of ground vehicles for airport security , 2014, Defense + Security Symposium.

[10]  Erik Blasch,et al.  Performance-driven resource management in layered sensing , 2009, 2009 12th International Conference on Information Fusion.

[11]  Mariusz Wyleżoł,et al.  Hypoxia and Coriolis Illusion in Pilots During Simulated Flight. , 2016, Aerospace medicine and human performance.

[12]  David H. Klyde,et al.  Development of Spatial Disorientation Demonstration Scenarios for Commercial Pilot Training , 2016 .

[13]  Erik Blasch,et al.  Pilot timeliness of safety decisions using information situation awareness , 2014, 2014 IEEE/AIAA 33rd Digital Avionics Systems Conference (DASC).

[14]  Erik Blasch,et al.  Aviation simulation training in the Czech air force , 2015, 2015 IEEE/AIAA 34th Digital Avionics Systems Conference (DASC).

[15]  Erik Blasch,et al.  Increasing flight safety using flight sensory illusions on a spatial disorientation simulator , 2016, 2016 IEEE/AIAA 35th Digital Avionics Systems Conference (DASC).

[16]  Lenka Hanakova,et al.  Basic Piloting Technique Error Rate as an Indicator of Flight Simulators Usability for Pilot Training , 2016 .

[17]  J. Boril,et al.  Possibilities of Assessing Objectively a Flight Illusion Effect on a Pilot’s Spatial Orientation , 2018, Advances in Military Technology.

[18]  Werner Retschitzegger,et al.  A Survey on Clustering Techniques for Situation Awareness , 2013, APWeb.

[19]  Erik Blasch,et al.  Pilot controller design using the CTU flight simulator for shared situation awareness , 2015, 2015 IEEE/AIAA 34th Digital Avionics Systems Conference (DASC).

[20]  E. P. Blasch.  Learning attributes for situational awareness in the landing of an autonomous airplane , 1997, 16th DASC. AIAA/IEEE Digital Avionics Systems Conference. Reflections to the Future. Proceedings.

[21]  Ari Kolbeinsson,et al.  Visualising uncertainty in aircraft cockpits : Is icon degradation an appropriate visualisation form , 2013 .

[22]  Erik Blasch.  Introduction to Level 5 Fusion: The Role of the User , 2017 .

[23]  A. Soto,et al.  ATC trajectory reconstruction for automated evaluation of sensor and tracker performance , 2013, IEEE Aerospace and Electronic Systems Magazine.

[24]  Keith L. Hiatt,et al.  Survey of spatial disorientation in military pilots and navigators. , 2003, Aviation, space, and environmental medicine.

[25]  Erik Blasch,et al.  Issues and Challenges in Situation Assessment (Level 2 Fusion) , 2006, J. Adv. Inf. Fusion.

[26]  V. V. Davydov,et al.  Spatial orientation of pilot using a cockpit exterior surveillance system , 2015, Human Physiology.

[27]  Jason A. Moore,et al.  Advanced Visualization and Interactive Displays (AVID) , 2009 .

[28]  Erik Blasch,et al.  Summary of avionics technologies , 2015, IEEE Aerospace and Electronic Systems Magazine.

[29]  E. Shahbazian,et al.  Uncertainty Evaluation: Current Status and Major Challenges , 2012 .

[30]  Chun Yang,et al.  Optimal Placement of Heterogeneous Sensors for Targets with Gaussian Priors , 2013, IEEE Transactions on Aerospace and Electronic Systems.

[31]  E. Blasch,et al.  Information fusion mangement and enterpise processing , 2012, 2012 IEEE National Aerospace and Electronics Conference (NAECON).

[32]  Elizabeth K. Bowman.  Persistent ISR: the social network analysis connection , 2012, Defense + Commercial Sensing.

[33]  Erik Blasch,et al.  Decisions-to-Data using Level 5 information fusion , 2014, Defense + Security Symposium.

[34]  Jose B. Cruz,et al.  Game Theoretic Approach to Threat Prediction and Situation Awareness , 2006, 2006 9th International Conference on Information Fusion.

[35]  James Llinas,et al.  High Level Information Fusion (HLIF): Survey of models, issues, and grand challenges , 2012, IEEE Aerospace and Electronic Systems Magazine.

[36]  Erik Blasch,et al.  Characteristic errors of the IMM algorithm under three maneuver models for an accelerating target , 2008, 2008 11th International Conference on Information Fusion.

[37]  G. Hunter,et al.  NAS-wide traffic flow management concept using required time of arrival, separation assurance and weather routing , 2012, 2012 IEEE/AIAA 31st Digital Avionics Systems Conference (DASC).

[38]  David H. Klyde,et al.  Evaluation of a Missed Approach/Go-Around Spatial Disorientation Demonstration Scenario for Commercial Pilot Training , 2017 .

[39]  Genshe Chen,et al.  On effectiveness of game theoretic modeling and analysis against cyber threats for avionic systems , 2015, 2015 IEEE/AIAA 34th Digital Avionics Systems Conference (DASC).

[40]  Tom Ziemke,et al.  Improving maritime anomaly detection and situation awareness through interactive visualization , 2008, 2008 11th International Conference on Information Fusion.

[41]  Murat M. Tanik,et al.  High-Level fusion for intelligence applications using Recombinant Cognition Synthesis , 2012, Inf. Fusion.

[42]  C. Yang,et al.  Pose angular-aiding for maneuvering target tracking , 2005, 2005 7th International Conference on Information Fusion.

[43]  Erik Blasch,et al.  Random-point-based filters: analysis and comparison in target tracking , 2015, IEEE Transactions on Aerospace and Electronic Systems.

[44]  Chun Yang,et al.  Relative Track Metrics to Determine Model Mismatch , 2008, 2008 IEEE National Aerospace and Electronics Conference.

[45]  Eloi Bosse,et al.  High-Level Information Fusion Management and System Design , 2012 .

[46]  Norbou Buchler,et al.  The Warfighter Associate: decision-support software agent for the management of intelligence, surveillance, and reconnaissance (ISR) assets , 2014, Defense + Security Symposium.

[47]  John J. Salerno,et al.  Evaluating algorithmic techniques in supporting situation awareness , 2005, SPIE Defense + Commercial Sensing.

[48]  I. Kadar,et al.  Resource management coordination with level 2/3 fusion issues and challenges [Panel Report] , 2008, IEEE Aerospace and Electronic Systems Magazine.

[49]  Erik Blasch,et al.  Revisiting the JDL model for information exploitation , 2013, Proceedings of the 16th International Conference on Information Fusion.

[50]  Lauren Scharff,et al.  Spatial disorientation: decades of pilot fatalities. , 2011, Aviation, space, and environmental medicine.

[51]  Erik Blasch,et al.  Experience with objective measuring of the coriolis illusion influence on the pilot's spatial orientation , 2017, 2017 IEEE/AIAA 36th Digital Avionics Systems Conference (DASC).

[52]  Ellen J. Bass,et al.  Emergency Management Decision-Making during Severe Weather , 2006 .

[53]  B. Self,et al.  Physiological responses to the Coriolis illusion: effects of head position and vision. , 2007, Aviation, space, and environmental medicine.

[54]  J.A. Besada,et al.  Design of an A-SMGCS prototype at Barajas airport: available information and architecture , 2005, 2005 7th International Conference on Information Fusion.

[55]  Erik Blasch,et al.  Enhanced air operations using JView for an air-ground fused situation awareness udop , 2013, 2013 IEEE/AIAA 32nd Digital Avionics Systems Conference (DASC).

[56]  Erik Blasch,et al.  Information fusion for information superiority , 2000, Proceedings of the IEEE 2000 National Aerospace and Electronics Conference. NAECON 2000. Engineering Tomorrow (Cat. No.00CH37093).