Detecting ambient/focal visual attention in professional airline pilots with a modified Coefficient K: a full flight simulator study

Flight instruments, from which a pilot monitors an aircraft, usually serve as areas-of-interest (AOI) that help to investigate the dynamics of the visual behavior of pilots. Consequently, several meta-metrics have been proposed to provide more information than common variables such as the number of fixations and saccades, the fixation durations, the saccade amplitude, and the standard dwell time. Researchers are however still searching for the best metrics for better insights into eye movements during scene exploration or inspection. In this work, we propose extending the formerly well established κ-coefficient metric defined by Krejtz et al. [2016] that allows discerning ambient and focal attention. Using AOI and transitions between them, we have derived a new measure that enables assessment of the distribution of visual attention (via eye-tracking data). Professional pilots’ eye movements were recorded while they were performing a flight scenario with full automation, including phases of flight (take-off, cruise, landing). Our analysis suggests that the take-off, cruise, and landing phases call for checking of specific areas, evidenced by the number of fixations and their durations. Furthermore, we compare our metric to the standard κ-coefficient and validate our approach using data collected during an experiment with 11 certified aircraft pilots. Here, we were able to show that the derived metric can be an interesting alternative for visual behavior investigation. The modified κ-coefficient can be used as a metric to investigate visual attention distribution, with application in cockpit monitoring assessment during training sessions or potentially during real flights.

[1]  D. Coppola,et al.  Idiosyncratic characteristics of saccadic eye movements when viewing different visual environments , 1999, Vision Research.

[2]  Mackenzie G Glaholt,et al.  Eye Tracking in the Cockpit: a Review of the Relationships between Eye Movements and the Aviators Cognitive State , 2014 .

[3]  Mickaël Causse,et al.  Intelligent cockpit: eye tracking integration to enhance the pilot-aircraft interaction , 2018, ETRA.

[4]  Arzu Çöltekin,et al.  Using coefficient K to distinguish ambient/focal visual attention during map viewing , 2017 .

[5]  Scott A. Shappell,et al.  A HUMAN ERROR APPROACH TO AVIATION ACCIDENT ANALYSIS , 2003 .

[6]  Rolf Zon,et al.  Eye Movements as an Indicator of Situation Awareness in a Flight Simulator Experiment , 2012 .

[7]  Yann-Gaël Guéhéneuc,et al.  Eye-Tracking Metrics in Software Engineering , 2015, 2015 Asia-Pacific Software Engineering Conference (APSEC).

[8]  R. Klein On the Control of Visual Orienting , 2004 .

[9]  Krzysztof Krejtz,et al.  Visualizing Dynamic Ambient/Focal Attention with Coefficient $$K$$ , 2015, ETVIS.

[10]  Zhen Wang,et al.  An Analysis of Pilot's Physiological Reactions in Different Flight Phases , 2014, HCI.

[11]  Vsevolod Peysakhovich,et al.  Flight Eye Tracking Assistant (FETA): Proof of Concept , 2019 .

[12]  Thierry Baccino,et al.  New insights into ambient and focal visual fixations using an automatic classification algorithm , 2011, i-Perception.

[13]  B. Velichkovsky,et al.  Time course of information processing during scene perception: The relationship between saccade amplitude and fixation duration , 2005 .

[14]  Vsevolod Peysakhovich,et al.  Assessment of Ocular and Physiological Metrics to Discriminate Flight Phases in Real Light Aircraft , 2018, Hum. Factors.

[15]  Andrew T. Duchowski,et al.  Discerning Ambient/Focal Attention with Coefficient K , 2016, ACM Trans. Appl. Percept..

[16]  J. Antes The time course of picture viewing. , 1974, Journal of experimental psychology.

[17]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[18]  Gal Ziv,et al.  Gaze Behavior and Visual Attention: A Review of Eye Tracking Studies in Aviation , 2016 .

[19]  Mickaël Causse,et al.  The Neuroergonomics of Aircraft Cockpits: The Four Stages of Eye-Tracking Integration to Enhance Flight Safety , 2018 .

[20]  David Woods,et al.  Situation Awareness: A Critical But Ill-Defined Phenomenon , 1991 .

[21]  Meredith Ringel Morris,et al.  Toward Everyday Gaze Input: Accuracy and Precision of Eye Tracking and Implications for Design , 2017, CHI.

[22]  Randall J. Mumaw Analysis of alerting system failures in commercial aviation accidents , 2017 .

[23]  J. Hoffman,et al.  The role of visual attention in saccadic eye movements , 1995, Perception & psychophysics.

[24]  Christopher D. Wickens,et al.  Eye-Tracking Measures in Aviation: A Selective Literature Review , 2018, The International Journal of Aerospace Psychology.

[25]  Steven G. Luke,et al.  Stable individual differences in saccadic eye movements during reading, pseudoreading, scene viewing, and scene search. , 2014, Journal of experimental psychology. Human perception and performance.

[26]  Amy L. Alexander,et al.  Attentional Tunneling and Task Management in Synthetic Vision Displays , 2009 .

[27]  Kai Puolamäki,et al.  Probabilistic approach to robust wearable gaze tracking , 2017 .

[28]  Alan Kennedy,et al.  Book Review: Eye Tracking: A Comprehensive Guide to Methods and Measures , 2016, Quarterly journal of experimental psychology.

[29]  J. Helmert,et al.  Visual Fixation Durations and Saccade Amplitudes: Shifting Relationship in a Variety of Conditions , 2008 .

[30]  Michela Terenzi,et al.  A Random Glance at the Flight Deck: Pilots' Scanning Strategies and the Real-Time Assessment of Mental Workload , 2007 .

[31]  B. Velichkovsky,et al.  Two Visual Systems and Their Eye Movements: Evidence from Static and Dynamic Scene Perception , 2005 .