Eye-Tracking Measures in Aviation: A Selective Literature Review

ABSTRACT Objective: The aim of this article is to present a comprehensive review of eye-tracking measures and discuss different application areas of the method of eye tracking in the field of aviation. Background: Psychophysiological measures such as eye tracking in pilots are useful for detecting fatigue or high-workload conditions, for investigating motion sickness and hypoxia, or for assessing display improvements and expertise. Method: We review the uses of eye tracking on pilots and include eye-tracking studies published in aviation journals, with both a historical and contemporary view. We include 79 papers and assign the results to the following three categories: Human performance, aircraft design, health and physiological factors affecting performance. We then summarize the different uses of eye tracking in each category and highlight metrics which turned out to be useful in each area. Our review is complementary to that of Ziv (2016). Results: On the basis of these analyses, we propose useful application areas for the measurement of eye tracking. Eye tracking has the potential to be effective in terms of preventing errors or injuries by detecting, for example, fatigue or performance decrements. Applied in an appropriate manner in simulated or real flight it can help to ensure optimal functioning of man–machine systems. Conclusion: Further aviation psychology and aerospace medicine research will benefit from measurement of eye movements.

[1]  Timothy J. Mavin,et al.  Using Pupillometry and Electromyography to Track Positive and Negative Affect During Flight Simulation , 2014 .

[2]  P K Hughes,et al.  Eye movement behaviour viewing colour-coded and monochrome avionic displays. , 1994, Ergonomics.

[3]  Andrés Catena,et al.  Intersaccadic drift velocity is sensitive to short‐term hypobaric hypoxia , 2014, The European journal of neuroscience.

[4]  C. Wickens.  The Cambridge Handbook of Applied Perception Research: Noticing Events in the Visual Workplace: The SEEV and NSEEV Models , 2017 .

[5]  Jun Maruta,et al.  Attention and visual tracking degradation during acute sleep deprivation in a military sample. , 2014, Aviation, space, and environmental medicine.

[6]  J. L. Greig,et al.  Involuntary eye responses as measures of fatigue in US Army Apache aviators. , 2005, Aviation, space, and environmental medicine.

[7]  D Regan,et al.  Device for measuring the precision of eye-hand coordination while tracking changing size. , 1980, Aviation, space, and environmental medicine.

[8]  Andrés Catena,et al.  Fatigue in the military: towards a fatigue detection test based on the saccadic velocity , 2016, Physiological measurement.

[9]  Elizabeth Broadbent,et al.  Avoiding involuntary sleep during civil air operations: validation of a wrist-worn alertness device. , 2005, Aviation, space, and environmental medicine.

[10]  G M Gauthier,et al.  Adapted head- and eye-movement responses to added-head inertia. , 1986, Aviation, space, and environmental medicine.

[11]  Christopher D. Wickens,et al.  Attentional Models of Multitask Pilot Performance Using Advanced Display Technology , 2003, Hum. Factors.

[12]  Gal Ziv,et al.  Gaze Behavior and Visual Attention: A Review of Eye Tracking Studies in Aviation , 2016 .

[13]  J D Enderle.  Observations on pilot neurosensory control performance during saccadic eye movements. , 1988, Aviation, space, and environmental medicine.

[14]  H W Leibowitz,et al.  The effects of fixation and restricted visual field on vection-induced motion sickness. , 1990, Aviation, space, and environmental medicine.

[15]  W Bles,et al.  Eye movements to yaw, pitch, and roll about vertical and horizontal axes: adaptation and motion sickness. , 2002, Aviation, space, and environmental medicine.

[16]  Robert S. Allison,et al.  Pilot gaze and glideslope control , 2010, TAP.

[17]  N. Wright,et al.  Vigilance on the civil flight deck: incidence of sleepiness and sleep during long-haul flights and associated changes in physiological parameters , 2001, Ergonomics.

[18]  John M. Flach,et al.  Information Processing in Aviation , 2010 .

[19]  Kathleen L. Mosier.  Chapter 6 – The Human in Flight: From Kinesthetic Sense to Cognitive Sensibility , 2010 .

[20]  John P. McIntire,et al.  Eye Metrics: An Alternative Vigilance Detector , 2012 .

[21]  Lora J Wu,et al.  Subjective Measurements of In-Flight Sleep, Circadian Variation, and Their Relationship with Fatigue. , 2016, Aerospace medicine and human performance.

[22]  Anthony P Tvaryanas,et al.  Visual scan patterns during simulated control of an uninhabited aerial vehicle (UAV). , 2004, Aviation, space, and environmental medicine.

[23]  Bob Cheung,et al.  Eye tracking, point of gaze, and performance degradation during disorientation. , 2003, Aviation, space, and environmental medicine.

[24]  John W. Senders,et al.  The Human Operator as a Monitor and Controller of Multidegree of Freedom Systems , 1964 .

[25]  S Hu,et al.  Optokinetic nystagmus correlates with severity of vection-induced motion sickness and gastric tachyarrhythmia. , 1998, Aviation, space, and environmental medicine.

[26]  J C Kotulak,et al.  Focus adjustment effects on visual acuity and oculomotor balance with aviator night vision displays. , 1994, Aviation, space, and environmental medicine.

[27]  Wen-Chin Li,et al.  Pilots' Visual Scan Patterns and Attention Distribution During the Pursuit of a Dynamic Target. , 2016, Aerospace medicine and human performance.

[28]  Xu Wu,et al.  Pilot's visual attention allocation modeling under fatigue. , 2015, Technology and health care : official journal of the European Society for Engineering and Medicine.

[29]  Jacqueline A Duley.  Effects of cockpit display of traffic information on visual attention and eye movements in the general aviation cockpit , 2001 .

[30]  J P Roll,et al.  The interaction of hand vibration with oculomanual coordination in pursuit tracking. , 1991, Aviation, space, and environmental medicine.

[31]  Y Itoh,et al.  The ergonomic evaluation of eye movement and mental workload in aircraft pilots. , 1990, Ergonomics.

[32]  M. Griffin,et al.  Optokinetic stimuli: motion sickness, visual acuity, and eye movements. , 2002, Aviation, space, and environmental medicine.

[33]  K. Ukai,et al.  Visually induced motion sickness with radial displays: effects of gaze angle and fixation. , 2007, Aviation, space, and environmental medicine.

[34]  Ji Hyun Yang,et al.  Helicopter pilot scan techniques during low-altitude high-speed flight. , 2014, Aviation, space, and environmental medicine.

[35]  J. Enderle,et al.  Relationships between manual reaction time and saccade latency in response to visual and auditory stimuli. , 1991, Aviation, space, and environmental medicine.

[36]  Hankins Tc,et al.  A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. , 1998, Aviation, space, and environmental medicine.

[37]  G M Gauthier,et al.  Dynamic analysis of human visuo-oculo-manual coordination control in target tracking tasks. , 1993, Aviation, space, and environmental medicine.

[38]  Jaime R. Carbonell,et al.  A Queueing Model of Visual Sampling Experimental Validation , 1968 .

[39]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[40]  Wen-Chin Li,et al.  Pilots' Attention Distributions Between Chasing a Moving Target and a Stationary Target. , 2016, Aerospace medicine and human performance.

[41]  Wen-Chin Li,et al.  Pilots' visual scan patterns and situation awareness in flight operations. , 2014, Aviation, space, and environmental medicine.

[42]  Rolf Zon,et al.  Eye Movements as an Indicator of Situation Awareness in a Flight Simulator Experiment , 2012 .

[43]  Bernard Claverie,et al.  Eyepiece focus and vergence/accommodation conflict: Implications for night vision devices , 2010 .

[44]  Joseph Demaio,et al.  A Reaction Time Analysis of Instrument Scanning , 1978 .

[45]  Michael Stein,et al.  Tracking Visual Scanning Techniques in Training Simulation for Helicopter Landing , 2013 .

[46]  Joseph C. Hickox,et al.  Eye Scan Patterns of Experienced and Novice Pilots during Visual Flight Rules (VFR) Navigation , 1999 .

[47]  Christopher D. Wickens,et al.  Attention-Situation Awareness (A-SA) Model of Pilot Error , 2007 .

[48]  Gregory Belenky,et al.  Oculomotor responses during partial and total sleep deprivation. , 2005, Aviation, space, and environmental medicine.

[49]  Christopher D. Wickens,et al.  Pilots Strategically Compensate for Display Enlargements in Surveillance and Flight Control Tasks , 2006, Hum. Factors.

[50]  Daniel W. Repperger,et al.  Evaluation of Eye Metrics as a Detector of Fatigue , 2011, Hum. Factors.

[51]  Erik D. Reichle,et al.  Eye movements in reading and information processing : , 2015 .

[52]  Lakhmi C. Jain,et al.  Monitoring pilot "Situation Awareness" , 2013, J. Intell. Fuzzy Syst..

[53]  Stephen E. Morse,et al.  Oculomotor Responses with Aviator Helmet-Mounted Displays and Their Relation to In-Flight Symptoms , 1995, Hum. Factors.

[54]  Arthur F. Kramer,et al.  Information Extraction during Instrument Flight: An Evaluation of the Validity of the Eye-Mind Hypothesis , 1996 .

[55]  Amy L. Alexander,et al.  Attentional Tunneling and Task Management in Synthetic Vision Displays , 2009 .

[56]  Glenn F. Wilson,et al.  Recording of Psychophysiological Data During Aerobatic Training , 2011 .

[57]  Vsevolod Peysakhovich,et al.  Pilot Flying and Pilot Monitoring’s Aircraft State Awareness During Go-Around Execution in Aviation: A Behavioral and Eye Tracking Study , 2017 .

[58]  E J Engelken,et al.  Saccadic eye movements in response to visual, auditory, and bisensory stimuli. , 1989, Aviation, space, and environmental medicine.

[59]  R L Harris,et al.  Visual scanning behavior and mental workload in aircraft pilots. , 1982, Aviation, space, and environmental medicine.

[60]  D B Chaffin,et al.  Postural effects on biomechanical and psychophysical weight-lifting limits. , 1994, Ergonomics.

[61]  Michael Day,et al.  Training simulation for helicopter navigation by characterizing visual scan patterns. , 2011, Aviation, space, and environmental medicine.

[62]  Stephanie M. Doane,et al.  ADAPT: A Predictive Cognitive Model of User Visual Attention and Action Planning , 2000, User Modeling and User-Adapted Interaction.

[63]  Michael B. McCamy,et al.  Effects of long and short simulated flights on the saccadic eye movement velocity of aviators , 2016, Physiology & Behavior.

[64]  Christopher D. Wickens,et al.  Eye-tracking and Individual Differences in off-Normal Event Detection when Flying with a Synthetic Vision System Display , 2004 .

[65]  Björn Peters,et al.  Hearing loss and a supportive tactile signal in a navigation system : effects on driving behavior and eye movements , 2013 .

[66]  Yves Gourinat,et al.  The role of Pilots' monitoring strategies in flight performance , 2016 .

[67]  Staffan Nählinder,et al.  Mental Workload in Aircraft and Simulator During Basic Civil Aviation Training , 2009 .

[68]  J R Lackner,et al.  Multiple sensory and motor cues enhance the accuracy of pursuit eye movements. , 1980, Aviation, space, and environmental medicine.

[69]  R Malcolm.  Pilot disorientation and the use of a peripheral vision display. The 1983 Annual Harry G. Armstrong Lecture. , 1984, Aviation, space, and environmental medicine.

[70]  Terry L. Morris,et al.  Electrooculographic indices of changes in simulated flying performance , 1985 .

[71]  B. Cheung,et al.  Physiological and behavioral responses to an exposure of pitch illusion in the simulator. , 2004, Aviation, space, and environmental medicine.

[72]  C. Wickens,et al.  Visual scanning and pilot expertise: the role of attentional flexibility and mental model development. , 1997, Aviation, space, and environmental medicine.

[73]  D. G. Newman,et al.  ALCOHOL AND HUMAN PERFORMANCE FROM AN AVIATION PERSPECTIVE: A REVIEW , 2004 .

[74]  Fred H. Previc,et al.  The Effects of Sleep Deprivation on Flight Performance, Instrument Scanning, and Physiological Arousal in Pilots , 2009 .

[75]  Dennis B. Beringer,et al.  A comparison of pilot navigation performance using conventional instrumentation, head-down, and head-up highway-in-the-sky primary flight displays , 2001 .

[76]  L. T,et al.  Electrooculographic and performance indices of fatigue during simulated flight , 2022 .

[77]  Mark R. Wilson,et al.  Individual reactions to stress predict performance during a critical aviation incident , 2015, Anxiety, stress, and coping.

[78]  Lianbing Lin,et al.  Gene cloning, sequence analysis and heterologous expression of a novel cold-active lipase from Pseudomonas sp. PF16. , 2015, Technology and health care : official journal of the European Society for Engineering and Medicine.

[79]  E Lafontaine,et al.  Vestibular habituation in flightcrew. , 1976, Aviation, space, and environmental medicine.

[80]  G. R. J. Hockey,et al.  Applied Attention Theory , 2009 .

[81]  J. Stepánek,et al.  Acute hypoxic hypoxia and isocapnic hypoxia effects on oculometric features. , 2014, Aviation, space, and environmental medicine.

[82]  Jonathan Allsop,et al.  Flying under pressure: Effects of anxiety on attention and gaze behavior in aviation , 2014 .

[83]  Daniel G. Morrow,et al.  Expertise Differences in Attentional Strategies Related to Pilot Decision Making , 2008, Hum. Factors.

[84]  Frank Kooi.  A display with two depth layers: attentional segregation and declutter , 2011 .

[85]  J Szczechura,et al.  Oculographic assessment of workload influence on flight performance. , 1998, The International journal of aviation psychology.

[86]  Mariusz Wyleżoł,et al.  Hypoxia and Coriolis Illusion in Pilots During Simulated Flight. , 2016, Aerospace medicine and human performance.

[87]  Christopher D. Wickens,et al.  Effects of Data-Link Modality and Display Redundancy on Pilot Performance: An Attentional Perspective , 2003 .

[88]  Scott M. Galster,et al.  Physiological Indicators of Workload in a Remotely Piloted Aircraft Simulation , 2015 .

[89]  Ji Hyun Yang,et al.  Pilot performance: assessing how scan patterns & navigational assessments vary by flight expertise. , 2013, Aviation, space, and environmental medicine.

[90]  Chiara Knecht,et al.  Situation Awareness Training for General Aviation Pilots using Eye Tracking , 2016 .

[91]  A J Benson,et al.  Visual-vestibular interaction in the control of eye movement. , 1978, Aviation, space, and environmental medicine.

[92]  Mickaël Causse,et al.  Reward and Uncertainty Favor Risky Decision-Making in Pilots: Evidence from Cardiovascular and Oculometric Measurements , 2011, Applied psychophysiology and biofeedback.