I spy with my little eye: Analysis of airline pilots' gaze patterns in a manual instrument flight scenario.

The aim of this study was to analyze pilots' visual scanning in a manual approach and landing scenario. Manual flying skills suffer from increasing use of automation. In addition, predominantly long-haul pilots with only a few opportunities to practice these skills experience this decline. Airline pilots representing different levels of practice (short-haul vs. long-haul) had to perform a manual raw data precision approach while their visual scanning was recorded by an eye-tracking device. The analysis of gaze patterns, which are based on predominant saccades, revealed one main group of saccades among long-haul pilots. In contrast, short-haul pilots showed more balanced scanning using two different groups of saccades. Short-haul pilots generally demonstrated better manual flight performance and within this group, one type of scan pattern was found to facilitate the manual landing task more. Long-haul pilots tend to utilize visual scanning behaviors that are inappropriate for the manual ILS landing task. This lack of skills needs to be addressed by providing specific training and more practice.

[1]  Ji Hyun Yang,et al.  Pilot performance: assessing how scan patterns & navigational assessments vary by flight expertise. , 2013, Aviation, space, and environmental medicine.

[2]  I. D. Brown,et al.  Components of driving skill: experience does not mean expertise , 1991 .

[3]  Jean Underwood,et al.  Visual attention while driving: sequences of eye fixations made by experienced and novice drivers , 2003, Ergonomics.

[4]  T. Foulsham,et al.  Comparing scanpaths during scene encoding and recognition : A multi-dimensional approach , 2012 .

[5]  Nadine B. Sarter,et al.  Pilot Interaction With Cockpit Automation II: An Experimental Study of Pilots’ Model and Awareness of the Flight Management System , 1994 .

[6]  Riender Happee,et al.  Changes of driving performance and gaze behavior of novice drivers during a 30-min simulator-based training , 2015 .

[7]  Timothy John Mavin,et al.  Can competency-based training fly?: An overview of key issues for ab initio pilot training , 2014 .

[8]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[9]  C. Wickens,et al.  Visual scanning and pilot expertise: the role of attentional flexibility and mental model development. , 1997, Aviation, space, and environmental medicine.

[10]  K L Shapiro,et al.  Training of efficient oculomotor strategies enhances skill acquisition. , 1989, Acta psychologica.

[11]  Steven J. Landry,et al.  Using Scanpaths as a Learning Method for a Conflict Detection Task of Multiple Target Tracking , 2014, Hum. Factors.

[12]  Alexander C. Schütz,et al.  Eye movements and perception: a selective review. , 2011, Journal of vision.

[13]  Klaus Bengler,et al.  The relationship between pilots' manual flying skills and their visual behavior: a flight simulator study using eye tracking , 2012 .

[14]  T. Gog,et al.  In the eyes of the beholder: How experts and novices interpret dynamic stimuli , 2010 .

[15]  A. A. Spady,et al.  Analytical techniques of pilot scanning behavior and their application , 1986 .

[16]  Christopher D. Wickens,et al.  Modeling the Control of Attention in Visual Workspaces , 2011, Hum. Factors.

[17]  Joseph C. Hickox,et al.  Eye Scan Patterns of Experienced and Novice Pilots during Visual Flight Rules (VFR) Navigation , 1999 .

[18]  Pascal Traverse.  Airbus Electrical Flight Controls:: A Family of Fault-Tolerant Systems , 2014 .

[19]  John W. Senders,et al.  THE ATTENTIONAL DEMAND OF AUTOMOBILE DRIVING , 1967 .

[20]  D. H. Jones.  An error-dependent model of instrument-scanning behavior in commercial airline pilots. Ph.D. Thesis - May 1983 , 1985 .

[21]  R L Harris,et al.  Visual scanning behavior and pilot workload. , 1982, Aviation, space, and environmental medicine.

[22]  Alan Kingstone,et al.  Recurrence quantification analysis of eye movements , 2013, Behavior Research Methods.

[23]  Pascal Traverse,et al.  AIRBUS A320/A330/A340 electrical flight controls - A family of fault-tolerant systems , 1993, FTCS-23 The Twenty-Third International Symposium on Fault-Tolerant Computing.

[24]  C. Favre,et al.  Fly-by-wire for commercial aircraft: the Airbus experience , 1994 .

[25]  P. Perona,et al.  Objects predict fixations better than early saliency. , 2008, Journal of vision.

[26]  Björn Peters,et al.  Hearing loss and a supportive tactile signal in a navigation system : effects on driving behavior and eye movements , 2013 .

[27]  Peter Chapman,et al.  VISUAL SEARCH PATTERNS IN TRAINED AND UNTRAINED NOVICE DRIVERS , 2002 .

[28]  Matthew Ebbatson.  The Loss of Manual Flying Skills in Pilots of Highly Automated Airliners , 2009 .

[29]  David Harris,et al.  A comparative survey of the utility of cross-cockpit linkages and autoflight systems' backfeed to the control inceptors of commercial aircraft , 1998 .

[30]  Jonathan Allsop,et al.  Flying under pressure: Effects of anxiety on attention and gaze behavior in aviation , 2014 .

[31]  Renwick E. Curry,et al.  Flight-deck automation: promises and problems , 1980 .

[32]  Christopher D. Wickens,et al.  Situation Awareness and Workload in Aviation , 2002 .

[33]  Joseph C. Hickox,et al.  COMPARISON OF EXPERT AND NOVICE SCAN BEHAVIORS DURING VFR FLIGHT , 2001 .

[34]  Alan Kennedy,et al.  Book Review: Eye Tracking: A Comprehensive Guide to Methods and Measures , 2016, Quarterly journal of experimental psychology.

[35]  Nadine B. Sarter,et al.  Pilot Interaction With Cockpit Automation: Operational Experiences With the Flight Management System , 1992 .

[36]  J.-C. Angue,et al.  Quantitative analysis of mental workload influence on eye scanning movements , 1993, Proceedings of IEEE Systems Man and Cybernetics Conference - SMC.

[37]  L. Mulder,et al.  Please Scroll down for Article Ergonomics Cardiovascular and Eye Activity Measures as Indices for Momentary Changes in Mental Effort during Simulated Flight Cardiovascular and Eye Activity Measures as Indices for Momentary Changes in Mental Effort during Simulated Flight , 2022 .

[38]  P A Hancock,et al.  Pilot performance and preference for short cycles of automation in adaptive function allocation. , 1995, Applied ergonomics.

[39]  Klaus Bengler,et al.  Pilots’ gaze strategies and manual control performance using occlusion as a measurement technique during a simulated manual flight task , 2016, Cognition, Technology & Work.

[40]  Andreas Haslbeck,et al.  Flying the Needles , 2016, Hum. Factors.

[41]  A. A. Spady.  Airline pilot scan patterns during simulated ILS approaches , 1978 .

[42]  L. Stark,et al.  Scanpaths in Eye Movements during Pattern Perception , 1971, Science.

[43]  A. O. Dick.  Instrument scanning and controlling: Using eye movement data to understand pilot behavior and strategies , 1980 .

[44]  Frank Schieber,et al.  Visual Entropy Metric Reveals Differences in Drivers' Eye Gaze Complexity across Variations in Age and Subsidiary Task Load , 2008 .

[45]  Eileen Kowler.  Eye movements: The past 25years , 2011, Vision Research.

[46]  Paul Milgram,et al.  Determining Fixed Glance Duration for Visual Occlusion Research , 2011 .

[47]  Miwa Hayashi,et al.  Hidden Markov Models for Analysis of Pilot Instrument Scanning and Attention Switching , 2004 .

[48]  Michela Terenzi,et al.  Using the Distribution of Eye Fixations to Assess Pilots' Mental Workload , 2006 .

[49]  Steven J. Landry,et al.  An Eye Movement Analysis Algorithm for a Multielement Target Tracking Task: Maximum Transition-Based Agglomerative Hierarchical Clustering , 2015, IEEE Transactions on Human-Machine Systems.

[50]  Enkelejda Kasneci,et al.  Automated Visual Scanpath Analysis Reveals the Expertise Level of Micro-neurosurgeons , 2015 .

[51]  Patrick R Veillette,et al.  DIFFERENCES IN AIRCREW MANUAL SKILLS IN AUTOMATED AND CONVENTIONAL FLIGHT DECKS , 1995 .

[52]  C. Koch,et al.  Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. , 2008, Journal of vision.

[53]  Christopher W. Myers,et al.  Scan pattern adaptation during repeated visual search , 2007 .

[54]  Thomas Martinetz,et al.  Variability of eye movements when viewing dynamic natural scenes. , 2010, Journal of vision.

[55]  George W. McConkie,et al.  Eye Movements and Perception during Reading. , 1982 .

[56]  Randall L. Harris,et al.  What Do Pilots See in Displays? , 1980 .

[57]  Michael Stein,et al.  Tracking Visual Scanning Techniques in Training Simulation for Helicopter Landing , 2013 .

[58]  Paul A. Wetzel,et al.  Instructor Use of Eye Position Based Feedback for Pilot Training , 1998 .

[59]  Kurt Colvin,et al.  Is Pilots’ Visual Scanning Adequate to Avoid Mid-Air Collisions? , 2005 .

[60]  Jorg Onno Entzinger,et al.  Inside the Pilot's Mind : Visual Information Use in Manual Aircraft Landings , 2012 .