Pilots’ gaze strategies and manual control performance using occlusion as a measurement technique during a simulated manual flight task

The aim of this study was to analyze pilots’ visual scanning under conditions visually restricted by the occlusion paradigm. During manual flight, pilots experienced interruptions in their panel scan due to concurring tasks and monitoring of distant displays. Eleven volunteer airline pilots performed several manual instrument landing system approaches in a fixed-base flight simulator. Some of these approaches were performed using the paradigm of occlusion with shutter glasses. Under occlusion, the gaze pattern analysis revealed that pilots demonstrated reduced mean glance durations, but did not reduce their attention to lesser information displays. The results also indicated that the attitude indicator (artificial horizon) as a preview instrument was less affected by occlusion compared to other areas of interest. A subsequent scanpath analysis revealed that vertical tracking was the predominant information acquisition strategy and corresponded to larger deviations on the glideslope. These results imply the need to optimize information even for short glances, and to be very cautious with adaptive layouts of free programmable or dynamic displays, and not to overburden the pilot flying with parallel tasks.

[1]  Richard van der Horst,et al.  Occlusion as a measure for visual workload: an overview of TNO occlusion research in car driving. , 2004 .

[2]  Patrick Gontar,et al.  Analyse menschlier Informationsverarbeitung am Beispiel manuellen Fliegens , 2014 .

[3]  S R Ellis,et al.  Statistical Dependency in Visual Scanning , 1986, Human factors.

[4]  Andrew Liu Chapter 20 – What the Driver's Eye Tells the Car's Brain , 1998 .

[5]  K L Shapiro,et al.  Training of efficient oculomotor strategies enhances skill acquisition. , 1989, Acta psychologica.

[6]  Richard E. Edwards,et al.  Pilot Visual Behavior as a Function of Navigation and Flight Control Modes in the Boeing 757/767 , 1982 .

[7]  Don Harris,et al.  The relationship between manual handling performance and recent flying experience in air transport pilots , 2010, Ergonomics.

[8]  Christopher D. Wickens,et al.  Effects of Data-Link Modality and Display Redundancy on Pilot Performance: An Attentional Perspective , 2003 .

[9]  R. Sleight,et al.  The effect of instrument dial shape on legibility. , 1948, The Journal of applied psychology.

[10]  Shama C. Akhtar,et al.  The role of visual occlusion in altitude maintenance during simulated flight. , 2008, Journal of experimental psychology. Human perception and performance.

[11]  Kurt Colvin,et al.  Is Pilots’ Visual Scanning Adequate to Avoid Mid-Air Collisions? , 2005 .

[12]  Florence Wilcock ONE TEAM. , 2016, Midwives.

[13]  Christopher W. Myers,et al.  Scan pattern adaptation during repeated visual search , 2007 .

[14]  Paul Milgram,et al.  A spectacle-mounted liquid-crystal tachistoscope , 1987 .

[15]  J. Flach Control With an Eye for Perception: Precursors to an Active Psychophysics , 1990 .

[16]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[17]  Klaus Bengler,et al.  Comparing Occlusion Method by Display Blanking to Occlusion Goggles , 2015 .

[18]  Patrick Gontar,et al.  Adaption hochgradig geübter psychomotorischer Muster an ungewohnte Simulationsumgebungen am Beispiel von Piloten , 2013 .

[19]  Christhard Gelau,et al.  The occlusion technique: a procedure to assess the HMI of in-vehicle information and communication systems. , 2004, Applied ergonomics.

[20]  Patrick Gontar,et al.  Untersuchung der Nutzung des Primary Flight Displays durch Piloten unterschiedlicher Trainiertheit mittels Blickerfassung , 2012 .

[21]  Christopher A. Monk,et al.  The Attentional Costs of Interrupting Task Performance at Various Stages , 2002 .

[22]  Paul Milgram,et al.  Determining Fixed Glance Duration for Visual Occlusion Research , 2011 .

[23]  Miwa Hayashi,et al.  Hidden Markov Models for Analysis of Pilot Instrument Scanning and Attention Switching , 2004 .

[24]  Andreas Haslbeck,et al.  Flying the Needles , 2016, Hum. Factors.

[25]  Richard van der Horst,et al.  Occlusion as a measure for visual workload: an overview of TNO occlusion research in car driving. , 2004, Applied ergonomics.

[26]  Charles H Morris,et al.  Pilot mental workload: how well do pilots really perform? , 2006, Ergonomics.

[27]  A. A. Spady Airline pilot scan patterns during simulated ILS approaches , 1978 .

[28]  C Trujillo Anna,et al.  Flight Crew Task Management in Non-Normal Situations , 1996 .

[29]  Alf Zimmer,et al.  Information Systems in Transportation , 2012 .

[30]  Christopher D. Wickens,et al.  Modeling the Control of Attention in Visual Workspaces , 2011, Hum. Factors.

[31]  D. H. Jones An error-dependent model of instrument-scanning behavior in commercial airline pilots. Ph.D. Thesis - May 1983 , 1985 .

[32]  Jean Underwood,et al.  Visual attention while driving: sequences of eye fixations made by experienced and novice drivers , 2003, Ergonomics.

[33]  Nadine B. Sarter,et al.  Pilot Interaction With Cockpit Automation II: An Experimental Study of Pilots’ Model and Awareness of the Flight Management System , 1994 .

[34]  W D Spears,et al.  Flight-Skill Decay and Recurrent Training , 1986, Perceptual and motor skills.

[35]  Klaus Bengler,et al.  A Flight Simulator Study to Evaluate Manual Flying Skills of Airline Pilots , 2014 .

[36]  Klaus Bengler,et al.  Evaluating visual display designs in vehicles: Advantages and disadvantages of the occlusion technique , 2000, Advanced Network Enterprises.

[37]  John W. Senders,et al.  THE ATTENTIONAL DEMAND OF AUTOMOBILE DRIVING , 1967 .

[38]  Amy L. Alexander,et al.  Attentional Tunneling and Task Management in Synthetic Vision Displays , 2009 .

[39]  A. O. Dick Instrument scanning and controlling: Using eye movement data to understand pilot behavior and strategies , 1980 .

[40]  Alan Kingstone,et al.  Recurrence quantification analysis of eye movements , 2013, Behavior Research Methods.

[41]  Tom Foulsham,et al.  Optimal and Preferred Eye Landing Positions in Objects and Scenes , 2013, Quarterly journal of experimental psychology.

[42]  Randall L. Harris,et al.  What Do Pilots See in Displays? , 1980 .

[43]  Steven J. Landry,et al.  An Eye Movement Analysis Algorithm for a Multielement Target Tracking Task: Maximum Transition-Based Agglomerative Hierarchical Clustering , 2015, IEEE Transactions on Human-Machine Systems.

[44]  S. Borin,et al.  Annual Meeting , 1917, Pediatric Research.

[45]  Peter Sandl,et al.  Information ergonomics : a theoretical approach and practical experience in transportation , 2012 .