A Random Glance at the Flight Deck: Pilots' Scanning Strategies and the Real-Time Assessment of Mental Workload

Based on previous research showing the usefulness of spatial statistics in detecting randomness in the distribution of eye fixations, this study investigated the ocular behavior of professional pilots engaged in a simulated flight. The distribution of eye fixations was used as an indirect index of mental workload: Eye movements were recorded during the different phases (departure to landing) of a simulated flight and were analyzed using spatial statistics algorithms. Results showed sensitivity of spatial dispersion indices to variations in mental workload: higher during departure and landing, lower during climb and descend, and the lowest during the cruise phase. This finding provides additional evidence of the utility of fixations distribution as a real-time measure of mental workload and, consequently, as a trigger for adaptive automation.

[1]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[2]  A. R. Ephrath,et al.  Instrument Scan—Is it an Indicator of the Pilot's Workload? , 1980 .

[3]  D. E. Irwin,et al.  Eye movements and scene perception: Memory for things observed , 2002, Perception & psychophysics.

[4]  G F Wilson,et al.  Evoked potential, cardiac, blink, and respiration measures of pilot workload in air-to-ground missions. , 1994, Aviation, space, and environmental medicine.

[5]  Glenn F. Wilson,et al.  An Analysis of Mental Workload in Pilots During Flight Using Multiple Psychophysiological Measures , 2002 .

[6]  Christopher D. Wickens,et al.  Situation Awareness and Workload in Aviation , 2002 .

[7]  Karel Brookhuis,et al.  Developments in Human Factors in Transportation, Design, and Evaluation , 2006 .

[8]  Hankins Tc,et al.  A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. , 1998, Aviation, space, and environmental medicine.

[9]  Joseph L. Bunecke.  Quantifying Some Information Processing Requirements of the Pilot's Instrument Crosscheck , 1987 .

[10]  Barry H. Kantowitz,et al.  Human workload in aviation , 1988 .

[11]  B. Velichkovsky,et al.  Time course of information processing during scene perception: The relationship between saccade amplitude and fixation duration , 2005 .

[12]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[13]  P. Hancock,et al.  Human Mental Workload , 1988 .

[14]  Francesco Di Nocera,et al.  Another look at scanpath: distance to nearest neighbour as a measure of mental workload , 2006 .

[15]  M. Scerbo.  STRESS, WORKLOAD, AND BOREDOM IN VIGILANCE: A PROBLEM AND AN ANSWER. , 2001 .

[16]  J. Pelz,et al.  Oculomotor behavior and perceptual strategies in complex tasks , 2001, Vision Research.

[17]  Dick de Waard,et al.  Eye scan patterns in a simulated ambulance dispatcher´s task. , 2006 .

[18]  C. Wickens,et al.  Visual scanning and pilot expertise: the role of attentional flexibility and mental model development. , 1997, Aviation, space, and environmental medicine.

[19]  A.W.K. Gaillard,et al.  Operator Functional State: The Assessment and Prediction of Human Performance Degradation in Complex Tasks , 2003 .

[20]  David C. Nagel,et al.  Human factors in aviation , 1988 .

[21]  Jeffrey T. Hansberger,et al.  TRACKING PILOT INTERACTIONS WITH FLIGHT MANAGEMENT SYSTEMS THROUGH EYE MOVEMENTS , 2001 .

[22]  S. Conte,et al.  Ultradian rhythms of reaction times in performance in vigilance tasks , 1995, Biological Psychology.

[23]  J. M. Peter,et al.  The Efficacy of Psychophysiological Measures for Implementing Adaptive Technology , 2001 .

[24]  Glenn F. Wilson,et al.  Psychophysiological responses to changes in workload during simulated air traffic control , 1996, Biological Psychology.

[25]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[26]  P. J. Clark,et al.  Distance to Nearest Neighbor as a Measure of Spatial Relationships in Populations , 1954 .

[27]  D. Kahneman,et al.  Attention and Effort , 1973 .

[28]  Sandra G. Hart,et al.  Inflight Evaluation of Four Measures of Pilot Workload , 1984 .

[29]  Jefferson M. Koonce,et al.  Human–automation interaction: Research and practice. , 1997 .

[30]  E. Granholm,et al.  Pupillary responses index cognitive resource limitations. , 1996, Psychophysiology.

[31]  Jayantha Katupitiya,et al.  Visual Scanning for , 2003 .

[32]  R L Harris,et al.  Visual scanning behavior and pilot workload. , 1982, Aviation, space, and environmental medicine.

[33]  Bor-Shong Liu,et al.  Inflight workload assessment: comparison of subjective and physiological measurements. , 2003, Aviation, space, and environmental medicine.

[34]  Y Itoh,et al.  The ergonomic evaluation of eye movement and mental workload in aircraft pilots. , 1990, Ergonomics.

[35]  J. Arruda,et al.  Rhythmic Oscillations in the Performance of a Sustained Attention Task , 2003, Journal of clinical and experimental neuropsychology.

[36]  Leslie G. Ungerleider.  Two cortical visual systems , 1982 .

[37]  J. Beatty.  Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982, Psychological bulletin.