Attentional costs and failures in air traffic control notifications

Large display screens are common in supervisory tasks, meaning that alerts are often perceived in peripheral vision. Five air traffic control notification designs were evaluated in their ability to capture attention during an ongoing supervisory task, as well as their impact on the primary task. A range of performance measures, eye-tracking and subjective reports showed that colour, even animated, was less effective than movement, and notifications sometimes went unnoticed. Designs that drew attention to the notified aircraft by a pulsating box, concentric circles or the opacity of the background resulted in faster perception and no missed notifications. However, the latter two designs were intrusive and impaired primary task performance, while the simpler animated box captured attention without an overhead cognitive cost. These results highlight the need for a holistic approach to evaluation, achieving a balance between the benefits for one aspect of performance against the potential costs for another. Practitioner summary: We performed a holistic examination of air traffic control notification designs regarding their ability to capture attention during an ongoing supervisory task. The combination of performance, eye-tracking and subjective measurements demonstrated that the best design achieved a balance between attentional power and the overhead cognitive cost to primary task performance.

[1]  S. Tremblay,et al.  Cognitive conflict in human-automation interactions: a psychophysiological study. , 2012, Applied ergonomics.

[2]  John T. Stasko,et al.  Establishing tradeoffs that leverage attention for utility: empirically evaluating information display in notification systems , 2003, Int. J. Hum. Comput. Stud..

[3]  K. Rayner The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[4]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[5]  Kang Chen,et al.  Visual Attention and Eye Movements , 2008 .

[6]  Tommy Strandvall,et al.  Eye Tracking in Human-Computer Interaction and Usability Research , 2009, INTERACT.

[7]  Sébastien Tremblay,et al.  Background Sound Impairs Interruption Recovery in Dynamic Task Situations: Procedural Conflict? , 2014 .

[8]  J. Gregory Trafton,et al.  Preparing to resume an interrupted task: effects of prospective goal encoding and retrospective rehearsal , 2003, Int. J. Hum. Comput. Stud..

[9]  Jean-Paul Imbert,et al.  The LABY Microworld , 2014 .

[10]  D. Simons,et al.  Do New Objects Capture Attention? , 2005, Psychological science.

[11]  C. Chabris,et al.  Gorillas in Our Midst: Sustained Inattentional Blindness for Dynamic Events , 1999, Perception.

[12]  Nadine B. Sarter,et al.  Why Pilots Miss the Green Box: How Display Context Undermines Attention Capture , 2004 .

[13]  Christopher D Wickens,et al.  Great expectations: top-down attention modulates the costs of clutter and eccentricity. , 2013, Journal of experimental psychology. Applied.

[14]  S. Yantis,et al.  Abrupt visual onsets and selective attention: voluntary versus automatic allocation. , 1990, Journal of experimental psychology. Human perception and performance.

[15]  Thomas W. Calvert,et al.  Moving Icons: Detection and Distraction , 2001, INTERACT.

[16]  Nilli Lavie,et al.  The role of perceptual load in inattentional blindness , 2007, Cognition.

[17]  Richard T. Kelly,et al.  Eye Tracking in Tactical Decision Making Environments: Implications for Decision Support Evaluation * , 1997 .

[18]  Christopher D. Wickens,et al.  Modeling the Control of Attention in Visual Workspaces , 2011, Hum. Factors.

[19]  William Knight,et al.  Moving icons as a human interrupt , 1992, Int. J. Hum. Comput. Interact..

[20]  Sébastien Tremblay,et al.  Insights from Eye Movement into Dynamic Decision-Making Research and Usability Testing , 2013, HCI.

[21]  Sébastien Tremblay,et al.  Using auditory streaming to reduce disruption to serial memory by extraneous auditory warnings. , 2003, Journal of experimental psychology. Applied.

[22]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[23]  E. Ancman Peripherally located CRTs: color perception limitations , 1991, Proceedings of the IEEE 1991 National Aerospace and Electronics Conference NAECON 1991.

[24]  Christopher D. Wickens,et al.  The Structure of Attentional Resources , 1980 .

[25]  Brian P. Bailey,et al.  The Effects of Interruptions on Task Performance, Annoyance, and Anxiety in the User Interface , 2001, INTERACT.

[26]  Mickaël Causse,et al.  Mitigation of Conflicts with Automation , 2011, Hum. Factors.

[27]  Jacquelyn M. Crebolder,et al.  Investigating Visual Alerting in Complex Command and Control Environments , 2012 .

[28]  Linden J. Ball,et al.  Eye Tracking in Human-Computer Interaction and Usability Research : Current Status and Future Prospects , 2004 .

[29]  Paula J. Durlach,et al.  Effects of Action Video Game Experience on Change Detection , 2009 .

[30]  D. Pearson,et al.  Oculomotor Control and the Maintenance of Spatially and Temporally Distributed Events in Visuo-Spatial Working Memory , 2003, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[31]  John T. Stasko,et al.  Evaluating Animation in the Periphery as a Mechanism for Maintaining Awarness , 2001, INTERACT.

[32]  Thomas W. Calvert,et al.  Moticons: : detection, distraction and task , 2003, Int. J. Hum. Comput. Stud..

[33]  Daniel Lafond,et al.  A Cognitive and Holistic Approach to Developing Metrics for Decision Support Incommand and Control , 2010 .

[34]  Steven B. Most,et al.  What you see is what you set: sustained inattentional blindness and the capture of awareness. , 2005, Psychological review.

[35]  Nadine B. Sarter,et al.  Pilot Interaction With Cockpit Automation II: An Experimental Study of Pilots’ Model and Awareness of the Flight Management System , 1994 .

[36]  Amy L. Alexander,et al.  Attentional Tunneling and Task Management in Synthetic Vision Displays , 2009 .

[37]  M. Masson Using confidence intervals for graphically based data interpretation. , 2003, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[38]  Giovanni Galfano,et al.  Color, form and luminance capture attention in visual search , 2000, Vision Research.

[39]  R. Marois,et al.  Visual Short-Term Memory Load Suppresses Temporo-Parietal Junction Activity and Induces Inattentional Blindness , 2005, Psychological science.

[40]  Christopher D. Wickens,et al.  False Alerts in Air Traffic Control Conflict Alerting System: Is There a “Cry Wolf” Effect? , 2009, Hum. Factors.

[41]  Dylan M. Jones,et al.  Auditory attentional capture during serial recall: violations at encoding of an algorithm-based neural model? , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[42]  Michael D'Zmura,et al.  Color in visual search , 1991, Vision Research.

[43]  Alexander Pollatsek,et al.  Eye movements and word skipping during reading revisited. , 2005, Journal of experimental psychology. Human perception and performance.

[44]  Frédéric Dehais,et al.  The Perseveration Syndrome in the Pilot's Activity: Guidelines and Cognitive Countermeasures , 2009, HESSD.

[45]  A J Courtney,et al.  Effects of Cognitive Foveal Load on a Peripheral Single-Target Detection Task , 1993, Perceptual and motor skills.

[46]  I Rock,et al.  Inattentional Blindness as a Function of Proximity to the Focus of Attention , 1998, Perception.

[47]  J Jonides,et al.  Attentional capture by abrupt onsets: new perceptual objects or visual masking? , 1996, Journal of experimental psychology. Human perception and performance.

[48]  Christopher D. Wickens,et al.  Pilots Strategically Compensate for Display Enlargements in Surveillance and Flight Control Tasks , 2006, Hum. Factors.

[49]  Daniel Gopher,et al.  On the Economy of the Human Processing System: A Model of Multiple Capacity. , 1977 .

[50]  J. Shaoul Human Error , 1973, Nature.

[51]  Paul P. Maglio,et al.  Tradeoffs in displaying peripheral information , 2000, CHI.

[52]  Masako Kanai-Pak,et al.  Design guidelines of a context-aware notification system for nursing , 2008, Pervasive 2008.

[53]  Daniel J. Simons,et al.  Inattentional blindness , 2007, Scholarpedia.

[54]  K. Gegenfurtner,et al.  Color perception in the intermediate periphery of the visual field. , 2009, Journal of vision.

[55]  W. C. Howell of the Human Factors and Ergonomics Society , 2010 .

[56]  W. Cowan,et al.  Visual search for colour targets that are or are not linearly separable from distractors , 1996, Vision Research.

[57]  Dennis B. Beringer,et al.  Automation in General Aviation: Two Studies of Pilot Responses to Autopilot Malfunctions , 1999 .

[58]  Jens Rasmussen,et al.  Cognitive Systems Engineering , 2022 .

[59]  Linden J. Ball,et al.  Eye tracking in HCI and usability research. , 2006 .

[60]  Shayne Loft,et al.  Prospective memory in an air traffic control simulation: external aids that signal when to act. , 2011, Journal of experimental psychology. Applied.

[61]  Harvey S. Smallman,et al.  Recovery from Interruptions to a Dynamic Monitoring Task: The Beguiling Utility of Instant Replay , 2005 .

[62]  S. Tremblay,et al.  Rehearsal in serial memory for visual-spatial information: Evidence from eye movements , 2006, Psychonomic bulletin & review.

[63]  J. Wolfe,et al.  The Invisible Gorilla Strikes Again , 2013, Psychological science.

[64]  Alistair G. Sutcliffe,et al.  Designing effective multimedia presentations , 1997, CHI.

[65]  Jean Saint-Aubin,et al.  Evidence of anticipatory eye movements in the spatial Hebb repetition effect: insights for modeling sequence learning. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[66]  Christopher D. Wickens,et al.  Dual-Task Performance Consequences of Imperfect Alerting Associated With a Cockpit Display of Traffic Information , 2007, Hum. Factors.

[67]  Stéphane Chatty,et al.  Human factors in ATC alarms and notifications design: an experimental evaluation , 2000 .

[68]  Dylan M. Jones,et al.  Contextual cues aid recovery from interruption: the role of associative activation. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[69]  Christopher D. Wickens,et al.  Identifying Black Swans in NextGen: Predicting Human Performance in Off-Nominal Conditions , 2009, Hum. Factors.

[70]  Andrew T. Duchowski,et al.  Eye tracking methodology - theory and practice, 2nd Edition , 2007 .

[71]  Nadine B. Sarter,et al.  Peripheral Visual Feedback: A Powerful Means of Supporting Effective Attention Allocation in Event-Driven, Data-Rich Environments , 2001, Hum. Factors.

[72]  Brian J. Scholl,et al.  PSYCHE an interdisciplinary journal of research on consciousness Sustained Inattentional Blindness : The Role of Location in the Detection of Unexpected Dynamic Events , 2000 .

[73]  Dylan M. Jones,et al.  Nonexplicit Change Detection in Complex Dynamic Settings , 2012, Hum. Factors.

[74]  J. Theeuwes,et al.  Interactions between working memory, attention and eye movements. , 2009, Acta psychologica.

[75]  Daryl Fougnie,et al.  Executive working memory load induces inattentional blindness , 2007, Psychonomic bulletin & review.

[76]  Christopher D. Wickens,et al.  ATTENTIONAL TUNNELING AND TASK MANAGEMENT , 2005 .

[77]  G. Zelinsky A theory of eye movements during target acquisition. , 2008, Psychological review.

[78]  Christopher D. Wickens,et al.  Factors Affecting Task Management in Aviation , 2007, Hum. Factors.

[79]  D. Scott McCrickard,et al.  Attuning notification design to user goals and attention costs , 2003, Commun. ACM.

[80]  J. C. Johnston,et al.  Involuntary attentional capture by abrupt onsets , 1992, Perception & psychophysics.

[81]  J. Jonides Voluntary versus automatic control over the mind's eye's movement , 1981 .

[82]  J. Theeuwes Exogenous and endogenous control of attention: The effect of visual onsets and offsets , 1991, Perception & psychophysics.

[83]  S. Breznitz Cry Wolf: The Psychology of False Alarms , 1984 .

[84]  William Knight,et al.  Simple Animation as a Human Interrupt , 1992 .