Remembering to Execute Deferred Tasks in Simulated Air Traffic Control: The Impact of Interruptions

Air traffic controllers can sometimes forget to complete deferred tasks, with safety implications. In two experiments, we examined how the presence and type of interruptions influenced the probability and speed at which individuals remembered to perform deferred tasks in simulated air traffic control (ATC). Participants were required to accept/handoff aircraft, detect aircraft conflicts, and perform two deferred tasks: a deferred conflict task that required remembering to resolve a conflict in the future and a deferred handoff task that required substituting an alternative aircraft handoff action in place of routine handoff action. Relative to no interruption, a blank display interruption slowed deferred conflict resumption, but this effect was not augmented by a cognitively demanding n-back task or a secondary ATC task interruption. However, the ATC task interruption increased the probability of failing to resume the deferred conflict relative to the blank interruption. An ex-Gaussian model of resumption times revealed that these resumption failures likely reflected true forgetting of the deferred task. Deferred handoff task performance was unaffected by interruptions. These findings suggest that remembering to resume a deferred task in simulated ATC depended on frequent interaction with situational cues on the display and that individuals were particularly susceptible to interference-based forgetting.

[1]  Jiqiang Guo,et al.  Stan: A Probabilistic Programming Language. , 2017, Journal of statistical software.

[2]  Joshua M. Kraut,et al.  Evaluating probe techniques and a situated theory of situation awareness. , 2016, Journal of experimental psychology. Applied.

[3]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[4]  Sébastien Tremblay,et al.  Decision support and vulnerability to interruption in a dynamic multitasking environment , 2015, Int. J. Hum. Comput. Stud..

[5]  W. Ma,et al.  Changing concepts of working memory , 2014, Nature Neuroscience.

[6]  Jörg Rieskamp,et al.  An Introduction to Bayesian Hypothesis Testing for Management Research , 2015 .

[7]  C. J. McGrath,et al.  Effect of exchange rate return on volatility spill-over across trading regions , 2012 .

[8]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[9]  Denis Cousineau,et al.  Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method , 2005 .

[10]  Shayne Loft,et al.  Slow down and remember to remember! A delay theory of prospective memory costs. , 2015, Psychological review.

[11]  Shayne Loft,et al.  ATC-labAdvanced: An air traffic control simulator with realism and control , 2009, Behavior research methods.

[12]  Vanessa K. Bowden,et al.  Eye movements provide insights into the conscious use of context in prospective memory , 2017, Consciousness and Cognition.

[13]  Patrik Sörqvist,et al.  Effects of Task Interruption and Background Speech on Word Processed Writing , 2016, Applied cognitive psychology.

[14]  Jonathon D Crystal,et al.  Prospective memory , 2019, Memory.

[15]  Rebekah E. Smith What Costs Do Reveal and Moving beyond the Cost Debate: Reply to Einstein and McDaniel (2010). , 2010 .

[16]  E. Wagenmakers A practical solution to the pervasive problems ofp values , 2007, Psychonomic bulletin & review.

[17]  Jonathon Love,et al.  BayesFactor: 0.9.12-2 CRAN , 2015 .

[18]  R. Dismukes,et al.  Prospective Memory in Workplace and Everyday Situations , 2012 .

[19]  Shayne Loft,et al.  Prospective memory in an air traffic control simulation: external aids that signal when to act. , 2011, Journal of experimental psychology. Applied.

[20]  Shayne Loft,et al.  A theory and model of conflict detection in air traffic control: incorporating environmental constraints. , 2009, Journal of experimental psychology. Applied.

[21]  R Key Dismukes,et al.  The Limits of Expertise: Rethinking Pilot Error and the Causes of Airline Accidents , 2007 .

[22]  Avi Parush,et al.  Where Did they Go? Recovering Dynamic Objects after Interruptions , 2010 .

[23]  Kim-Phuong L. Vu,et al.  A Situated Approach To Shared Situation Awareness , 2012 .

[24]  Daniel C. McFarlane,et al.  Comparison of Four Primary Methods for Coordinating the Interruption of People in Human-Computer Interaction , 2002, Hum. Comput. Interact..

[25]  R. Ratcliff Group reaction time distributions and an analysis of distribution statistics. , 1979, Psychological bulletin.

[26]  J. Trafton,et al.  The effect of interruption duration and demand on resuming suspended goals. , 2008, Journal of experimental psychology. Applied.

[27]  Shayne Loft,et al.  Applying Psychological Science to Examine Prospective Memory in Simulated Air Traffic Control , 2014 .

[28]  Jeffrey N. Rouder,et al.  Bayesian t tests for accepting and rejecting the null hypothesis , 2009, Psychonomic bulletin & review.

[29]  Shayne Loft,et al.  Modeling and Predicting Mental Workload in En Route Air Traffic Control: Critical Review and Broader Implications , 2007, Hum. Factors.

[30]  Shayne Loft,et al.  Reducing prospective memory error and costs in simulated air traffic control: External aids, extending practice, and removing perceived memory requirements. , 2016, Journal of experimental psychology. Applied.

[31]  Stacey D. Scott,et al.  Assisting Interruption Recovery in Supervisory Control of Multiple Uavs , 2006 .

[32]  P. Jolicoeur,et al.  A central capacity sharing model of dual-task performance. , 2003, Journal of experimental psychology. Human perception and performance.

[33]  Michael F. Bunting,et al.  Proactive interference and item similarity in working memory. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[34]  Wai-Tat Fu,et al.  Soft constraints in interactive behavior: the case of ignoring perfect knowledge in-the-world for imperfect knowledge in-the-head , 2004, Cogn. Sci..

[35]  Christopher A. Monk,et al.  Dealing with Interruptions can be Complex, but does Interruption Complexity Matter: A Mental Resources Approach to Quantifying Disruptions , 2008 .

[36]  R. Duncan Luce,et al.  Response Times: Their Role in Inferring Elementary Mental Organization , 1986 .

[37]  M. B. Edwards,et al.  Task interruption and its effects on memory. , 1998, Memory.

[38]  J. Gregory Trafton,et al.  Memory for goals: an activation-based model , 2002, Cogn. Sci..

[39]  Harvey S. Smallman,et al.  Recovery from Interruptions to a Dynamic Monitoring Task: The Beguiling Utility of Instant Replay , 2005 .

[40]  M Frerichs,et al.  Where did they go? , 1968, Chart.

[41]  Mark A McDaniel,et al.  Prospective memory and what costs do not reveal about retrieval processes: A commentary on Smith, Hunt, McVay, and McConnell (2007). , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[42]  Shayne Loft,et al.  Using Spatial Context to Support Prospective Memory in Simulated Air Traffic Control , 2011, Hum. Factors.

[43]  J. Wixted,et al.  An analysis of latency and interresponse time in free recall , 1994, Memory & cognition.

[44]  J. Shaoul Human Error , 1973, Nature.

[45]  E. Wagenmakers,et al.  A default Bayesian hypothesis test for correlations and partial correlations , 2012, Psychonomic bulletin & review.

[46]  Shayne Loft,et al.  Minimizing the disruptive effects of prospective memory in simulated air traffic control. , 2013, Journal of experimental psychology. Applied.

[47]  Sébastien Tremblay,et al.  Background Sound Impairs Interruption Recovery in Dynamic Task Situations: Procedural Conflict? , 2014 .

[48]  T. Braver The variable nature of cognitive control: a dual mechanisms framework , 2012, Trends in Cognitive Sciences.

[49]  Birsen Donmez,et al.  Effects of Nested Interruptions on Task Resumption: A Laboratory Study With Intensive Care Nurses , 2017, Hum. Factors.

[50]  R H Logie,et al.  Interference with visual short-term memory. , 1990, Acta psychologica.

[51]  Tom Kontogiannis,et al.  A proactive approach to human error detection and identification in aviation and air traffic control , 2009 .

[52]  Stacey D. Scott,et al.  Supervisory-level interruption recovery in time-critical control tasks. , 2014, Applied ergonomics.

[53]  M. McDaniel,et al.  (www.interscience.wiley.com) DOI: 10.1002/acp.1002 Delaying Execution of Intentions: Overcoming the Costs of Interruptions , 2022 .

[54]  N. Taatgen,et al.  The problem state: a cognitive bottleneck in multitasking. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[55]  Shayne Loft,et al.  Varying the Complexity of the Prospective Memory Decision Process in an Air Traffic Control Simulation , 2011 .

[56]  Malcolm C. Rubel Encoding information , 1993 .

[57]  P. Grambsch,et al.  A Package for Survival Analysis in S , 1994 .

[58]  Jonathan Back,et al.  Recovering from an interruption: investigating speed-accuracy trade-offs in task resumption behavior. , 2013, Journal of experimental psychology. Applied.

[59]  Harvey S. Smallman,et al.  Staying Up to Speed: Four Design Principles for Maintaining and Recovering Situation Awareness , 2008 .

[60]  Raj M. Ratwani,et al.  Spatial memory guides task resumption , 2008 .

[61]  Steven Shorrock,et al.  Errors of memory in air traffic control. , 2005 .

[62]  Shayne Loft,et al.  The Chronic Detrimental Impact of Interruptions in a Simulated Submarine Track Management Task , 2015, Hum. Factors.

[63]  Daniel Gopher,et al.  On the Economy of the Human Processing System: A Model of Multiple Capacity. , 1977 .

[64]  J. Wixted,et al.  Analyzing the dynamics of free recall: An integrative review of the empirical literature , 1994, Psychonomic bulletin & review.

[65]  Shayne Loft,et al.  Prospective memory and task interference in a continuous monitoring dynamic display task. , 2010, Journal of experimental psychology. Applied.

[66]  K. Dismukes,et al.  Effects of ongoing task context and target typicality on prospective memory performance: The importance of associative cueing , 2005, Memory.

[67]  E. Kaplan,et al.  Nonparametric Estimation from Incomplete Observations , 1958 .

[68]  D. Broadbent,et al.  What makes interruptions disruptive? A study of length, similarity, and complexity , 1989 .

[69]  L. M. M.-T. Theory of Probability , 1929, Nature.

[70]  Roger Remington,et al.  Prospective memory in dynamic environments: Effects of load, delay, and phonological rehearsal , 2001, Memory.

[71]  Niels Taatgen,et al.  The Multitasking Mind , 2010, Oxford series on cognitive models and architectures.

[72]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[73]  Shayne Loft,et al.  Accumulating Evidence About What Prospective Memory Costs Actually Reveal , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[74]  Gavriel Salvendy,et al.  Handbook of Human Factors and Ergonomics , 2005 .

[75]  M R Endsley,et al.  Sources of situation awareness errors in aviation. , 1996, Aviation, space, and environmental medicine.

[76]  Rebekah E. Smith,et al.  What Costs Do Reveal and Moving Beyond the Cost Debate: Reply to Einstein and McDaniel (in press). , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[77]  D. Norman Categorization of action slips. , 1981 .

[78]  Tim Schmitz,et al.  Contrast Analysis Focused Comparisons In The Analysis Of Variance , 2016 .

[79]  Lynn Hasher,et al.  The role of interference in memory span , 1999, Memory & cognition.

[80]  J. Gregory Trafton,et al.  Preparing to resume an interrupted task: effects of prospective goal encoding and retrospective rehearsal , 2003, Int. J. Hum. Comput. Stud..

[81]  R. Marsh,et al.  The Role of Interruptions and Contextual Associations in Delayed‐Execute Prospective Memory , 2014 .

[82]  E. M. Altmann,et al.  Momentary interruptions can derail the train of thought. , 2014, Journal of experimental psychology. General.

[83]  Asher Koriat,et al.  Encoding information for future action: Memory for to-be-performed tasks versus memory for to-be-recalled tasks , 1990, Memory & cognition.

[84]  Alan D Baddeley,et al.  Memory for serial order across domains: An overview of the literature and directions for future research. , 2014, Psychological bulletin.

[85]  Pamela S. Tsang,et al.  Mental Workload and Situation Awareness , 2006 .

[86]  Steven Shorrock,et al.  Errors of perception in air traffic control , 2007 .

[87]  Simon Farrell,et al.  The Playing Field : Findings for Evaluating Hypotheses About WM Capacity , 2016 .

[88]  D. Balota,et al.  Moving Beyond the Mean in Studies of Mental Chronometry , 2011 .

[89]  David F. Channell Pasteur's Quadrant: Basic Science and Technological Innovation , 1999 .

[90]  Rahul M. Dodhia,et al.  Interruptions create prospective memory tasks , 2009 .

[91]  Brian P. Bailey,et al.  If not now, when?: the effects of interruption at different moments within task execution , 2004, CHI.

[92]  Dylan M. Jones,et al.  Interruption of the Tower of London task: support for a goal-activation approach. , 2006, Journal of experimental psychology. General.

[93]  Dario D. Salvucci On reconstruction of task context after interruption , 2010, CHI.