Background Sound Impairs Interruption Recovery in Dynamic Task Situations: Procedural Conflict?

Summary: Interruptions impair performance even on simple, static, laboratory-based tasks, but little research has looked at their impact in more complex and realistic settings that involve dynamically evolving circumstances and other environmental stressors. Using a radar operator task with or without background sound, participants were unexpectedly interrupted to complete another task, which masked the radar screen as the scenario continually evolved. Task efficiency was impaired by interruption: decisionmaking time was slower immediately following interruption, this cost being greater and persevered longer in the presence of auditory distraction. Resumption time was also increased with distraction. Eye fixation durations were shorter following interruption, reflecting participants’ attempts to rapidly re-encode and update their model of the situation. These results suggest that those processes involved in task resumption are also susceptible to background sound, and indicate a need for theories of task interruption to better specify the role of attention in interruption recovery. Copyright © 2013 John Wiley & Sons, Ltd. System operators in critical command and control (C2) environments such as air traffic control, emergency services, and crisis management, must constantly monitor, assess, and integrate incoming information in order to make optimal decisions in dangerous, complex, and unpredictable task environments. The demand to support cognitive aspects of performance and decision making in such high-reliability environments is growing rapidly, but it is first necessary to gain a conceptual understanding of the cognitive limitations of the human operator to inform the development of such technological support tools. Task interruption is one particular constraint with which operators are often faced. Although

[1]  Dario D. Salvucci,et al.  Threaded cognition: an integrated theory of concurrent multitasking. , 2008, Psychological review.

[2]  Dylan M. Jones,et al.  Auditory babble and cognitive efficiency: Role of number of voices and their location , 1995 .

[3]  E. M. Altmann,et al.  Timecourse of recovery from task interruption: Data and a model , 2006, Psychonomic bulletin & review.

[4]  Dylan M. Jones,et al.  Role of Habituation in the Irrelevant Sound Effect: Evidence From the Effects of Token Set Size and Rate of Transition , 1998 .

[5]  Dylan M. Jones,et al.  Interruption of the Tower of London task: support for a goal-activation approach. , 2006, Journal of experimental psychology. General.

[6]  M Rahimi,et al.  A field evaluation of driver eye and head movement strategies toward environmental targets and distractors. , 1990, Applied ergonomics.

[7]  Dylan M. Jones,et al.  Journal of Experimental Psychology : Learning , Memory , and Cognition Broken Expectations : Violation of Expectancies , Not Novelty , Captures Auditory Attention , 2011 .

[8]  Dylan M. Jones,et al.  When does between-sequence phonological similarity promote irrelevant sound disruption? , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[9]  Linden J. Ball,et al.  Eye tracking in HCI and usability research. , 2006 .

[10]  Dylan M. Jones,et al.  Auditory Distraction and Short-Term Memory: Phenomena and Practical Implications , 2001, Hum. Factors.

[11]  Jean-Paul Imbert,et al.  LABY: Un support d'aide à l'évaluation de choix de conception d'IHM pour le contrôle aérien , 2012, Ergo'IHM.

[12]  J. Gregory Trafton,et al.  Preparing to resume an interrupted task: effects of prospective goal encoding and retrospective rehearsal , 2003, Int. J. Hum. Comput. Stud..

[13]  Erich Schrger,et al.  A Neural Mechanism for Involuntary Attention Shifts to Changes in Auditory Stimulation , 1996, Journal of Cognitive Neuroscience.

[14]  Dylan M. Jones,et al.  Privileged Access by Irrelevant Speech to Short-term Memory: The Role of Changing State , 1992, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[15]  E. Elliott,et al.  The irrelevant-speech effect and children: theoretical implications of developmental change , 2002, Memory & cognition.

[16]  Dylan M. Jones,et al.  Does auditory streaming require attention? Evidence from attentional selectivity in short-term memory. , 2003, Journal of experimental psychology. Human perception and performance.

[17]  Roger Remington,et al.  Prospective memory in dynamic environments: Effects of load, delay, and phonological rehearsal , 2001, Memory.

[18]  Linden J. Ball,et al.  Eye Tracking in Human-Computer Interaction and Usability Research : Current Status and Future Prospects , 2004 .

[19]  Dylan M. Jones,et al.  Disruption of short-term memory by changing and deviant sounds: support for a duplex-mechanism account of auditory distraction. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[20]  D. Berry,et al.  Disruption of office‐related tasks by speech and office noise , 1998 .

[21]  Harvey S. Smallman,et al.  Recovery from Interruptions to a Dynamic Monitoring Task: The Beguiling Utility of Instant Replay , 2005 .

[22]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[23]  Sébastien Tremblay,et al.  Using auditory streaming to reduce disruption to serial memory by extraneous auditory warnings. , 2003, Journal of experimental psychology. Applied.

[24]  Harvey S. Smallman,et al.  Staying Up to Speed: Four Design Principles for Maintaining and Recovering Situation Awareness , 2008 .

[25]  Daniel Lafond,et al.  Decision Analysis Using Policy Capturing and Process Tracing Techniques in a Simulated Naval Air-Defense Task , 2009 .

[26]  Raj M. Ratwani,et al.  Spatial memory guides task resumption , 2008 .

[27]  Dylan M. Jones,et al.  Interference by process, not content, determines semantic auditory distraction , 2009, Cognition.

[28]  Dirk Schaefer,et al.  The effects of party line communication on flight task performance , 2005 .

[29]  Daniel Gartenberg,et al.  Situation Awareness Reacquisition in a Supervisory Control Task , 2011 .

[30]  Joseph H. Goldberg,et al.  Computer interface evaluation using eye movements: methods and constructs , 1999 .

[31]  Mark W. Wiggins,et al.  Polychronicity and Information Acquisition in Pilot Decision Making , 2008 .

[32]  Julie A Fiez,et al.  Evaluating models of working memory through the effects of concurrent irrelevant information. , 2010, Journal of experimental psychology. General.

[33]  Niels Taatgen,et al.  Toward a unified theory of the multitasking continuum: from concurrent performance to task switching, interruption, and resumption , 2009, CHI.

[34]  Harvey S. Smallman,et al.  Chex (Change History Explicit): New HCI Concepts for Change Awareness , 2003 .

[35]  Scott Makeig,et al.  Eye Activity Correlates of Workload during a Visuospatial Memory Task , 2001, Hum. Factors.

[36]  Gary Lupyan,et al.  Overheard Cell-Phone Conversations , 2010, Psychological science.

[37]  C. Philip Beaman,et al.  Auditory distraction from low‐intensity noise: a review of the consequences for learning and workplace environments , 2005 .

[38]  F. Barceló,et al.  Why are auditory novels distracting? Contrasting the roles of novelty, violation of expectation and stimulus change , 2011, Cognition.

[39]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[40]  Simon P. Banbury,et al.  'Irrelevant Sound Effect': The effects of extraneous sounds on aircrew performance , 1999 .

[41]  Christopher A. Monk,et al.  A Process-Model Account of Task Interruption and Resumption: When Does Encoding of the Problem State Occur? , 2009 .

[42]  Daniel Lafond,et al.  Supporting situation awareness: A tradeoff between benefits and overhead , 2011, 2011 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[43]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[44]  E. M. Altmann,et al.  Momentary interruptions can derail the train of thought. , 2014, Journal of experimental psychology. General.

[45]  M. A. Recarte,et al.  Effects of verbal and spatial-imagery tasks on eye fixations while driving. , 2000, Journal of experimental psychology. Applied.

[46]  Dylan M. Jones,et al.  Disruption of verbal-spatial serial memory by extraneous air-traffic speech , 2012 .

[47]  R. Näätänen The role of attention in auditory information processing as revealed by event-related potentials and other brain measures of cognitive function , 1990, Behavioral and Brain Sciences.

[48]  Dylan M. Jones,et al.  Auditory attentional capture during serial recall: violations at encoding of an algorithm-based neural model? , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[49]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[50]  J. Gregory Trafton,et al.  Memory for goals: an activation-based model , 2002, Cogn. Sci..

[51]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[52]  R. Key Dismukes,et al.  Remembrance of Things Future: Prospective Memory in Laboratory, Workplace, and Everyday Settings , 2010 .

[53]  Dylan M. Jones,et al.  Role of Serial Order in the Irrelevant Speech Effect: Tests of the Changing-State Hypothesis , 1997 .

[54]  N. Cowan Attention and Memory: An Integrated Framework , 1995 .

[55]  Christopher A. Monk,et al.  Recovering From Interruptions: Implications for Driver Distraction Research , 2004, Hum. Factors.

[56]  Dylan M. Jones,et al.  Interference in memory by process or content? A reply to Neath (2000) , 2000, Psychonomic bulletin & review.

[57]  Sébastien Tremblay,et al.  Supporting Change Detection in Complex Dynamic Situations: Does the CHEX Serve its Purpose? , 2012 .

[58]  Dylan Marc Jones The cognitive psychology of auditory distraction: The 1997 BPS Broadbent Lecture , 1999 .

[59]  Nigel Holt,et al.  Reverberant auditory environments: the effects of multiple echoes on distraction by ‘irrelevant’ speech , 2007 .

[60]  Daniel Lafond,et al.  A Cognitive and Holistic Approach to Developing Metrics for Decision Support Incommand and Control , 2010 .

[61]  Earl S Stein EVALUATING AIR TRAFFIC CONTROLLER WORKLOAD USING REAL-TIME PERSON IN THE LOOP SIMULATION. , 1991 .

[62]  Dylan M. Jones,et al.  Contextual cues aid recovery from interruption: the role of associative activation. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[63]  J. Trafton,et al.  The effect of interruption duration and demand on resuming suspended goals. , 2008, Journal of experimental psychology. Applied.

[64]  Daniel Lafond,et al.  Dealing With Task Interruptions in Complex Dynamic Environments , 2012, Hum. Factors.

[65]  Daniel J. Callan Eye Movement Relationships to Excessive Performance Error in Aviation , 1998 .

[66]  Wayne D. Gray,et al.  Argus: A suite of tools for research in complex cognition , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[67]  Avi Parush,et al.  Where Did they Go? Recovering Dynamic Objects after Interruptions , 2010 .

[68]  Simon Banbury,et al.  The role of rehearsal in a novel call center-type task. , 2012, Noise & health.

[69]  Tommy Strandvall,et al.  Eye Tracking in Human-Computer Interaction and Usability Research , 2009, INTERACT.

[70]  Sophia L. King,et al.  Improving memory after interruption: exploiting soft constraints and manipulating information access cost. , 2009, Journal of experimental psychology. Applied.

[71]  Dylan M. Jones,et al.  Indispensable benefits and unavoidable costs of unattended sound for cognitive functioning. , 2003, Noise & health.

[72]  Stacey D. Scott,et al.  Assisting Interruption Recovery in Supervisory Control of Multiple Uavs , 2006 .

[73]  Dylan M. Jones,et al.  Nonexplicit Change Detection in Complex Dynamic Settings , 2012, Hum. Factors.

[74]  Dario D. Salvucci On reconstruction of task context after interruption , 2010, CHI.

[75]  Dylan M. Jones,et al.  Do realistic reverberation levels reduce auditory distraction , 2007 .

[76]  Dylan M. Jones,et al.  Irrelevant tones produce an irrelevant speech effect : Implications for phonological coding in working memory , 1993 .

[77]  Raj M. Ratwani,et al.  The Effect of Interruption Modality on Primary Task Resumption , 2008 .

[78]  Dianne C. Berry,et al.  Habituation and dishabituation to speech and office noise , 1997 .

[79]  F. Parmentier Towards a cognitive model of distraction by auditory novelty: The role of involuntary attention capture and semantic processing , 2008, Cognition.

[80]  Wayne D. Gray Simulated task environments: The role of high-fidelity simulations, scaled worlds, synthetic environments, and laboratory tasks in basic and applied cognitive research. , 2002 .

[81]  Raj M. Ratwani,et al.  An Eye Movement Analysis of the Effect of Interruption Modality on Primary Task Resumption , 2010, Hum. Factors.

[82]  Sarah Sharples,et al.  Changing the role of the air traffic controller: how will free flight affect memory for spatial events? , 2007, Applied ergonomics.