Surviving task interruptions: Investigating the implications of long-term working memory theory

Typically, we have several tasks at hand, some of which are in interrupted state while others are being carried out. Most of the time, such interruptions are not disruptive to task performance. Based on the theory of Long-Term Working Memory (LTWM; Ericsson, K.A., Kintsch, W., 1995. Long-term working memory. Psychological Review, 102, 211-245), we posit that unless there are enough mental skills and resources to encode task representations to retrieval structures in long-term memory, the resulting memory traces will not enable reinstating the information, which can lead to memory losses. However, once encoded to LTWM, they are virtually safeguarded. Implications of the theory were tested in a series of experiments in which the reading of an expository text was interrupted by a 30-s interactive task, after which the reading was continued. The results convey the remarkably robust nature of skilled memory-when LTWM encoding speed is fast enough for the task-processing imposed by the interface, interruptions have no effect on memory, regardless of their pacing, intensity, or difficulty. In the final experiment where presentation time in the main task was notably speeded up to match the limits of encoding speed, interruptions did hamper memory. Based on the results and the theory, we argue that auditory rehearsal or time-based retrieval cues were not utilized in surviving interruptions and that they are in general weaker strategies for surviving interruptions in complex cognitive tasks. We conclude the paper by suggesting three ways to support interruption tolerance by the means of task and interface design: (1) actively facilitating the development of memory skills, (2) matching encoding speed to task processing demands, and (3) supporting encoding-retrieval symmetry.

[1]  Stephen S. Intille,et al.  Change Blind Information Display for Ubiquitous Computing Environments , 2002, UbiComp.

[2]  Kenneth Kotovsky,et al.  Complex Information Processing: The Impact of Herbert A. Simon , 1989 .

[3]  J. Sloboda,et al.  Visual Perception of Musical Notation: Registering Pitch Symbols in Memory , 1976, The Quarterly journal of experimental psychology.

[4]  Judith S Reitman,et al.  Skilled perception in Go: Deducing memory structures from inter-response times , 1976, Cognitive Psychology.

[5]  Brian P. Bailey,et al.  If not now, when?: the effects of interruption at different moments within task execution , 2004, CHI.

[6]  W. Chase,et al.  Visual information processing. , 1974 .

[7]  K. A. Ericsson,et al.  Shortcomings of generic retrieval structures with slots of the type that Gobet (1993) proposed and modelled. , 2000, British journal of psychology.

[8]  Donald A. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[9]  Pertti Saariluoma,et al.  Explanatory frameworks for interaction design , 2005 .

[10]  Erik M. Altmann,et al.  Near-term memory in programming: a simulation-based analysis , 2001, Int. J. Hum. Comput. Stud..

[11]  P. Saariluoma,et al.  Aspects of skilled imagery in blindfold chess. , 1991, Acta psychologica.

[12]  Mark Weiser,et al.  Some computer science issues in ubiquitous computing , 1993, CACM.

[13]  K J Vicente,et al.  An ecological theory of expertise effects in memory recall. , 1998, Psychological review.

[14]  M Glanzer,et al.  Short-Term Storage and the Processing of Cohesion during Reading , 1986, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[15]  Ö. Akin.  Psychology of architectural design , 1986 .

[16]  John R. Anderson,et al.  Serial modules in parallel: the psychological refractory period and perfect time-sharing. , 2001, Psychological review.

[17]  K. A. Ericsson,et al.  Expert and exceptional performance: evidence of maximal adaptation to task constraints. , 1996, Annual review of psychology.

[18]  Pertti Saarilouma.  Chess Players' Thinking: A Cognitive Psychological Approach , 1995 .

[19]  D. Broadbent,et al.  What makes interruptions disruptive? A study of length, similarity, and complexity , 1989 .

[20]  K. A. Ericsson,et al.  Skilled memory and expertise: Mechanisms of exceptional performance. , 1988 .

[21]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[22]  Takeshi Hatta,et al.  Digit memory of soroban experts: Evidence of utilization of mental imagery , 1989 .

[23]  P. Saariluoma.  Chess players' recall of auditorily presented chess positions , 1989 .

[24]  Brian P. Bailey,et al.  Towards an index of opportunity: understanding changes in mental workload during task execution , 2004, CHI.

[25]  Mary Czerwinski,et al.  Notification, Disruption, and Memory: Effects of Messaging Interruptions on Memory and Performance , 2001, INTERACT.

[26]  Patrice Terrier,et al.  Depth of processing and design-assessment of ecological interfaces: Task nalysi , 1999, Int. J. Hum. Comput. Stud..

[27]  Peter G. Polson,et al.  An experimental analysis of the mechanisms of a memory skill. , 1988 .

[28]  David M. Frohlich,et al.  Timespace in the workplace: dealing with interruptions , 1995, CHI 95 Conference Companion.

[29]  M. D’Esposito.  Working memory. , 2008, Handbook of clinical neurology.

[30]  M. B. Edwards,et al.  Task interruption and its effects on memory. , 1998, Memory.

[31]  P. Saariluoma,et al.  Chess players' intake of task-relevant cues , 1985, Memory & cognition.

[32]  K. J. Vicente.  Adapting the memory recall paradigm to evaluate interfaces , 1988 .

[33]  M. Glanzer,et al.  Short-term storage in reading. , 1984 .

[34]  Richard Lethin,et al.  Technical and Social Components of Peer-to-Peer Computing , 2003 .

[35]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[36]  Antti Oulasvirta,et al.  Task demands and memory in web interaction: a levels of processing approach , 2004, Interact. Comput..

[37]  Endel Tulving,et al.  Encoding specificity and retrieval processes in episodic memory. , 1973 .

[38]  Murray Glanzer,et al.  Short-term storage in the processing of text , 1981 .

[39]  H Eyrolle,et al.  The effects of interruptions in work activity: field and laboratory results. , 2000, Applied ergonomics.

[40]  Herbert A. Simon,et al.  THE MIND'S EYE IN CHESS , 1988 .

[41]  S. Ian Robertson,et al.  Problem-solving , 2001, Human Thinking.

[42]  H. Simon,et al.  Expert chess memory: revisiting the chunking hypothesis. , 1998, Memory.

[43]  Paul R. Kinnear,et al.  Skill in Map Reading and Memory for Maps , 1988 .

[44]  M. J. Emerson,et al.  The role of inner speech in task switching: A dual-task investigation , 2003 .

[45]  P. Saariluoma,et al.  Taxi drivers’ exceptional memory of street names , 2001, Memory & cognition.

[46]  A Baddeley,et al.  Working memory and the control of action: evidence from task switching. , 2001, Journal of experimental psychology. General.

[47]  D E Egan,et al.  Chunking in recall of symbolic drawings , 1979, Memory & cognition.

[48]  John R. Anderson,et al.  Elaborative encoding as an explanation of levels of processing , 1982 .

[49]  Loraine K. Obler,et al.  The exceptional brain: Neuropsychology of talent and special abilities. , 1988 .

[50]  P. Saariluoma,et al.  Apperception and imagery in blindfold chess. , 1998, Memory.

[51]  Neil Charness,et al.  Components of skill in bridge. , 1979 .

[52]  Erik Hollnagel,et al.  Joint Cognitive Systems: Foundations of Cognitive Systems Engineering , 2005 .

[53]  Mark Gluck,et al.  Memory and cognition , 2000, Clinical Neurophysiology.

[54]  Alison Green,et al.  Empirical advances in expertise research , 1992 .

[55]  Antti Oulasvirta,et al.  A cognitive meta-analysis of design approaches to interruptions in intelligent environments , 2004, CHI EA '04.

[56]  Joyce Ho,et al.  Using context-aware computing to reduce the perceived burden of interruptions from mobile devices , 2005, CHI.

[57]  L. Jacoby.  Memory as cognition. , 1980, Science.

[58]  Virpi Roto,et al.  Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI , 2005, CHI.

[59]  A. D. D. Groot.  Thought and Choice in Chess , 1978 .

[60]  PETER E. LOWTHER,et al.  In Memory , 1977, Evolution; international journal of organic evolution.

[61]  W. Kintsch.  The role of knowledge in discourse comprehension : a construction-integration model , 1991 .

[62]  Mary Czerwinski,et al.  Effects of instant messaging interruptions on computing tasks , 2000, CHI Extended Abstracts.

[63]  N. Cowan.  The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[64]  OulasvirtaAntti,et al.  Surviving task interruptions , 2006 .

[65]  Jeffrey L. Cummings,et al.  The Exceptional Brain: Neuropsychology of Talent and Special Abilities , 1989 .

[66]  H B Richman,et al.  Simulation of expert memory using EPAM IV. , 1995, Psychological review.

[67]  N. Charness.  The impact of chess research on cognitive science , 1992 .

[68]  Daniel C. McFarlane,et al.  Comparison of Four Primary Methods for Coordinating the Interruption of People in Human-Computer Interaction , 2002, Hum. Comput. Interact..

[69]  A. Miyake,et al.  Models of Working Memory: Mechanisms of Active Maintenance and Executive Control , 1999 .

[70]  M. Myles-Worsley,et al.  The influence of expertise on X-ray image processing. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[71]  John Brown.  Some Tests of the Decay Theory of Immediate Memory , 1958 .

[72]  Joseph S. Valacich,et al.  AIS Electronic , 2022 .

[73]  Kara A. Latorella,et al.  The Scope and Importance of Human Interruption in Human-Computer Interaction Design , 2002, Hum. Comput. Interact..

[74]  A. Baddeley.  The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[75]  Herbert A. Simon,et al.  Templates in Chess Memory: A Mechanism for Recalling Several Boards , 1996, Cognitive Psychology.

[76]  J. G. Kreifeldt,et al.  Interruption as a test of the user-computer interface , 1981 .

[77]  Fernand Gobet,et al.  Chunk hierarchies and retrieval structures: Comments on Saariluoma and Laine , 2001 .

[78]  P. W. Frey,et al.  Recall memory for visually presented chess positions , 1976, Memory & cognition.

[79]  Mary Czerwinski,et al.  Scope: providing awareness of multiple notifications at a glance , 2002, AVI '02.

[80]  B. Underwood,et al.  Proactive inhibition in short-term retention of single items , 1962 .

[81]  H. Simon,et al.  Recall of rapidly presented random chess positions is a function of skill , 1996, Psychonomic bulletin & review.

[82]  C. Alberini,et al.  Memory , 2006, Cellular and Molecular Life Sciences CMLS.

[83]  Steve Howard,et al.  Human-Computer Interaction INTERACT ’97 , 1997, IFIP — The International Federation for Information Processing.

[84]  Ad Degroot,et al.  THE MEMORY RECALL PARADIGM - STRAIGHTENING OUT THE HISTORICAL RECORD , 1990 .

[85]  N. Charness,et al.  Expert Performance Its Structure and Acquisition , 2002 .

[86]  L. R. Peterson,et al.  Short-term retention of individual verbal items. , 1959, Journal of experimental psychology.

[87]  Ben Shneiderman,et al.  Exploratory experiments in programmer behavior , 1976, International Journal of Computer & Information Sciences.

[88]  J. Reitman,et al.  Knowledge organization and skill differences in computer programmers , 1981, Cognitive Psychology.

[89]  Edward L. Bennett,et al.  Neural mechanisms of learning and memory , 1977 .

[90]  T. S. Hyde,et al.  Differential effects of incidental tasks on the organization of recall of a list of highly associated words. , 1969 .

[91]  R. W. Peterson,et al.  OPTICAL INTERFEROMETRY OF SURFACES , 1991 .

[92]  Víctor M. González,et al.  No task left behind?: examining the nature of fragmented work , 2005, CHI.

[93]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[94]  D. Lane,et al.  The generality of the levels of processing hypothesis: An application to memory for chess positions , 1979 .

[95]  Rolf A. Zwaan,et al.  Discourse comprehension. , 1997, Annual review of psychology.

[96]  Paul R. Kinnear,et al.  Memory for topographic contour maps , 1987 .

[97]  F. Craik,et al.  Levels of processing: A framework for memory research , 1972 .

[98]  K. A. Ericsson,et al.  Skill and Working Memory , 1982 .

[99]  P. Saariluoma,et al.  Skilled imagery and long-term working memory , 1997 .

[100]  Edgar Erdfelder,et al.  GPOWER: a priori, post-hoc, and compromise power analyses for MS-DOS [Computer Program] , 2004 .

[101]  Erik M Altmann,et al.  Functional decay of memory for tasks , 2002, Psychological research.

[102]  J. Gregory Trafton,et al.  Preparing to resume an interrupted task: effects of prospective goal encoding and retrospective rehearsal , 2003, Int. J. Hum. Comput. Stud..

[103]  John D. Bransford,et al.  Levels of processing versus transfer appropriate processing , 1977 .

[104]  Neil Charness,et al.  Expertise in chess and bridge. , 1989 .

[105]  K. A. Ericsson,et al.  Long-Term Working Memory as an Alternative to Capacity Models of Working Memory in Everyday Skilled Performance , 1999 .

[106]  E. Loftus,et al.  Make my memory: How advertising can change our memories of the past , 2002 .

[107]  D. Norman,et al.  Psychological Issues in Support of Multiple Activities , 1986 .

[108]  Antti Oulasvirta,et al.  Long-term working memory and interrupting messages in human – computer interaction , 2004, Behav. Inf. Technol..

[109]  H. Simon,et al.  STM capacity for Chinese words and idioms: Chunking and acoustical loop hypotheses , 1985, Memory & cognition.

[110]  Fernand Gobet,et al.  Retrieval structures and schemata: A brief reply to Ericsson and Kintsch , 2000 .

[111]  Graeme E. Field.  EXPERIMENTUS INTERRUPTUS , 1987, SGCH.

[112]  A. Richardson-Klavehn,et al.  Remembering and knowing , 2000 .

[113]  F. Gobet.  Expert memory: a comparison of four theories , 1998, Cognition.

[114]  P. Muter,et al.  Very rapid forgetting , 1980, Memory & cognition.

[115]  N. Charness.  Memory for Chess Positions: Resistance to Interference. , 1976 .

[116]  John Jonides,et al.  Maintenance rehearsal: a two-component analysis , 1984 .

[117]  Christopher A. Monk,et al.  Recovering From Interruptions: Implications for Driver Distraction Research , 2004, Hum. Factors.

[118]  F. Gobet,et al.  Some shortcomings of long-term working memory. , 2000, British journal of psychology.

[119]  Austin Henderson,et al.  A multiple, virtual-workspace interface to support user task switching , 1986, CHI '87.

[120]  Jeffrey S. Shell,et al.  Attentive user interfaces: the surveillance and sousveillance of gaze-aware objects , 2008 .

[121]  F. Craik,et al.  Levels of Pro-cessing: A Framework for Memory Research , 1975 .

[122]  R. Engle,et al.  Memory processes among bridge players of differing expertise. , 1978 .