Resource-sharing between internal maintenance and external selection modulates attentional capture by working memory content

It is unclear why and under what circumstances working memory (WM) and attention interact. Here, we apply the logic of the time-based resource-sharing (TBRS) model of WM (e.g., Barrouillet et al., 2004) to explore the mixed findings of a separate, but related, literature that studies the guidance of visual attention by WM contents. Specifically, we hypothesize that the linkage between WM representations and visual attention is governed by a time-shared cognitive resource that alternately refreshes internal (WM) and selects external (visual attention) information. If this were the case, WM content should guide visual attention (involuntarily), but only when there is time for it to be refreshed in an internal focus of attention. To provide an initial test for this hypothesis, we examined whether the amount of unoccupied time during a WM delay could impact the magnitude of attentional capture by WM contents. Participants were presented with a series of visual search trials while they maintained a WM cue for a delayed-recognition test. WM cues could coincide with the search target, a distracter, or neither. We varied both the number of searches to be performed, and the amount of available time to perform them. Slowing of visual search by a WM matching distracter—and facilitation by a matching target—were curtailed when the delay was filled with fast-paced (refreshing-preventing) search trials, as was subsequent memory probe accuracy. WM content may, therefore, only capture visual attention when it can be refreshed, suggesting that internal (WM) and external attention demands reciprocally impact one another because they share a limited resource. The TBRS rationale can thus be applied in a novel context to explain why WM contents capture attention, and under what conditions that effect should be observed.

[1]  P. Barrouillet,et al.  On the law relating processing to storage in working memory. , 2011, Psychological review.

[2]  T. Egner,et al.  Cognitive control over working memory biases of selection , 2012, Psychonomic Bulletin & Review.

[3]  Min-Shik Kim,et al.  Do the contents of working memory capture attention? Yes, but cognitive control matters. , 2009, Journal of experimental psychology. Human perception and performance.

[4]  G. Woodman,et al.  Do the contents of visual working memory automatically influence attentional selection during visual search? , 2007, Journal of experimental psychology. Human perception and performance.

[5]  Stephen R Mitroff,et al.  Journal of Experimental Psychology : Human Perception and Performance Attentional Guidance by Working Memory Overrides Salience Cues in Visual Search , 2013 .

[6]  Jay Pratt,et al.  The role of spatial working memory in inhibition of return: Evidence from divided attention tasks , 2003, Perception & psychophysics.

[7]  Jöran Lepsien,et al.  Searching for Targets within the Spatial Layout of Visual Short-Term Memory , 2009, The Journal of Neuroscience.

[8]  Stephan Lewandowsky,et al.  No temporal decay in verbal short-term memory , 2009, Trends in Cognitive Sciences.

[9]  G. Humphreys,et al.  Stressing the mind: The effect of cognitive load and articulatory suppression on attentional guidance from working memory , 2008, Perception & psychophysics.

[10]  A. Nobre,et al.  Orienting Attention to Locations in Internal Representations , 2003, Journal of Cognitive Neuroscience.

[11]  T. Egner,et al.  Working memory as internal attention: Toward an integrative account of internal and external selection processes , 2012, Psychonomic Bulletin & Review.

[12]  J. Theeuwes,et al.  Feature-based memory-driven attentional capture: visual working memory content affects visual attention. , 2006, Journal of experimental psychology. Human perception and performance.

[13]  Marcia K. Johnson,et al.  Memory: Enduring Traces of Perceptual and Reflective Attention , 2011, Neuron.

[14]  G. Humphreys,et al.  Early, involuntary top-down guidance of attention from working memory. , 2005, Journal of experimental psychology. Human perception and performance.

[15]  Andrew Hollingworth,et al.  The relationship between visual working memory and attention: retention of precise colour information in the absence of effects on perceptual selection , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[16]  P. Barrouillet,et al.  Time and cognitive load in working memory. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[17]  Marcia K. Johnson,et al.  A brief thought can modulate activity in extrastriate visual areas: Top-down effects of refreshing just-seen visual stimuli , 2007, NeuroImage.

[18]  P. Maquet,et al.  Orienting Attention to Locations in Perceptual Versus Mental Representations , 2004, Journal of Cognitive Neuroscience.

[19]  Nancy B. Carlisle,et al.  Automatic and strategic effects in the guidance of attention by working memory representations. , 2011, Acta psychologica.

[20]  Suiping Wang,et al.  Guidance of visual attention from working memory contents depends on stimulus attributes , 2010, Neuroscience Letters.

[21]  Paul E. Downing,et al.  Competition in visual working memory for control of search , 2003 .

[22]  Alessandra S. Souza,et al.  Retro-cue benefits in working memory without sustained focal attention , 2014, Memory & cognition.

[23]  P. Roelfsema,et al.  Different States in Visual Working Memory: When It Guides Attention and When It Does Not , 2022 .

[24]  P. Barrouillet,et al.  Time constraints and resource sharing in adults' working memory spans. , 2004, Journal of experimental psychology. General.

[25]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[26]  Klaus Oberauer,et al.  Design for a working memory. , 2009 .

[27]  J. Jonides,et al.  Rehearsal in spatial working memory. , 1998, Journal of experimental psychology. Human perception and performance.

[28]  G. Woodman,et al.  Voluntary and automatic attentional control of visual working memory , 2002 .

[29]  A. Hollingworth,et al.  Journal of Experimental Psychology : Human Perception and Performance Selective Maintenance in Visual Working Memory Does Not Require Sustained Visual Attention , 2012 .

[30]  Christian N. L. Olivers,et al.  The time course of working memory effects on visual attention , 2010 .

[31]  Nelson Cowan,et al.  How verbal memory loads consume attention , 2009, Memory & cognition.

[32]  Jöran Lepsien,et al.  Directing spatial attention in mental representations: Interactions between attentional orienting and working-memory load , 2005, NeuroImage.

[33]  G. Woodman,et al.  The role of working memory and long-term memory in visual search , 2006 .

[34]  P. Roelfsema,et al.  The effect of items in working memory on the deployment of attention and the eyes during visual search. , 2006, Journal of experimental psychology. Human perception and performance.

[35]  M. Chun Visual working memory as visual attention sustained internally over time , 2011, Neuropsychologia.

[36]  Anastasia Kiyonaga,et al.  The Working Memory Stroop Effect: When Internal Representations Clash With External Stimuli , 2014, Psychological science.

[37]  Sarah E. MacPherson,et al.  Concurrent performance of two memory tasks: Evidence for domain-specific working memory systems , 2002, Memory & cognition.

[38]  Nelson Cowan,et al.  Loss of visual working memory within seconds: the combined use of refreshable and non-refreshable features. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[39]  A. Nobre,et al.  Top-down modulation: bridging selective attention and working memory , 2012, Trends in Cognitive Sciences.

[40]  B. Postle Working memory as an emergent property of the mind and brain , 2006, Neuroscience.

[41]  G. Humphreys,et al.  Automatic guidance of attention from working memory , 2008, Trends in Cognitive Sciences.

[42]  Suiping Wang,et al.  Effects of load on the guidance of visual attention from working memory , 2011, Vision Research.

[43]  S. Lewandowsky,et al.  Forgetting in immediate serial recall: decay, temporal distinctiveness, or interference? , 2008, Psychological review.

[44]  Jarrod A. Lewis-Peacock,et al.  Multiple neural states of representation in short-term memory? It’s a matter of attention , 2014, Front. Hum. Neurosci..

[45]  C. Frith,et al.  The Role of Working Memory in Visual Selective Attention , 2001, Science.

[46]  Jeffrey D Schall,et al.  The role of working memory representations in the control of attention. , 2007, Cerebral cortex.

[47]  Robert J. Antonio Searching for Justice , 1988, Telos.

[48]  C D Frith,et al.  Modulating irrelevant motion perception by varying attentional load in an unrelated task. , 1997, Science.

[49]  Martin Eimer,et al.  Memory-driven attentional capture is modulated by temporal task demands , 2011 .

[50]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[51]  Stephen M. Emrich Competition in Visual Working Memory , 2012 .

[52]  Stephen M. Emrich,et al.  Strengthened Effective Connectivity Underlies Transfer of Working Memory Training to Tests of Short-Term Memory and Attention , 2013, The Journal of Neuroscience.

[53]  N. Cowan Evolving conceptions of memory storage, selective attention, and their mutual constraints within the human information-processing system. , 1988, Psychological bulletin.

[54]  Edward Awh,et al.  The Role of Spatial Selective Attention in Working Memory for Locations: Evidence from Event-Related Potentials , 2000, Journal of Cognitive Neuroscience.

[55]  Andrew Hollingworth,et al.  Visual Working Memory Modulates Rapid Eye Movements to Simple Onset Targets , 2013, Psychological science.

[56]  P. Barrouillet,et al.  The impact of storage on processing: how is information maintained in working memory? , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[57]  Simon Farrell,et al.  Modeling working memory: An interference model of complex span , 2012, Psychonomic bulletin & review.

[58]  Nelson Cowan,et al.  Differences between presentation methods in working memory procedures: a matter of working memory consolidation. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[59]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[60]  Dietmar Heinke,et al.  Working memory can guide pop-out search , 2006, Vision Research.

[61]  Christian N L Olivers,et al.  What drives memory-driven attentional capture? The effects of memory type, display type, and search type. , 2009, Journal of experimental psychology. Human perception and performance.

[62]  K. Oberauer,et al.  Attention to Information in Working Memory , 2012 .

[63]  C. Bundesen A theory of visual attention. , 1990, Psychological review.

[64]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[65]  Theodoros N. Arvanitis,et al.  Dissociating effects of stimulus identity and load on working memory attentional guidance: Lengthening encoding time eliminates the effect of load but not identity , 2012, Quarterly journal of experimental psychology.

[66]  P. Downing,et al.  Interactions Between Visual Working Memory and Selective Attention , 2000, Psychological science.

[67]  Pieter R. Roelfsema,et al.  Remembered but Unused: The Accessory Items in Working Memory that Do Not Guide Attention , 2009, Journal of Cognitive Neuroscience.

[68]  Camarin E. Rolle,et al.  Video game training enhances cognitive control in older adults , 2013, Nature.

[69]  C. Curtis,et al.  Common neural mechanisms supporting spatial working memory, attention and motor intention , 2011, Neuropsychologia.

[70]  Pierre Barrouillet,et al.  As Time Goes By , 2012 .

[71]  G. Woodman,et al.  Visual Search Remains Efficient when Visual Working Memory is Full , 2001, Psychological science.

[72]  Suk Won Han,et al.  Do the contents of working memory capture attention? Yes, but it's under control , 2010 .