Behind the scenes: how visual memory load biases selective attention during processing of visual streams.

We recorded ERPs to investigate whether the visual memory load can bias visual selective attention. Participants memorized one or four letters and then responded to memory-matching letters presented in a relevant color while ignoring distractor letters or letters in an irrelevant color. Stimuli in the relevant color elicited larger frontal selection positivities (FSP) and occipital selection negativities (OSN) compared to irrelevant color stimuli. Only distractors elicited a larger FSP in the high than in the low memory load task. Memory load prolonged the OSN for all letters. Response mapping complexity was also modulated but did not affect the FSP and OSN. Together, the FSP data suggest that high memory load increased distractability. The OSN data suggest that memory load sustained attention to letters in a relevant color until working memory processing was completed, independently of whether the letters were in working memory or not.

[1]  J. Theeuwes,et al.  Feature-based memory-driven attentional capture: visual working memory content affects visual attention. , 2006, Journal of experimental psychology. Human perception and performance.

[2]  B McElree,et al.  Working memory and focal attention. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[3]  Suiping Wang,et al.  Guidance of visual attention from working memory contents depends on stimulus attributes , 2010, Neuroscience Letters.

[4]  Paul E. Downing,et al.  Competition in visual working memory for control of search , 2003 .

[5]  S. Yantis 3 Goal-Directed and Stimulus-Driven Determinants of Attentional Control , 2000 .

[6]  H. Heinze,et al.  An event-related brain potential study of visual selective attention to conjunctions of color and shape. , 1999, Psychophysiology.

[7]  Charles L. Folk,et al.  Do locally defined feature discontinuities capture attention? , 1994, Perception & psychophysics.

[8]  Wei Ji Ma,et al.  Variability in encoding precision accounts for visual short-term memory limitations , 2012, Proceedings of the National Academy of Sciences.

[9]  E. Vogel,et al.  Individual Differences in Recovery Time From Attentional Capture , 2011, Psychological science.

[10]  N. Lavie Distracted and confused?: Selective attention under load , 2005, Trends in Cognitive Sciences.

[11]  P. Roelfsema,et al.  The effect of items in working memory on the deployment of attention and the eyes during visual search. , 2006, Journal of experimental psychology. Human perception and performance.

[12]  N. Lavie,et al.  The role of working memory in attentional capture , 2005, Psychonomic bulletin & review.

[13]  Marvin M Chun,et al.  Concurrent working memory load can reduce distraction. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[14]  G Mulder,et al.  Event-related potentials during memory search and selective attention to letter size and conjunctions of letter size and color. , 1989, Psychophysiology.

[15]  Leo Poom,et al.  Visual working memory capacity and stimulus categories: a behavioral and electrophysiological investigation , 2011, Experimental Brain Research.

[16]  Min-Shik Kim,et al.  Do the contents of working memory capture attention? Yes, but cognitive control matters. , 2009, Journal of experimental psychology. Human perception and performance.

[17]  Hans-Jochen Heinze,et al.  Representations in human visual short-term memory: an event-related brain potential study , 1999, Neuroscience Letters.

[18]  G. Humphreys,et al.  Stressing the mind: The effect of cognitive load and articulatory suppression on attentional guidance from working memory , 2008, Perception & psychophysics.

[19]  Steven J. Luck,et al.  The Number and Quality of Representations in Working Memory , 2011, Psychological science.

[20]  G. Woodman,et al.  Visual Search Remains Efficient when Visual Working Memory is Full , 2001, Psychological science.

[21]  M. Kane,et al.  Working-memory capacity predicts the executive control of visual search among distractors: The influences of sustained and selective attention , 2009, Quarterly journal of experimental psychology.

[22]  M. Chun,et al.  Concurrent working memory load can facilitate selective attention: evidence for specialized load. , 2007, Journal of experimental psychology. Human perception and performance.

[23]  G Mulder,et al.  Working memory processes show different degrees of lateralization: evidence from event-related potentials. , 2001, Psychophysiology.

[24]  A. Nobre,et al.  Top-down modulation: bridging selective attention and working memory , 2012, Trends in Cognitive Sciences.

[25]  Edward Awh,et al.  Precision in Visual Working Memory Reaches a Stable Plateau When Individual Item Limits Are Exceeded , 2011, The Journal of Neuroscience.

[26]  K. Oberauer Access to information in working memory: exploring the focus of attention. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[27]  S. Luck,et al.  Spatio‐temporal dynamics of attention to color: Evidence from human electrophysiology , 1998, Human brain mapping.

[28]  Geoffrey F. Woodman,et al.  When Memory Is Not Enough: Electrophysiological Evidence for Goal-dependent Use of Working Memory Representations in Guiding Visual Attention , 2011, Journal of Cognitive Neuroscience.

[29]  M. Chun Visual working memory as visual attention sustained internally over time , 2011, Neuropsychologia.

[30]  C. Frith,et al.  The Role of Working Memory in Visual Selective Attention , 2001, Science.

[31]  Andreas Keil,et al.  Feature selection in the human brain: Electrophysiological correlates of sensory enhancement and feature integration , 2010, Brain Research.

[32]  P. Roelfsema,et al.  Different States in Visual Working Memory: When It Guides Attention and When It Does Not , 2022 .

[33]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[34]  H G Smid,et al.  An electrophysiological study of the insertion of overt response choice. , 2000, Journal of experimental psychology. Human perception and performance.

[35]  H. Heinze,et al.  Selective attention to conjunctions of color and shape of alphanumeric versus non-alphanumeric stimuli: a comparative electrophysiological study , 1997, Biological Psychology.

[36]  A. A. Wijers,et al.  An event-related brain potential correlate of visual short-term memory. , 1999, Neuroreport.

[37]  M. Moscovitch,et al.  The parietal cortex and episodic memory: an attentional account , 2008, Nature Reviews Neuroscience.

[38]  Lila Davachi,et al.  Are Representations in Working Memory Distinct From Representations in Long-Term Memory? , 2010, Psychological science.

[39]  C. Elger,et al.  Using visual advance information: an event-related functional MRI study. , 2004, Brain research. Cognitive brain research.

[40]  G. Woodman,et al.  Neural fate of ignored stimuli: dissociable effects of perceptual and working memory load , 2004, Nature Neuroscience.

[41]  G. Keren,et al.  Recognition models of alphanumeric characters. , 1981, Perception & psychophysics.

[42]  Suiping Wang,et al.  Effects of load on the guidance of visual attention from working memory , 2011, Vision Research.

[43]  Ernst Martin,et al.  Neural activity in the hippocampus predicts individual visual short‐term memory capacity , 2013, Hippocampus.

[44]  Brian McElree,et al.  Accessing Recent Events , 2006 .

[45]  C. Elger,et al.  Temporal and cerebellar brain regions that support both declarative memory formation and retrieval. , 2004, Cerebral cortex.

[46]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[47]  A Kok,et al.  Event-related potentials to conjunctions of spatial frequency and orientation as a function of stimulus parameters and response requirements. , 1993, Electroencephalography and clinical neurophysiology.

[48]  J. C. Johnston,et al.  Involuntary covert orienting is contingent on attentional control settings. , 1992, Journal of experimental psychology. Human perception and performance.

[49]  H. Heinze,et al.  An electrophysiological study of the selection of the color and shape of alphanumeric characters in response choice , 1997, Biological Psychology.

[50]  Monika Althaus,et al.  The effects of memory load and stimulus relevance on the EEG during a visual selective memory search task: An ERP and ERD/ERS study , 2006, Clinical Neurophysiology.

[51]  J. Theeuwes,et al.  Interactions between working memory, attention and eye movements. , 2009, Acta psychologica.

[52]  E. Vogel,et al.  Human Variation in Overriding Attentional Capture , 2009, The Journal of Neuroscience.

[53]  David Soto,et al.  Electrophysiological evidence for attentional guidance by the contents of working memory , 2009, The European journal of neuroscience.

[54]  D. Tucker,et al.  Frontal evaluation and posterior representation in target detection. , 2001, Brain research. Cognitive brain research.

[55]  G Mulder,et al.  Attention to color: an analysis of selection, controlled search, and motor activation, using event-related potentials. , 1989, Psychophysiology.

[56]  Benoit Brisson,et al.  Contingent capture of visual-spatial attention depends on capacity-limited central mechanisms: Evidence from human electrophysiology and the psychological refractory period , 2009, Biological Psychology.

[57]  T. Klingberg,et al.  Prefrontal cortex and basal ganglia control access to working memory , 2008, Nature Neuroscience.

[58]  Edward Awh,et al.  The Role of Spatial Selective Attention in Working Memory for Locations: Evidence from Event-Related Potentials , 2000, Journal of Cognitive Neuroscience.

[59]  J. Duncan,et al.  Beyond the search surface: visual search and attentional engagement. , 1992, Journal of experimental psychology. Human perception and performance.

[60]  J. Theeuwes,et al.  Role of frontal cortex in attentional capture by singleton distractors , 2012, Brain and Cognition.

[61]  Theodore P. Zanto,et al.  Causal role of the prefrontal cortex in top-down modulation of visual processing and working memory , 2011, Nature Neuroscience.

[62]  H G Smid,et al.  The organization of multidimensional selection on the basis of color and shape: An event-related brain potential study , 1997, Perception & psychophysics.

[63]  G. Potts,et al.  Parallel perceptual enhancement and hierarchic relevance evaluation in an audio-visual conjunction task , 2008, Brain Research.

[64]  Pieter R. Roelfsema,et al.  Remembered but Unused: The Accessory Items in Working Memory that Do Not Guide Attention , 2009, Journal of Cognitive Neuroscience.

[65]  E. Viding,et al.  Load theory of selective attention and cognitive control. , 2004, Journal of experimental psychology. General.

[66]  Paul M Bays,et al.  Dynamic Updating of Working Memory Resources for Visual Objects , 2011, The Journal of Neuroscience.

[67]  C. D. Olds On the representations, $N_3 \left( {n^2 } \right)$ , 1941 .

[68]  Maro G. Machizawa,et al.  Neural measures reveal individual differences in controlling access to working memory , 2005, Nature.

[69]  S. Hillyard,et al.  Selective attention to the color and direction of moving stimuli: Electrophysiological correlates of hierarchical feature selection , 1996, Perception & psychophysics.

[70]  Chen Shuo The Capacity of Visual Working Memory for Motion Direction of Objects , 2006 .

[71]  A Kok,et al.  Selective processing of two-dimensional visual stimuli in young and old subjects: electrophysiological analysis. , 1995, Psychophysiology.