Spatial Attention can Bias Search in Visual Short-Term Memory

Whereas top-down attentional control is known to bias perceptual functions at many levels of stimulus analysis, its possible influence over memory-related functions remains uncharted. Our experiment combined behavioral measures and event-related potentials (ERPs) to test the ability of spatial orienting to bias functions associated with visual short-term memory (VSTM), and to shed light on the neural mechanisms involved. In particular, we investigated whether orienting attention to a spatial location within an array maintained in VSTM could facilitate the search for a specific remembered item. Participants viewed arrays of one, two or four differently colored items, followed by an informative spatial (100% valid) or uninformative neutral retro-cue (1500–2500 ms after the array), and later by a probe stimulus (500–1000 ms after the retro-cue). The task was to decide whether the probe stimulus had been present in the array. Behavioral results showed that spatial retro-cues improved both accuracy and response times for making decisions about the presence of the probe item in VSTM, and significantly attenuated performance decrements caused by increasing VSTM load. We also identified a novel ERP component (N3RS) specifically associated with searching for an item within VSTM. Paralleling the behavioral results, the amplitude and duration of the N3RS systematically increased with VSTM load in neutral retro-cue trials. When spatial retro-cues were provided, this “retro-search” component was absent. Our findings clearly show that the influence of top-down attentional biases extends to mnemonic functions, and, specifically, that searching for items within VSTM can be under flexible voluntary control.

[1]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[2]  C C Wood,et al.  Letter: The epsilon-adjustment procedure for repeated-measures analyses of variance. , 1976, Psychophysiology.

[3]  G. Woodman,et al.  Voluntary and automatic attentional control of visual working memory , 2002 .

[4]  P. Maquet,et al.  Orienting Attention to Locations in Perceptual Versus Mental Representations , 2004, Journal of Cognitive Neuroscience.

[5]  Sabine Kastner,et al.  Visual attention as a multilevel selection process , 2004, Cognitive, affective & behavioral neuroscience.

[6]  Maro G. Machizawa,et al.  Electrophysiological Measures of Maintaining Representations in Visual Working Memory , 2007, Cortex.

[7]  J. Jay Todd,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004, Nature.

[8]  S. Luck,et al.  Attention effects during visual short-term memory maintenance: Protection or prioritization? , 2007 .

[9]  A. Nobre,et al.  Attentional modulation of object representations in working memory. , 2007, Cerebral cortex.

[10]  Dylan M. Jones,et al.  Articulatory complexity at item boundaries in serial recall: the case of Welsh and English digit span. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[11]  D. Guthrie,et al.  Significance testing of difference potentials. , 1991, Psychophysiology.

[12]  A. Nobre,et al.  Cognitive control of attention in the human brain: Insights from orienting attention to mental representations , 2006, Brain Research.

[13]  Monika Althaus,et al.  The effects of memory load and stimulus relevance on the EEG during a visual selective memory search task: An ERP and ERD/ERS study , 2006, Clinical Neurophysiology.

[14]  S J Luck,et al.  Spatial filtering during visual search: evidence from human electrophysiology. , 1994, Journal of experimental psychology. Human perception and performance.

[15]  H. Lüders,et al.  American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature , 1991, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[16]  E Wascher,et al.  The interaction of stimulus- and response-related processes measured by event-related lateralizations of the EEG. , 1996, Electroencephalography and clinical neurophysiology.

[17]  W. A. Phillips On the distinction between sensory storage and short-term visual memory , 1974 .

[18]  M. Manosevitz,et al.  High-Speed Scanning in Human Memory , 2022 .

[19]  M. Mesulam Spatial attention and neglect: parietal, frontal and cingulate contributions to the mental representation and attentional targeting of salient extrapersonal events. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[20]  C. C. Wood,et al.  The ɛ-Adjustment Procedure for Repeated-Measures Analyses of Variance , 1976 .

[21]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[22]  E. Averbach,et al.  Short-term memory in vision , 1961 .

[23]  G. Woodman,et al.  Dissociations Among Attention, Perception, and Awareness During Object-Substitution Masking , 2003, Psychological science.

[24]  D. E. Irwin Memory for position and identity across eye movements. , 1992 .

[25]  Antoine Rémond,et al.  Methods of Analysis of Brain Electrical and Magnetic Signals , 1987 .

[26]  Maro G. Machizawa,et al.  Neural measures reveal individual differences in controlling access to working memory , 2005, Nature.

[27]  A. Nobre,et al.  Orienting Attention to Locations in Internal Representations , 2003, Journal of Cognitive Neuroscience.

[28]  C M Michel,et al.  42-channel potential map series to visual contrast and stereo stimuli: perceptual and cognitive event-related segments. , 1992, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[29]  T. Moore The neurobiology of visual attention: finding sources , 2006, Current Opinion in Neurobiology.

[30]  H. Spekreijse,et al.  Large capacity storage of integrated objects before change blindness , 2003, Vision Research.

[31]  R Dell'Acqua,et al.  Spatial attention freezes during the attention blink. , 2006, Psychophysiology.

[32]  D. E. Irwin,et al.  Integration and accumulation of information across saccadic eye movements. , 1996 .

[33]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[34]  T. Womelsdorf,et al.  Neuronal coherence during selective attentional processing and sensory–motor integration , 2006, Journal of Physiology-Paris.

[35]  Victor A. F. Lamme,et al.  Are There Multiple Visual Short-Term Memory Stores? , 2008, PloS one.

[36]  D. Lehmann,et al.  Segmentation of brain electrical activity into microstates: model estimation and validation , 1995, IEEE Transactions on Biomedical Engineering.

[37]  Anna Christina Nobre Probing the Flexibility of Attentional Orienting in the Human Brain. , 2004 .

[38]  W. Walter,et al.  Contingent Negative Variation : An Electric Sign of Sensori-Motor Association and Expectancy in the Human Brain , 1964, Nature.

[39]  Rachel S. Sussman,et al.  Orienting attention in visual working memory reduces interference from memory probes. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[40]  Won Mok Shim,et al.  Interference from filled delays on visual change detection. , 2006, Journal of vision.

[41]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[42]  J. Knott,et al.  Regarding the American Electroencephalographic Society guidelines for standard electrode position nomenclature: a commentary on the proposal to change the 10-20 electrode designators. , 1993, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[43]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[44]  Anna C. Nobre,et al.  Synergistic Effect of Combined Temporal and Spatial Expectations on Visual Attention , 2005, The Journal of Neuroscience.

[45]  D. Lehmann,et al.  Principles of spatial analysis , 1987 .

[46]  G. Sperling Negative Afterimage without Prior Positive Image , 1960, Science.

[47]  Jöran Lepsien,et al.  Directing spatial attention in mental representations: Interactions between attentional orienting and working-memory load , 2005, NeuroImage.

[48]  M. Gazzaniga,et al.  The new cognitive neurosciences , 2000 .

[49]  S. Sternberg Memory Scanning: New Findings and Current Controversies , 1975 .

[50]  Yuhong Jiang,et al.  Connecting the past with the present: how do humans match an incoming visual display with visual memory? , 2005, Journal of vision.

[51]  M. Eimer The N2pc component as an indicator of attentional selectivity. , 1996, Electroencephalography and clinical neurophysiology.

[52]  M. Rushworth,et al.  TMS in the parietal cortex: Updating representations for attention and action , 2006, Neuropsychologia.

[53]  R. Atkinson,et al.  The control of short-term memory. , 1971, Scientific American.

[54]  Jan Theeuwes,et al.  Electrophysiological Evidence of the Capture of Visual Attention , 2013, J. Cogn. Neurosci..

[55]  J. Reynolds,et al.  Attentional modulation of visual processing. , 2004, Annual review of neuroscience.

[56]  A. Treisman,et al.  Binding in short-term visual memory. , 2002, Journal of experimental psychology. General.

[57]  R. Desimone,et al.  Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. , 1997, Journal of neurophysiology.

[58]  A. A. Wijers,et al.  An event-related brain potential correlate of visual short-term memory. , 1999, Neuroreport.

[59]  S. Yantis,et al.  Selective visual attention and perceptual coherence , 2006, Trends in Cognitive Sciences.

[60]  Charan Ranganath,et al.  Opinion TRENDS in Cognitive Sciences Vol.9 No.8 August 2005 Doubts about double dissociations between short- and long-term memory , 2022 .

[61]  J. Mattingley,et al.  Neurodisruption of selective attention: insights and implications , 2005, Trends in Cognitive Sciences.

[62]  Greg Davis,et al.  The capacity of visual short-term memory is not a fixed number of objects , 2005, Memory & cognition.

[63]  G. Woodman,et al.  Event-related potential studies of attention , 2000, Trends in Cognitive Sciences.

[64]  Yuhong Jiang,et al.  Distributing versus focusing attention in visual short-term memory , 2007, Psychonomic bulletin & review.