Orienting attention to objects in visual short-term memory

We measured electroencephalographic activity during visual search of a target object among objects available to perception or among objects held in visual short-term memory (VSTM). For perceptual search, a single shape was shown first (pre-cue) followed by a search-array, and the task was to decide whether the pre-cue was or was not in the search-array. For search of VSTM, a search-array was shown first followed by a single shape (post-cue), and the task was to decide whether the post-cue was or was not in the previously displayed search-array. We focused on early lateralized electrical brain activity over posterior and temporal areas time-locked to search-arrays in pre-cue trials and to post-cues in post-cue trials. In Experiment 1, search-arrays were composed of two lateralized shapes, displayed in the upper/lower two quadrants of the monitor. In Experiment 2, search-arrays were composed of four shapes, displayed at the corners of an imaginary square centered on fixation. In pre-cue trials, we observed an N2pc of about equal amplitude and latency for search-arrays composed of two or four shapes. In post-cue trials, we observed N2pc-like activity with search-arrays composed of two shapes, that was however substantially attenuated with search-arrays composed of four shapes. For many aspects, attending to a perceptual object was functionally and neurally analogous to attending to an object held in VSTM, suggesting that spatial selective attention biases search of objects during both ongoing perception and retention.

[1]  Pierre Jolicœur,et al.  Express Attentional Re-Engagement but Delayed Entry into Consciousness Following Invalid Spatial Cues in Visual Search , 2008, PloS one.

[2]  W. A. Phillips On the distinction between sensory storage and short-term visual memory , 1974 .

[3]  Pierre Jolicoeur,et al.  Tracking the Location of Visuospatial Attention in a Contingent Capture Paradigm , 2008, Journal of Cognitive Neuroscience.

[4]  D. Gitelman,et al.  Neuroanatomic Overlap of Working Memory and Spatial Attention Networks: A Functional MRI Comparison within Subjects , 1999, NeuroImage.

[5]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[6]  Maro G. Machizawa,et al.  Electrophysiological Measures of Maintaining Representations in Visual Working Memory , 2007, Cortex.

[7]  G. Woodman,et al.  Event-related potential studies of attention , 2000, Trends in Cognitive Sciences.

[8]  Christian N L Olivers,et al.  What drives memory-driven attentional capture? The effects of memory type, display type, and search type. , 2009, Journal of experimental psychology. Human perception and performance.

[9]  A. Nobre The attentive homunculus: Now you see it, now you don't , 2001, Neuroscience & Biobehavioral Reviews.

[10]  E. Marg A VISION OF THE BRAIN , 1994 .

[11]  P. Jolicœur,et al.  Visual short-term memory: Central capacity limitations in short-term consolidation , 2007 .

[12]  R. Dell’Acqua,et al.  The Demonstration of Short-Term Consolidation , 1998, Cognitive Psychology.

[13]  Martin Eimer,et al.  An electrophysiological measure of access to representations in visual working memory. , 2010, Psychophysiology.

[14]  Abraham Z. Snyder,et al.  Changing Human Visual Field Organization from Early Visual to Extra-Occipital Cortex , 2007, PloS one.

[15]  Min-Shik Kim,et al.  The role of spatial working memory in visual search efficiency , 2004, Psychonomic bulletin & review.

[16]  Derek Besner,et al.  Reading for Meaning: The Effects of Concurrent Articulation* , 1981 .

[17]  S. Yantis,et al.  Transient neural activity in human parietal cortex during spatial attention shifts , 2002, Nature Neuroscience.

[18]  Joel R. Meyer,et al.  A large-scale distributed network for covert spatial attention: further anatomical delineation based on stringent behavioural and cognitive controls. , 1999, Brain : a journal of neurology.

[19]  Anna C. Nobre,et al.  Spatial Attention can Bias Search in Visual Short-Term Memory , 2007, Frontiers in human neuroscience.

[20]  G. Woodman,et al.  Dissociations Among Attention, Perception, and Awareness During Object-Substitution Masking , 2003, Psychological science.

[21]  A. Nobre,et al.  Spatial Selection of Features within Perceived and Remembered Objects , 2009, NeuroImage.

[22]  G. Mangun,et al.  Dissociating top-down attentional control from selective perception and action , 2001, Neuropsychologia.

[23]  Geoffrey F. Woodman,et al.  Electrophysiological measurement of rapid shifts of attention during visual search , 1999, Nature.

[24]  Jeff Miller,et al.  Using the jackknife-based scoring method for measuring LRP onset effects in factorial designs. , 2001, Psychophysiology.

[25]  R Dell'Acqua,et al.  Spatial attention freezes during the attention blink. , 2006, Psychophysiology.

[26]  S J Luck,et al.  Spatial filtering during visual search: evidence from human electrophysiology. , 1994, Journal of experimental psychology. Human perception and performance.

[27]  M. Eimer The N2pc component as an indicator of attentional selectivity. , 1996, Electroencephalography and clinical neurophysiology.

[28]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[29]  Christian N L Olivers,et al.  Interactions between visual working memory and visual attention. , 2008, Frontiers in bioscience : a journal and virtual library.

[30]  E. Averbach,et al.  Short-term memory in vision , 1961 .

[31]  Nicolas Robitaille,et al.  Short-term consolidation of visual patterns interferes with visuo-spatial attention: Converging evidence from human electrophysiology , 2007, Brain Research.

[32]  M. Sereno,et al.  Mapping of Contralateral Space in Retinotopic Coordinates by a Parietal Cortical Area in Humans , 2001, Science.

[33]  Edward E. Smith,et al.  Temporal dynamics of brain activation during a working memory task , 1997, Nature.

[34]  Jöran Lepsien,et al.  Directing spatial attention in mental representations: Interactions between attentional orienting and working-memory load , 2005, NeuroImage.

[35]  R. T. Pivik,et al.  Guidelines for the recording and quantitative analysis of electroencephalographic activity in research contexts. , 1993, Psychophysiology.

[36]  M. Corbetta,et al.  Neural Systems for Visual Orienting and Their Relationships to Spatial Working Memory , 2002, Journal of Cognitive Neuroscience.

[37]  C. Frith,et al.  The Role of Working Memory in Visual Selective Attention , 2001, Science.

[38]  R. Shepard Ecological constraints on internal representation: resonant kinematics of perceiving, imagining, thinking, and dreaming. , 1984, Psychological review.

[39]  G. Woodman,et al.  Visual search is slowed when visuospatial working memory is occupied , 2004, Psychonomic bulletin & review.

[40]  P. Jolicoeur,et al.  The interdependence of spatial attention and lexical access as revealed by early asymmetries in occipito-parietal ERP activity. , 2007, Psychophysiology.

[41]  Vincent Di Lollo,et al.  Electrophysiological Indices of Target and Distractor Processing in Visual Search , 2009, Journal of Cognitive Neuroscience.

[42]  Nicolas Robitaille,et al.  On the control of visual spatial attention: evidence from human electrophysiology , 2006, Psychological research.

[43]  G Gratton,et al.  The contralateral organization of visual memory: a theoretical concept and a research tool. , 1998, Psychophysiology.

[44]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[45]  John Jonides,et al.  Common and distinct neural correlates of perceptual and memorial selection , 2009, NeuroImage.

[46]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[47]  P. Maquet,et al.  Orienting Attention to Locations in Perceptual Versus Mental Representations , 2004, Journal of Cognitive Neuroscience.

[48]  Leslie G. Ungerleider,et al.  Transient and sustained activity in a distributed neural system for human working memory , 1997, Nature.

[49]  J. Jay Todd,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004, Nature.

[50]  A. A. Wijers,et al.  An event-related brain potential correlate of visual short-term memory. , 1999, Neuroreport.

[51]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[52]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[53]  J. C. Johnston,et al.  Involuntary covert orienting is contingent on attentional control settings. , 1992, Journal of experimental psychology. Human perception and performance.

[54]  M. Chun,et al.  Organization of visual short-term memory. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[55]  Nicolas Robitaille,et al.  Attentional control and capture in the attentional blink paradigm: Evidence from human electrophysiology , 2006 .

[56]  John Duncan,et al.  A neural basis for visual search in inferior temporal cortex , 1993, Nature.

[57]  Benoit Brisson,et al.  Dissociation of the N2pc and sustained posterior contralateral negativity in a choice response task , 2008, Brain Research.

[58]  A. Nobre,et al.  Where and When to Pay Attention: The Neural Systems for Directing Attention to Spatial Locations and to Time Intervals as Revealed by Both PET and fMRI , 1998, The Journal of Neuroscience.

[59]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[60]  G. Woodman,et al.  Visual Search Remains Efficient when Visual Working Memory is Full , 2001, Psychological science.

[61]  Roy Luria,et al.  Visual Short-term Memory Capacity for Simple and Complex Objects , 2010, Journal of Cognitive Neuroscience.

[62]  Jöran Lepsien,et al.  Searching for Targets within the Spatial Layout of Visual Short-Term Memory , 2009, The Journal of Neuroscience.

[63]  Benoit Brisson,et al.  Electrophysiological evidence of central interference in the control of visuospatial attention , 2007, Psychonomic bulletin & review.

[64]  Bernhard Hommel,et al.  Responding to object files: Automatic integration of spatial information revealed by stimulus-response compatibility effects , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[65]  C. C. Wood,et al.  Scalp distributions of event-related potentials: an ambiguity associated with analysis of variance models. , 1985, Electroencephalography and clinical neurophysiology.

[66]  Martin Eimer,et al.  Attentional capture by visual singletons is mediated by top-down task set: new evidence from the N2pc component. , 2008, Psychophysiology.

[67]  G K Aguirre,et al.  Neural components of topographical representation. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[68]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[69]  S. Luck,et al.  Neural sources of focused attention in visual search. , 2000, Cerebral cortex.

[70]  F. Perrin,et al.  Spherical splines for scalp potential and current density mapping. , 1989, Electroencephalography and clinical neurophysiology.

[71]  M. Coltheart,et al.  Iconic memory and visible persistence , 1980, Perception & psychophysics.

[72]  Geoffrey F Woodman,et al.  Serial deployment of attention during visual search. , 2003, Journal of experimental psychology. Human perception and performance.

[73]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[74]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.