Searching for Targets within the Spatial Layout of Visual Short-Term Memory

Recent studies have revealed that the internal representations that we construct from the environment and maintain in visual short-term memory (VSTM) to guide behavior are highly flexible and can be selectively modulated according to our task goals and expectations. In the current study, we conducted two experiments to compare and contrast neural mechanisms of selective attention related to searching for target items within perceptual versus VSTM representations. We used event-related potentials to investigate whether searching for relevant target items from within VSTM representations involves spatially specific biasing of neural activity in a manner analogous to that which occurs during visual search for target items in perceptual arrays. The results, replicated across the two experiments, revealed that selection of a target object within a search array maintained in VSTM proceeds through a similar mechanism as that in the perceptual domain. In line with previous results, N2pc potentials were obtained when targets were identified within a perceptual visual-search array. Interestingly, equivalent N2pcs, with similar time courses and scalp distributions, were also elicited when target items were identified within a VSTM representation. The findings reinforce the notion of highly flexible VSTM representations that can be modulated according to task goals and suggest a large degree of overlap in the spatially specific neural mechanisms of target selection across the perceptual and VSTM domains.

[1]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[2]  Anna C. Nobre,et al.  Spatial Attention can Bias Search in Visual Short-Term Memory , 2007, Frontiers in human neuroscience.

[3]  L. Pessoa,et al.  Motivation sharpens exogenous spatial attention. , 2007, Emotion.

[4]  C. C. Wood,et al.  Scalp distributions of event-related potentials: an ambiguity associated with analysis of variance models. , 1985, Electroencephalography and clinical neurophysiology.

[5]  C C Wood,et al.  Letter: The epsilon-adjustment procedure for repeated-measures analyses of variance. , 1976, Psychophysiology.

[6]  J. Duncan,et al.  Top-Down Activation of Shape-Specific Population Codes in Visual Cortex during Mental Imagery , 2009, The Journal of Neuroscience.

[7]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[8]  John J. Foxe,et al.  Determinants and mechanisms of attentional modulation of neural processing. , 2001, Frontiers in Bioscience.

[9]  J. Saiki,et al.  [Perceptual judgments of novel contour shapes and hierarchical descriptions of geometrical properties]. , 2003, Shinrigaku kenkyu : The Japanese journal of psychology.

[10]  Michael X. Cohen,et al.  Inferior Temporal, Prefrontal, and Hippocampal Contributions to Visual Working Memory Maintenance and Associative Memory Retrieval , 2004, The Journal of Neuroscience.

[11]  Robert T. Knight,et al.  Top-down Enhancement and Suppression of the Magnitude and Speed of Neural Activity , 2005, Journal of Cognitive Neuroscience.

[12]  John Duncan,et al.  A neural basis for visual search in inferior temporal cortex , 1993, Nature.

[13]  H. Lüders,et al.  American Electroencephalographic Society Guidelines for Standard Electrode Position Nomenclature , 1991, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[14]  Jöran Lepsien,et al.  Directing spatial attention in mental representations: Interactions between attentional orienting and working-memory load , 2005, NeuroImage.

[15]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[16]  S. Kosslyn,et al.  Brain areas underlying visual mental imagery and visual perception: an fMRI study. , 2004, Brain research. Cognitive brain research.

[17]  Victor A. F. Lamme,et al.  Are There Multiple Visual Short-Term Memory Stores? , 2008, PloS one.

[18]  A. Nobre,et al.  Spatial Selection of Features within Perceived and Remembered Objects , 2009, NeuroImage.

[19]  A. Nobre,et al.  Cognitive control of attention in the human brain: Insights from orienting attention to mental representations , 2006, Brain Research.

[20]  B. Postle,et al.  Prefrontal cortical contributions to working memory: evidence from event-related fMRI studies , 2000, Experimental Brain Research.

[21]  S J Luck,et al.  Spatial filtering during visual search: evidence from human electrophysiology. , 1994, Journal of experimental psychology. Human perception and performance.

[22]  Rachel S. Sussman,et al.  Orienting attention in visual working memory reduces interference from memory probes. , 2008, Journal of experimental psychology. Learning, memory, and cognition.

[23]  A. Nobre,et al.  Attentional modulation of object representations in working memory. , 2007, Cerebral cortex.

[24]  C. Curtis,et al.  Persistent activity in the prefrontal cortex during working memory , 2003, Trends in Cognitive Sciences.

[25]  D. Guthrie,et al.  Significance testing of difference potentials. , 1991, Psychophysiology.

[26]  G Gratton,et al.  The contralateral organization of visual memory: a theoretical concept and a research tool. , 1998, Psychophysiology.

[27]  Vincent Di Lollo,et al.  Electrophysiological Indices of Target and Distractor Processing in Visual Search , 2009, Journal of Cognitive Neuroscience.

[28]  C. C. Wood,et al.  The ɛ-Adjustment Procedure for Repeated-Measures Analyses of Variance , 1976 .

[29]  M. Eimer The N2pc component as an indicator of attentional selectivity. , 1996, Electroencephalography and clinical neurophysiology.

[30]  A. Nobre,et al.  Orienting Attention to Locations in Internal Representations , 2003, Journal of Cognitive Neuroscience.

[31]  M. Chun,et al.  Organization of visual short-term memory. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[32]  S. Treue Visual attention: the where, what, how and why of saliency , 2003, Current Opinion in Neurobiology.

[33]  R. Desimone,et al.  Responses of Neurons in Inferior Temporal Cortex during Memory- Guided Visual Search , 1998 .

[34]  Martin Eimer,et al.  The N2pc component and its links to attention shifts and spatially selective visual processing. , 2008, Psychophysiology.

[35]  B. Postle Working memory as an emergent property of the mind and brain , 2006, Neuroscience.

[36]  M. Petrides The role of the mid-dorsolateral prefrontal cortex in working memory , 2000, Experimental Brain Research.

[37]  Benoit Brisson,et al.  Dissociation of the N2pc and sustained posterior contralateral negativity in a choice response task , 2008, Brain Research.

[38]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[39]  S. Luck,et al.  Neural sources of focused attention in visual search. , 2000, Cerebral cortex.

[40]  Joaquín M. Fuster,et al.  Executive frontal functions , 2000, Experimental Brain Research.

[41]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[42]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[43]  Katsuyuki Sakai,et al.  The prefrontal cortex and working memory: physiology and brain imaging , 2004, Current Opinion in Neurobiology.

[44]  Pierre Jolicœur,et al.  The N2pc component and stimulus duration , 2007, Neuroreport.

[45]  Adam Gazzaley,et al.  Functional interactions between prefrontal and visual association cortex contribute to top-down modulation of visual processing. , 2007, Cerebral cortex.

[46]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[47]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[48]  H. Spekreijse,et al.  Large capacity storage of integrated objects before change blindness , 2003, Vision Research.

[49]  S M Kosslyn,et al.  Visual images preserve metric spatial information: evidence from studies of image scanning. , 1978, Journal of experimental psychology. Human perception and performance.

[50]  M. Manosevitz High-Speed Scanning in Human Memory , .

[51]  John J. Foxe,et al.  The Spatiotemporal Dynamics of Illusory Contour Processing: Combined High-Density Electrical Mapping, Source Analysis, and Functional Magnetic Resonance Imaging , 2002, The Journal of Neuroscience.