Remembered but Unused: The Accessory Items in Working Memory that Do Not Guide Attention

If we search for an item, a representation of this item in our working memory guides attention to matching items in the visual scene. We can hold multiple items in working memory. Do all these items guide attention in parallel? We asked participants to detect a target object in a stream of objects while they maintained a second item in memory for a subsequent task. On some trials, we presented this memory item as a distractor in the stream. Subjects did not confuse these memory items with the search target, as the false alarm rate on trials where the memory item was presented in the stream was comparable to that on trials with only regular distractors. However, a comparable performance does not exclude that the memory items are processed differently from normal distractors. We therefore recorded event-related potentials (ERPs) evoked by search targets, memory items, and regular distractors. As expected, ERPs evoked by search targets differed from those evoked by distractors. Search targets elicited an occipital selection negativity and a frontal selection positivity indexing selective attention, whereas the P3b component, which reflects the matching of sensory events to memory representations, was enhanced for targets compared to distractors. Remarkably, the ERPs evoked by memory items were indistinguishable from the ERPs evoked by normal distractors. This implies that the search target has a special status in working memory that is not shared by the other items. These other, “accessory” items do not guide attention and are excluded from the matching process.

[1]  R. Desimone,et al.  Parallel neuronal mechanisms for short-term memory. , 1994, Science.

[2]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[3]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[4]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[5]  Robert Desimone,et al.  Parallel and Serial Neural Mechanisms for Visual Search in Macaque Area V4 , 2005, Science.

[6]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[7]  Jeffrey D. Schall,et al.  Neural basis of saccade target selection in frontal eye field during visual search , 1993, Nature.

[8]  S. Luck,et al.  Spatio‐temporal dynamics of attention to color: Evidence from human electrophysiology , 1998, Human brain mapping.

[9]  P. Goldman-Rakic,et al.  Inactivation of parietal and prefrontal cortex reveals interdependence of neural activity during memory-guided saccades. , 2000, Journal of neurophysiology.

[10]  P. Goldman-Rakic,et al.  Dissociation of object and spatial processing domains in primate prefrontal cortex. , 1993, Science.

[11]  F H Previc,et al.  Electrophysiological and behavioral indicants of selective attention to multifeature gratings , 1982, Perception & psychophysics.

[12]  M. R. Harter,et al.  Hemispheric differences in the neural processing of stimulus location and type: Effects of selective attention on visual evoked potentials , 1982, Neuropsychologia.

[13]  S. Sternberg High-Speed Scanning in Human Memory , 1966, Science.

[14]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[15]  Edward E. Smith,et al.  Temporal dynamics of brain activation during a working memory task , 1997, Nature.

[16]  Nancy B. Carlisle,et al.  Automatic and strategic effects in the guidance of attention by working memory representations. , 2011, Acta psychologica.

[17]  A. Baddeley The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[18]  S C Rao,et al.  Integration of what and where in the primate prefrontal cortex. , 1997, Science.

[19]  Rainer Goebel,et al.  Cortical capacity constraints for visual working memory: dissociation of fMRI load effects in a fronto-parietal network , 2003, NeuroImage.

[20]  Earl K Miller,et al.  The representation of multiple objects in prefrontal neuronal delay activity. , 2007, Cerebral cortex.

[21]  John Duncan,et al.  A neural basis for visual search in inferior temporal cortex , 1993, Nature.

[22]  Maro G. Machizawa,et al.  Neural activity predicts individual differences in visual working memory capacity , 2004, Nature.

[23]  Earl K. Miller,et al.  Selective representation of relevant information by neurons in the primate prefrontal cortex , 1998, Nature.

[24]  G. Woodman,et al.  Do the contents of visual working memory automatically influence attentional selection during visual search? , 2007, Journal of experimental psychology. Human perception and performance.

[25]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[26]  Steven A. Hillyard,et al.  Vertex potentials evoked during auditory signal detection: Relation to decision criteria , 1973 .

[27]  G. Humphreys,et al.  Dividing the mind: The necessary role of the frontal lobes in separating memory from search , 2006, Neuropsychologia.

[28]  Jeffrey D Schall,et al.  The role of working memory representations in the control of attention. , 2007, Cerebral cortex.

[29]  G. Humphreys,et al.  Early, involuntary top-down guidance of attention from working memory. , 2005, Journal of experimental psychology. Human perception and performance.

[30]  J. Theeuwes,et al.  Feature-based memory-driven attentional capture: visual working memory content affects visual attention. , 2006, Journal of experimental psychology. Human perception and performance.

[31]  R. H. Phaf,et al.  SLAM: A connectionist model for attention in visual selection tasks , 1990, Cognitive Psychology.

[32]  A. Sanders Issues and trends in the debate on discrete vs. continuous processing of information , 1990 .

[33]  E. Vogel,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004 .

[34]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[35]  A Kok,et al.  Event-related potentials to conjunctions of spatial frequency and orientation as a function of stimulus parameters and response requirements. , 1993, Electroencephalography and clinical neurophysiology.

[36]  J. Fuster,et al.  Inferotemporal neurons distinguish and retain behaviorally relevant features of visual stimuli. , 1981, Science.

[37]  R. C. Oldfield THE ASSESSMENT AND ANALYSIS OF HANDEDNESS , 1971 .

[38]  M. Scherg,et al.  Mental Chronometry of Working Memory Retrieval: A Combined Functional Magnetic Resonance Imaging and Event-Related Potentials Approach , 2006, The Journal of Neuroscience.

[39]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[40]  F. Hamker The reentry hypothesis: the putative interaction of the frontal eye field, ventrolateral prefrontal cortex, and areas V4, IT for attention and eye movement. , 2005, Cerebral cortex.

[41]  Paul E. Downing,et al.  Competition in visual working memory for control of search , 2003 .

[42]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[43]  M. Corbetta,et al.  Neural Systems for Visual Orienting and Their Relationships to Spatial Working Memory , 2002, Journal of Cognitive Neuroscience.

[44]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[45]  R. Knight,et al.  Auditory event-related potentials dissociate early and late memory processes. , 1995, Electroencephalography and clinical neurophysiology.

[46]  Christian N L Olivers,et al.  What drives memory-driven attentional capture? The effects of memory type, display type, and search type. , 2009, Journal of experimental psychology. Human perception and performance.

[47]  R. Andersen,et al.  Memory related motor planning activity in posterior parietal cortex of macaque , 1988, Experimental Brain Research.

[48]  C. Bundesen A theory of visual attention. , 1990, Psychological review.

[49]  P. Roelfsema,et al.  The effect of items in working memory on the deployment of attention and the eyes during visual search. , 2006, Journal of experimental psychology. Human perception and performance.

[50]  E. Niebur,et al.  Modeling the Temporal Dynamics of IT Neurons in Visual Search: A Mechanism for Top-Down Selective Attention , 1996, Journal of Cognitive Neuroscience.

[51]  M. Manosevitz High-Speed Scanning in Human Memory , .

[52]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[53]  Y. Miyashita,et al.  Top-down signal from prefrontal cortex in executive control of memory retrieval , 1999, Nature.

[54]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[55]  Min-Shik Kim,et al.  The guidance effect of working memory load on visual search , 2010 .

[56]  H Spekreijse,et al.  A Neural Correlate of Working Memory in the Monkey Primary Visual Cortex , 2001, Science.

[57]  Leslie G. Ungerleider,et al.  Transient and sustained activity in a distributed neural system for human working memory , 1997, Nature.

[58]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[59]  R. Desimone,et al.  Responses of Neurons in Inferior Temporal Cortex during Memory- Guided Visual Search , 1998 .

[60]  A. Kok On the utility of P3 amplitude as a measure of processing capacity. , 2001, Psychophysiology.

[61]  Suiping Wang,et al.  Guidance of visual attention from working memory contents depends on stimulus attributes , 2010, Neuroscience Letters.