Neural Representation of Targets and Distractors during Object Individuation and Identification

In many everyday activities, we need to attend and encode multiple target objects among distractor objects. For example, when driving a car on a busy street, we need to simultaneously attend objects such as traffic signs, pedestrians, and other cars, while ignoring colorful and flashing objects in display windows. To explain how multiple visual objects are selected and encoded in visual STM and in perception in general, the neural object file theory argues that, whereas object selection and individuation is supported by inferior intraparietal sulcus (IPS), the encoding of detailed object features that enables object identification is mediated by superior IPS and higher visual areas such as the lateral occipital complex (LOC). Nevertheless, because task-irrelevant distractor objects were never present in previous studies, it is unclear how distractor objects would impact neural responses related to target object individuation and identification. To address this question, in two fMRI experiments, we asked participants to encode target object shapes among distractor object shapes, with targets and distractors shown in different spatial locations and in different colors. We found that distractor-related neural processing only occurred at low, but not at high, target encoding load and impacted both target individuation in inferior IPS and target identification in superior IPS and LOC. However, such distractor-related neural processing was short-lived, as it was only present during the visual STM encoding but not the delay period. Moreover, with spatial cuing of target locations in advance, distractor processing was attenuated during target encoding in superior IPS. These results are consistent with the load theory of visual information processing. They also show that, whereas inferior IPS and LOC were automatically engaged in distractor processing under low task load, with the help of precuing, superior IPS was able to only encode the task-relevant visual information.

[1]  E. Viding,et al.  Load theory of selective attention and cognitive control. , 2004, Journal of experimental psychology. General.

[2]  Galit Yovel,et al.  Clutter Modulates the Representation of Target Objects in the Human Occipitotemporal Cortex , 2014, Journal of Cognitive Neuroscience.

[3]  Yaoda Xu,et al.  Representing connected and disconnected shapes in human inferior intraparietal sulcus , 2008, NeuroImage.

[4]  Y. Tsal,et al.  Perceptual load as a major determinant of the locus of selection in visual attention , 1994, Perception & psychophysics.

[5]  B T Hyman,et al.  H. M.’s Medial Temporal Lobe Lesion: Findings from Magnetic Resonance Imaging , 1997, The Journal of Neuroscience.

[6]  J. Deutsch Perception and Communication , 1958, Nature.

[7]  N. Moray Attention in Dichotic Listening: Affective Cues and the Influence of Instructions , 1959 .

[8]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[9]  N. Lavie Distracted and confused?: Selective attention under load , 2005, Trends in Cognitive Sciences.

[10]  Z. Pylyshyn Some primitive mechanisms of spatial attention , 1994, Cognition.

[11]  E. Vogel,et al.  Word meanings can be accessed but not reported during the attentional blink , 1996, Nature.

[12]  Yaoda Xu The Role of the Superior Intraparietal Sulcus in Supporting Visual Short-Term Memory for Multifeature Objects , 2007, The Journal of Neuroscience.

[13]  Leslie G. Ungerleider,et al.  A neural system for human visual working memory. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Z. Pylyshyn The role of location indexes in spatial perception: A sketch of the FINST spatial-index model , 1989, Cognition.

[15]  Yaoda Xu,et al.  Visual grouping in human parietal cortex , 2007, Proceedings of the National Academy of Sciences.

[16]  Yaoda Xu,et al.  Distinctive Neural Mechanisms Supporting Visual Object Individuation and Identification , 2009, Journal of Cognitive Neuroscience.

[17]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[18]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[19]  N. Kanwisher,et al.  Cortical Regions Involved in Perceiving Object Shape , 2000, The Journal of Neuroscience.

[20]  J. Deutsch,et al.  Attention: Some theoretical considerations. , 1963 .

[21]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[22]  J. Jay Todd,et al.  Capacity limit of visual short-term memory in human posterior parietal cortex , 2004, Nature.

[23]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[24]  P. Goldman-Rakic Cellular basis of working memory , 1995, Neuron.

[25]  Ana Torralbo,et al.  Perceptual-Load-Induced Selection as a Result of Local Competitive Interactions in Visual Cortex , 2008, Psychological science.

[26]  B. Milner,et al.  Further analysis of the hippocampal amnesic syndrome: 14-year follow-up study of H.M.☆ , 1968 .

[27]  J. Assad,et al.  Dynamic coding of behaviourally relevant stimuli in parietal cortex , 2002, Nature.

[28]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[29]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[30]  M. Chun,et al.  Selecting and perceiving multiple visual objects , 2009, Trends in Cognitive Sciences.

[31]  M. Pinsk,et al.  Push-pull mechanism of selective attention in human extrastriate cortex. , 2004, Journal of neurophysiology.

[32]  J. Talairach,et al.  Co-Planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging , 1988 .

[33]  Suzanne Corkin,et al.  ACQUISITION OF MOTOR SKILL AFTER BILATERAL MEDIAL TEMPORAL-LOBE EXCISION , 1968 .

[34]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[35]  G. Woodman,et al.  Neural fate of ignored stimuli: dissociable effects of perceptual and working memory load , 2004, Nature Neuroscience.

[36]  S. Corkin What's new with the amnesic patient H.M.? , 2002, Nature Reviews Neuroscience.

[37]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[38]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[39]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[40]  David J. Freedman,et al.  Experience-dependent representation of visual categories in parietal cortex , 2006, Nature.

[41]  Yaoda Xu,et al.  The Neural Fate of Task-Irrelevant Features in Object-Based Processing , 2010, The Journal of Neuroscience.