Category Selectivity in the Ventral Visual Pathway Confers Robustness to Clutter and Diverted Attention

Are objects coded by a small number of neurons or cortical regions that respond preferentially to the object in question, or by more distributed patterns of responses, including neurons or regions that respond only weakly? Distributed codes can represent a larger number of alternative items than sparse codes but produce ambiguities when multiple items are represented simultaneously (the "superposition" problem). Recent studies found category information in the distributed pattern of response across the ventral visual pathway, including in regions that do not "prefer" the object in question. However, these studies measured neural responses to isolated objects, a situation atypical of real-world vision, where multiple objects are usually present simultaneously ("clutter"). We report that information in the spatial pattern of fMRI response about standard object categories is severely disrupted by clutter and eliminated when attention is diverted. However, information about preferred categories in category-specific regions is undiminished by clutter and partly preserved under diverted attention. These findings indicate that in natural conditions, the pattern of fMRI response provides robust category information only for objects coded in selective cortical regions and highlight the vulnerability of distributed representations to clutter and the advantages of sparse cortical codes in mitigating clutter costs.

[1]  P. Downing,et al.  Bodies capture attention when nothing is expected , 2004, Cognition.

[2]  Geoffrey E. Hinton,et al.  Parallel Models of Associative Memory , 1989 .

[3]  N. Kanwisher,et al.  Domain specificity in visual cortex. , 2006, Cerebral cortex.

[4]  James J DiCarlo,et al.  Multiple Object Response Normalization in Monkey Inferotemporal Cortex , 2005, The Journal of Neuroscience.

[5]  C. Koch,et al.  The duration of the attentional blink in natural scenes depends on stimulus category , 2007, Vision Research.

[6]  Alice J. O'Toole,et al.  Partially Distributed Representations of Objects and Faces in Ventral Temporal Cortex , 2005, Journal of Cognitive Neuroscience.

[7]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[8]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[9]  Frank Tong,et al.  The Face of Controversy , 2001, Science.

[10]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[11]  Bartlett W. Mel,et al.  Minimizing Binding Errors Using Learned Conjunctive Features , 2000, Neural Computation.

[12]  Peter Földiák,et al.  SPARSE CODING IN THE PRIMATE CORTEX , 2002 .

[13]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[14]  N. Kanwisher,et al.  Does the fusiform face area contain subregions highly selective for nonfaces? , 2007, Nature Neuroscience.

[15]  G. Rees,et al.  Neuroimaging: Decoding mental states from brain activity in humans , 2006, Nature Reviews Neuroscience.

[16]  Edward Awh,et al.  Evidence against a central bottleneck during the attentional blink: Multiple channels for configural and featural processing , 2004, Cognitive Psychology.

[17]  J D Cohen,et al.  Neuroscience. The face of controversy. , 2001, Science.

[18]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[19]  N. Kanwisher,et al.  Only some spatial patterns of fMRI response are read out in task performance , 2007, Nature Neuroscience.

[20]  David J. Anderson,et al.  A single population of olfactory sensory neurons mediates an innate avoidance behaviour in Drosophila , 2004, Nature.

[21]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[22]  David D. Cox,et al.  Opinion TRENDS in Cognitive Sciences Vol.11 No.8 Untangling invariant object recognition , 2022 .

[23]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[24]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[25]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[26]  N. Kanwisher,et al.  How Distributed Is Visual Category Information in Human Occipito-Temporal Cortex? An fMRI Study , 2002, Neuron.

[27]  Leila Reddy,et al.  Coding of visual objects in the ventral stream , 2006, Current Opinion in Neurobiology.

[28]  A. Wong,et al.  Two-Photon Calcium Imaging Reveals an Odor-Evoked Map of Activity in the Fly Brain , 2003, Cell.

[29]  Michèle Fabre-Thorpe,et al.  ULTRA RAPID FACE DETECTION IN NATURAL IMAGES : IMPLICATIONS FOR COMPUTATION IN THE VISUAL SYSTEM , 2006 .

[30]  N. Lavie,et al.  Changing Faces: A Detection Advantage in the Flicker Paradigm , 2001, Psychological science.

[31]  T. Carlson,et al.  Patterns of Activity in the Categorical Representations of Objects , 2003 .