Partially Distributed Representations of Objects and Faces in Ventral Temporal Cortex

Object and face representations in ventral temporal (VT) cortex were investigated by combining object confusability data from a computational model of object classification with neural response confusability data from a functional neuroimaging experiment. A pattern-based classification algorithm learned to categorize individual brain maps according to the object category being viewed by the subject. An identical algorithm learned to classify an image-based, view-dependent representation of the stimuli. High correlations were found between the confusability of object categories and the confusability of brain activity maps. This occurred even with the inclusion of multiple views of objects, and when the object classification model was tested with high spatial frequency line drawings of the stimuli. Consistent with a distributed representation of objects in VT cortex, the data indicate that object categories with shared image-based attributes have shared neural structure.

[1]  A. O'Toole,et al.  Stimulus-specific effects in face recognition over changes in viewpoint , 1998, Vision Research.

[2]  Tomaso Poggio,et al.  Models of object recognition , 2000, Nature Neuroscience.

[3]  Michel Vidal-Naquet,et al.  Visual features of intermediate complexity and their use in classification , 2002, Nature Neuroscience.

[4]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[6]  Isabel Gauthier,et al.  Three-dimensional object recognition is viewpoint dependent , 1998, Nature Neuroscience.

[7]  K. Nakayama,et al.  RESPONSE PROPERTIES OF THE HUMAN FUSIFORM FACE AREA , 2000, Cognitive neuropsychology.

[8]  T. Carlson,et al.  Patterns of Activity in the Categorical Representations of Objects , 2003 .

[9]  M. Tarr,et al.  Activation of the middle fusiform 'face area' increases with expertise in recognizing novel objects , 1999, Nature Neuroscience.

[10]  I. Gauthier,et al.  Expertise for cars and birds recruits brain areas involved in face recognition , 2000, Nature Neuroscience.

[11]  L. Cohen,et al.  The neural bases of prosopagnosia and pure alexia: recent insights from functional neuroimaging , 2006, Current opinion in neurology.

[12]  Xiaoping P. Hu,et al.  Real‐time fMRI using brain‐state classification , 2007, Human brain mapping.

[13]  Thomas E. Nichols,et al.  Statistical limitations in functional neuroimaging. I. Non-inferential methods and statistical models. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[14]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[15]  Leila Reddy,et al.  Coding of visual objects in the ventral stream , 2006, Current Opinion in Neurobiology.

[16]  M. V. Van Hulle,et al.  Encoding of Categories by Noncategory-Specific Neurons in the Inferior Temporal Cortex , 2001, Journal of Cognitive Neuroscience.

[17]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[18]  Tutis Vilis,et al.  Task-related laterality effects in the lateral occipital complex , 2007, Brain Research.

[19]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[20]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[21]  N. Kanwisher,et al.  How Distributed Is Visual Category Information in Human Occipito-Temporal Cortex? An fMRI Study , 2002, Neuron.

[22]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[23]  I. Biederman,et al.  Recognizing depth-rotated objects: Evidence and conditions for three-dimensional viewpoint invariance. , 1993 .

[24]  N. Kanwisher,et al.  The fusiform face area: a cortical region specialized for the perception of faces , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[25]  D I Perrett,et al.  Organization and functions of cells responsive to faces in the temporal cortex. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[26]  Leslie G. Ungerleider,et al.  Distributed representation of objects in the human ventral visual pathway. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[27]  G. Rees,et al.  Neuroimaging: Decoding mental states from brain activity in humans , 2006, Nature Reviews Neuroscience.

[28]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[29]  S. Edelman,et al.  Toward direct visualization of the internal shape representation space by fMRI , 1998, Psychobiology.

[30]  N. Logothetis,et al.  View-dependent object recognition by monkeys , 1994, Current Biology.

[31]  Keiji Tanaka,et al.  Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. , 1994, Journal of neurophysiology.

[32]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.