Recognition of objects and their component parts: responses of single units in the temporal cortex of the macaque.

We investigated the role that different component parts play in the neural encoding of the visual appearance of one complex object in the temporal cortex. Cells responsive to the sight of the entire human body (but no to control stimuli) were tested with two subregions (head alone with the body occluded from sight and the body alone with the head occluded). Forty-two percent (22 of 53) of cells responded to the whole body and to one of the two body regions tested separately: 72% (17 of 22) responding to the head and 28% (5 of 22) to the rest of the body. Forty-two percent (22 of 53) of cells responded independently to both regions of the body when tested in isolation. The remaining cells (17%, 9 of 53) were selective for the entire body and unresponsive to component parts. The majority of cells tested (90%, 35 of 39) were selective for perspective view (e.g., some cells respond optimally to the side view of the body, others to the back view). Comparable levels of view sensitivity were found for responses to the whole body and its parts. Results indicate (1) separate neuronal analysis of body parts and (2) extensive integration of information from different parts. Contrary to influential models of object recognition (Marr and Nishihara, 1978; Biederman, 1987), the results indicate view-specific processing both for the appearance of separate object components and for integration of information across components.

[1]  W. J. Langford.  Statistical Methods , 1959, Nature.

[2]  D. B. Bender,et al.  Visual Receptive Fields of Neurons in Inferotemporal Cortex of the Monkey , 1969, Science.

[3]  D. B. Bender,et al.  Visual properties of neurons in inferotemporal cortex of the Macaque. , 1972, Journal of neurophysiology.

[4]  A. Taylor,et al.  The contribution of the right parietal lobe to object recognition. , 1973, Cortex; a journal devoted to the study of the nervous system and behavior.

[5]  C. Gross.  Visual Functions of Inferotemporal Cortex , 1973 .

[6]  D. Pandya,et al.  Afferent cortical connections and architectonics of the superior temporal sulcus and surrounding cortex in the rhesus monkey , 1978, Brain Research.

[7]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  R. Desimone,et al.  Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. , 1981, Journal of neurophysiology.

[9]  R. Shepard,et al.  Mental Images and Their Transformations , 1982 .

[10]  R. Desimone,et al.  Shape recognition and inferior temporal neurons. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Donald D. Hoffman,et al.  Parts of recognition , 1984, Cognition.

[12]  A. J. Mistlin,et al.  Neurones responsive to faces in the temporal cortex: studies of functional organization, sensitivity to identity and relation to perception. , 1984, Human neurobiology.

[13]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[15]  A. J. Mistlin,et al.  Visual cells in the temporal cortex sensitive to face view and gaze direction , 1985, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[16]  D. Rosene,et al.  A cryoprotection method that facilitates cutting frozen sections of whole monkey brains for histological and histochemical processing without freezing artifact. , 1986, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[17]  E. Warrington,et al.  Visual Object Recognition in Patients with Right-Hemisphere Lesions: Axes or Features? , 1986, Perception.

[18]  V. Bruce,et al.  The basis of the 3/4 view advantage in face recognition , 1987 .

[19]  B. A. Baldwin,et al.  Cells in temporal cortex of conscious sheep can respond preferentially to the sight of faces. , 1987, Science.

[20]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[21]  Y. Miyashita,et al.  Neuronal correlate of pictorial short-term memory in the primate temporal cortexYasushi Miyashita , 1988, Nature.

[22]  Tony P. Pridmore,et al.  TINA: a 3D vision system for pick and place , 1988, Image Vis. Comput..

[23]  Y. Miyashita.  Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[24]  S. Ullman.  Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.

[25]  D I Perrett,et al.  Frameworks of analysis for the neural representation of animate objects and actions. , 1989, The Journal of experimental biology.

[26]  M. Tarr,et al.  Mental rotation and orientation-dependence in shape recognition , 1989, Cognitive Psychology.

[27]  M. Hasselmo,et al.  The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey , 1989, Behavioural Brain Research.

[28]  Allen M. Waxman,et al.  Learning Aspect Graph Representations from View Sequences , 1989, NIPS.

[29]  P. Fldik.  Forming sparse representations by local anti-Hebbian learning , 1990 .

[30]  R. Desimone,et al.  Attentional control of visual perception: cortical and subcortical mechanisms. , 1990, Cold Spring Harbor symposia on quantitative biology.

[31]  Shimon Edelman,et al.  Viewpoint-specific Representations in Three-dimensional Object Recognition , 1990 .

[32]  Peter Földiák,et al.  Learning Invariance from Transformation Sequences , 1991, Neural Comput..

[33]  M. Harries,et al.  Visual Processing of Faces in Temporal Cortex: Physiological Evidence for a Modular Organization and Possible Anatomical Correlates , 1991, Journal of Cognitive Neuroscience.

[34]  Keiji Tanaka,et al.  Coding visual images of objects in the inferotemporal cortex of the macaque monkey. , 1991, Journal of neurophysiology.

[35]  R. Beauchamp.  VISION, MEMORY, AND THE TEMPORAL LOBE , 1991 .

[36]  M. Farah,et al.  Viewer-Centered and Object-Centered Representations in the Recognition of Naturalistic Line Drawings , 1991 .

[37]  Minami Ito,et al.  Columns for visual features of objects in monkey inferotemporal cortex , 1992, Nature.

[38]  D I Perrett,et al.  Organization and functions of cells responsive to faces in the temporal cortex. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[39]  K. Verfaillie.  Variant points of view on viewpoint invariance. , 1992, Canadian journal of psychology.

[40]  D. Perrett,et al.  Time course of neural responses discriminating different views of the face and head. , 1992, Journal of neurophysiology.

[41]  David I. Perrett,et al.  Neurophysiology of shape processing , 1993, Image Vis. Comput..

[42]  H. Komatsu,et al.  Relationships between color, shape, and pattern selectivities of neurons in the inferior temporal cortex of the monkey. , 1993, Journal of neurophysiology.

[43]  C. B. Cave,et al.  The Role of Parts and Spatial Relations in Object Identification , 1993, Perception.