View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex.

A view-invariant representation of objects in the brain would have many computational advantages. Here we describe a population of single neurons in the temporal visual cortex (IT) that have view-invariant representations of familiar objects. Ten real plastic objects were placed in the monkeys' home cages for a period of time before neurophysiological experiments in which neuronal responses were measured to four views of each object. The macaques performed a visual fixation task, and had never been trained in object discrimination. The majority of the visual neurons recorded were responsive to some views of some objects and/or to the control stimuli, as would be expected from previous studies. However, a small subset of these neurons were responsive to all views of one or more of the objects, providing evidence that these neurons were coding for objects, rather than simply for individual views or visual features within the image. This result was confirmed by information theoretic analyses, which showed that the neurons provided information about which object was being seen, independently of the view. The coding scheme was shown to be sparse distributed, with relatively independent information being provided by the different neurons. Hypotheses about how these view-invariant cells are formed are described.

[1]  D. B. Bender,et al.  Visual properties of neurons in inferotemporal cortex of the Macaque. , 1972, Journal of neurophysiology.

[2]  E. Rolls,et al.  The latency of activation of neurones in the lateral hypothalamus and substantia innominata during feeding in the monkey , 1979, Brain Research.

[3]  B. Richmond,et al.  Implantation of magnetic search coils for measurement of eye position: An improved method , 1980, Vision Research.

[4]  R. Desimone,et al.  Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. , 1981, Journal of neurophysiology.

[5]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  L. Weiskrantz,et al.  Impairments of visual object transforms in monkeys. , 1984, Brain : a journal of neurology.

[7]  A. J. Mistlin,et al.  Visual cells in the temporal cortex sensitive to face view and gaze direction , 1985, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  G. Humphreys,et al.  To See But Not To See: A Case Study Of Visual Agnosia , 1987 .

[9]  E. Rolls,et al.  Gustatory responses of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. , 1990, Journal of neurophysiology.

[10]  Edmund T. Rolls,et al.  What determines the capacity of autoassociative memories in the brain? Network , 1991 .

[11]  Peter Földiák,et al.  Learning Invariance from Transformation Sequences , 1991, Neural Comput..

[12]  E. Rolls,et al.  Allocentric and egocentric spatial information processing in the hippocampal formation of the behaving primate , 1991, Psychobiology.

[13]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[14]  Minami Ito,et al.  Columns for visual features of objects in monkey inferotemporal cortex , 1992, Nature.

[15]  E T Rolls,et al.  Neurophysiological mechanisms underlying face processing within and beyond the temporal cortical visual areas. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[16]  M. Tovée,et al.  Information encoding and the responses of single neurons in the primate temporal visual cortex. , 1993, Journal of neurophysiology.

[17]  K Tanaka,et al.  Neuronal mechanisms of object recognition. , 1993, Science.

[18]  A. Mikami,et al.  Visual response properties of single neurons in the temporal pole of behaving monkeys. , 1994, Journal of neurophysiology.

[19]  M. Tovée,et al.  Translation invariance in the responses to faces of single neurons in the temporal visual cortical areas of the alert macaque. , 1994, Journal of neurophysiology.

[20]  E. Rolls Brain mechanisms for invariant visual recognition and learning , 1994, Behavioural Processes.

[21]  A. Mikami,et al.  Neuronal responses to photographs in the superior temporal sulcus of the rhesus monkey , 1994, Behavioural Brain Research.

[22]  Keiji Tanaka,et al.  Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. , 1994, Journal of neurophysiology.

[23]  D. Perrett,et al.  Recognition of objects and their component parts: responses of single units in the temporal cortex of the macaque. , 1994, Cerebral cortex.

[24]  E. Rolls Learning mechanisms in the temporal lobe visual cortex , 1995, Behavioural Brain Research.

[25]  H. Barlow The neuron doctrine in perception. , 1995 .

[26]  E T Rolls,et al.  Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. , 1995, Journal of neurophysiology.

[27]  Minami Ito,et al.  Size and position invariance of neuronal responses in monkey inferotemporal cortex. , 1995, Journal of neurophysiology.

[28]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[29]  Stefano Panzeri,et al.  The Upward Bias in Measures of Information Derived from Limited Data Samples , 1995, Neural Computation.

[30]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[31]  Y Miyashita,et al.  Feedback signal from medial temporal lobe mediates visual associative mnemonic codes of inferotemporal neurons. , 1996, Brain research. Cognitive brain research.

[32]  Wendy A Suzuki,et al.  The anatomy, physiology and functions of the perirhinal cortex , 1996, Current Opinion in Neurobiology.

[33]  K. Tanaka,et al.  Divergent Projections from the Anterior Inferotemporal Area TE to the Perirhinal and Entorhinal Cortices in the Macaque Monkey , 1996, The Journal of Neuroscience.

[34]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[35]  Y. Miyashita,et al.  Formation of mnemonic neuronal responses to visual paired associates in inferotemporal cortex is impaired by perirhinal and entorhinal lesions. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Stefano Panzeri,et al.  Analytical estimates of limited sampling biases in different information measures. , 1996, Network.

[37]  D. Gaffan,et al.  Impairment of visual object-discrimination learning after perirhinal cortex ablation. , 1997, Behavioral neuroscience.

[38]  E. Rolls,et al.  INVARIANT FACE AND OBJECT RECOGNITION IN THE VISUAL SYSTEM , 1997, Progress in Neurobiology.

[39]  A. Treves,et al.  The representational capacity of the distributed encoding of information provided by populations of neurons in primate temporal visual cortex , 1997, Experimental Brain Research.

[40]  E. Murray,et al.  Functional double dissociation between two inferior temporal cortical areas: perirhinal cortex versus middle temporal gyrus. , 1997, Journal of neurophysiology.

[41]  E. Rolls,et al.  Neural networks and brain function , 1998 .

[42]  Néstor Parga,et al.  Transform-Invariant Recognition by Association in a Recurrent Network , 1998, Neural Computation.

[43]  E T Rolls,et al.  Information about spatial view in an ensemble of primate hippocampal cells. , 1998, Journal of neurophysiology.