Scene perception: inferior temporal cortex neurons encode the positions of different objects in the scene

Inferior temporal cortex (IT) neurons have reduced receptive field sizes in complex natural scenes. This facilitates the read‐out of information about individual objects from IT, but raises the question of whether more than the single object present at the fovea is represented by the firing of IT neurons, as would be important for whole scene perception in which several objects may be located without eye movements. Recordings from IT neurons with five simultaneously presented objects, each subtending 7°, with one object at the fovea and the other four centred 10° eccentrically in the parafovea, showed that although 38 IT neurons had their best response to an effective stimulus at the fovea, eight IT neurons had their best response to an object when it was located in one or more of the parafoveal positions. Moreover, of 54 neurons tested for asymmetric parafoveal receptive fields, 35 (65%) had significantly different responses for different parafoveal positions. The asymmetry was partly related to competition within the receptive fields, as only 21% of the neurons had significant asymmetries when tested with just one object present located at the same parafoveal positions. The findings thus show that some evidence is conveyed by a population of IT neurons about the relative positions of several simultaneously presented objects in a scene extending well into the parafovea during a single fixation, and this is likely to be important in whole scene perception with multiple objects, including specifying the relative positions of different objects in a scene.

[1]  A. Churchill The Physiology of the Eye , 1949, The British journal of ophthalmology.

[2]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[3]  D. B. Bender,et al.  Visual properties of neurons in inferotemporal cortex of the Macaque. , 1972, Journal of neurophysiology.

[4]  I. Biederman Perceiving Real-World Scenes , 1972, Science.

[5]  I. Biederman,et al.  On the information extracted from a glance at a scene. , 1974, Journal of experimental psychology.

[6]  E. Rolls,et al.  The latency of activation of neurones in the lateral hypothalamus and substantia innominata during feeding in the monkey , 1979, Brain Research.

[7]  B. Richmond,et al.  Implantation of magnetic search coils for measurement of eye position: An improved method , 1980, Vision Research.

[8]  R. Desimone,et al.  Inferior Temporal Cortex and Pattern Recognition , 1985 .

[9]  E. Rolls,et al.  Role of low and high spatial frequencies in the face-selective responses of neurons in the cortex in the superior temporal sulcus in the monkey , 1985, Vision Research.

[10]  E. Rolls,et al.  Functional subdivisions of the temporal lobe neocortex , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  E. Rolls,et al.  Gustatory responses of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. , 1990, Journal of neurophysiology.

[12]  Michael C. Mozer,et al.  Perception of multiple objects - a connectionist approach , 1991, Neural network modeling and connectionism.

[13]  E. Rolls,et al.  Allocentric and egocentric spatial information processing in the hippocampal formation of the behaving primate , 1991, Psychobiology.

[14]  R. Desimone Face-Selective Cells in the Temporal Cortex of Monkeys , 1991, Journal of Cognitive Neuroscience.

[15]  E T Rolls,et al.  Neurophysiological mechanisms underlying face processing within and beyond the temporal cortical visual areas. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[16]  E. Miller,et al.  Suppression of visual responses of neurons in inferior temporal cortex of the awake macaque by addition of a second stimulus , 1993, Brain Research.

[17]  M. Tovée,et al.  Information encoding and the responses of single neurons in the primate temporal visual cortex. , 1993, Journal of neurophysiology.

[18]  John Duncan,et al.  A neural basis for visual search in inferior temporal cortex , 1993, Nature.

[19]  M. Tovée,et al.  Translation invariance in the responses to faces of single neurons in the temporal visual cortical areas of the alert macaque. , 1994, Journal of neurophysiology.

[20]  E T Rolls,et al.  Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. , 1995, Journal of neurophysiology.

[21]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[22]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[23]  L. Abbott,et al.  Responses of neurons in primary and inferior temporal visual cortices to natural scenes , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[24]  E. Rolls,et al.  View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex. , 1998, Cerebral cortex.

[25]  Stefano Panzeri,et al.  Firing Rate Distributions and Efficiency of Information Transmission of Inferior Temporal Cortex Neurons to Natural Visual Stimuli , 1999, Neural Computation.

[26]  Leon Lagnado,et al.  The retina , 1999, Current Biology.

[27]  Wolf Singer,et al.  Neuronal Synchrony: A Versatile Code for the Definition of Relations? , 1999, Neuron.

[28]  R. Vogels Categorization of complex visual images by rhesus monkeys. Part 2: single‐cell study , 1999, The European journal of neuroscience.

[29]  G. Orban,et al.  Shape interactions in macaque inferior temporal neurons. , 1999, Journal of neurophysiology.

[30]  L. Chelazzi Serial attention mechanisms in visual search: A critical look at the evidence , 1999, Psychological research.

[31]  M. Gazzaniga,et al.  The new cognitive neurosciences , 2000 .

[32]  L. Chelazzi,et al.  Cortical mechanisms of visuospatial attention in the primate brain. , 2000 .

[33]  R. Vogels,et al.  Spatial sensitivity of macaque inferior temporal neurons , 2000, The Journal of comparative neurology.

[34]  E. Rolls Functions of the Primate Temporal Lobe Cortical Visual Areas in Invariant Visual Object and Face Recognition , 2000, Neuron.

[35]  David L. Sheinberg,et al.  Noticing Familiar Objects in Real World Scenes: The Role of Temporal Cortical Neurons in Natural Vision , 2001, The Journal of Neuroscience.

[36]  Thomas P. Trappenberg,et al.  Effective Size of Receptive Fields of Inferior Temporal Visual Cortex Neurons in Natural Scenes , 2001, NIPS.

[37]  E. Rolls,et al.  Speed of feedforward and recurrent processing in multilayer networks of integrate-and-fire neurons , 2001, Network.

[38]  Stefano Panzeri,et al.  Speed of feedforward and recurrent processing in multilayer networks of integrate-and-fire neurons , 2001 .

[39]  Gustavo Deco,et al.  Computational neuroscience of vision , 2002 .

[40]  J. Maunsell,et al.  Anterior inferotemporal neurons of monkeys engaged in object recognition can be highly sensitive to object retinal position. , 2003, Journal of neurophysiology.

[41]  Edmund T Rolls,et al.  The Receptive Fields of Inferior Temporal Cortex Neurons in Natural Scenes , 2003, The Journal of Neuroscience.

[42]  E. Rolls,et al.  A Neurodynamical cortical model of visual attention and invariant object recognition , 2004, Vision Research.

[43]  A. Cowey,et al.  Topography of the retina and striate cortex and its relationship to visual acuity in rhesus monkeys and squirrel monkeys , 2004, Experimental Brain Research.

[44]  D. Perrett,et al.  Visual neurones responsive to faces in the monkey temporal cortex , 2004, Experimental Brain Research.

[45]  M. Tovée,et al.  The responses of single neurons in the temporal visual cortical areas of the macaque when more than one stimulus is present in the receptive field , 2004, Experimental Brain Research.

[46]  T. Sato,et al.  Interactions of visual stimuli in the receptive fields of inferior temporal neurons in awake macaques , 2004, Experimental Brain Research.

[47]  Takayuki Sato,et al.  Interactions between two different visual stimuli in the receptive fields of inferior temporal neurons in macaques during matching behaviors , 2004, Experimental Brain Research.

[48]  E. Rolls,et al.  Size and contrast have only small effects on the responses to faces of neurons in the cortex of the superior temporal sulcus of the monkey , 2004, Experimental Brain Research.