The Receptive Fields of Inferior Temporal Cortex Neurons in Natural Scenes

Inferior temporal cortex neurons have generally been found to have large visual receptive fields that typically include the fovea and extend throughout much of the visual field. However, a problem of such a large receptive field is that it does not easily support object selection by subsequent processing areas, in that all objects within such a large receptive field might activate inferior temporal cortex cells. To clarify this, we recorded from inferior temporal cortex neurons while macaques searched for objects in complex natural scenes or in plain backgrounds, as normally used. Inferior temporal cortex neuron receptive fields were much smaller in natural scenes (mean radius, 11°) than in plain backgrounds (39°). With two objects in a scene, one of which was a target for action (a touch), the firing rates were equally high during foveation of the effective stimulus when it was the target and when it was the distractor in both the plain and the complex scenes. With a plain background and two objects present, the receptive fields were much larger (24°) for the stimulus when it was the target than when it was the distractor (9°). This effect of object-based attention was much less evident in the complex scene, when the receptive fields were small both when the stimulus was a distractor and when it was a target. The results show that the temporal visual cortex provides an unambiguous representation in natural scenes by responding to the object shown at or close to the fixation point.

[1]  G. Orban,et al.  Shape interactions in macaque inferior temporal neurons. , 1999, Journal of neurophysiology.

[2]  M. Tovée,et al.  Translation invariance in the responses to faces of single neurons in the temporal visual cortical areas of the alert macaque. , 1994, Journal of neurophysiology.

[3]  M. Posner The Brain and Emotion , 1999, Nature Medicine.

[4]  David L. Sheinberg,et al.  Noticing Familiar Objects in Real World Scenes: The Role of Temporal Cortical Neurons in Natural Vision , 2001, The Journal of Neuroscience.

[5]  Gustavo Deco,et al.  Computational neuroscience of vision , 2002 .

[6]  E. Rolls,et al.  The latency of activation of neurones in the lateral hypothalamus and substantia innominata during feeding in the monkey , 1979, Brain Research.

[7]  E. Rolls,et al.  Size and contrast have only small effects on the responses to faces of neurons in the cortex of the superior temporal sulcus of the monkey , 2004, Experimental Brain Research.

[8]  Stefano Panzeri,et al.  Speed of feedforward and recurrent processing in multilayer networks of integrate-and-fire neurons , 2001 .

[9]  A. J. Mistlin,et al.  Visual neurones responsive to faces , 1987, Trends in Neurosciences.

[10]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[11]  D. B. Bender,et al.  Visual properties of neurons in inferotemporal cortex of the Macaque. , 1972, Journal of neurophysiology.

[12]  E T Rolls,et al.  Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. , 1995, Journal of neurophysiology.

[13]  D. Perrett,et al.  Visual neurones responsive to faces in the monkey temporal cortex , 2004, Experimental Brain Research.

[14]  E. Rolls,et al.  Neural networks and brain function , 1998 .

[15]  R. Desimone,et al.  Inferior Temporal Cortex and Pattern Recognition , 1985 .

[16]  D C Van Essen,et al.  Neural activity in areas V1, V2 and V4 during free viewing of natural scenes compared to controlled viewing. , 1998, Neuroreport.

[17]  E. T. Rolls,et al.  Activity of neurones in the inferotemporal cortex of the alert monkey , 1977, Brain Research.

[18]  J. Maunsell,et al.  Form representation in monkey inferotemporal cortex is virtually unaltered by free viewing , 2000, Nature Neuroscience.

[19]  D H Hubel,et al.  Visual responses in V1 of freely viewing monkeys. , 1996, Cold Spring Harbor symposia on quantitative biology.

[20]  R. Desimone,et al.  Responses of Neurons in Inferior Temporal Cortex during Memory- Guided Visual Search , 1998 .

[21]  R. Meddis Statistics Using Ranks: A Unified Approach , 1984 .

[22]  John Duncan,et al.  A neural basis for visual search in inferior temporal cortex , 1993, Nature.

[23]  E. Rolls Functions of the Primate Temporal Lobe Cortical Visual Areas in Invariant Visual Object and Face Recognition , 2000, Neuron.

[24]  L. Chelazzi,et al.  Cortical mechanisms of visuospatial attention in the primate brain. , 2000 .

[25]  E. Rolls,et al.  Gustatory responses of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. , 1990, Journal of neurophysiology.

[26]  M. Tovée,et al.  Information encoding and the responses of single neurons in the primate temporal visual cortex. , 1993, Journal of neurophysiology.

[27]  E T Rolls,et al.  Neurophysiological mechanisms underlying face processing within and beyond the temporal cortical visual areas. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[28]  E. Rolls A Theory of Emotion, and its Application to Understanding the Neural Basis of Emotion , 1990 .

[29]  Thomas P. Trappenberg,et al.  Effective Size of Receptive Fields of Inferior Temporal Visual Cortex Neurons in Natural Scenes , 2001, NIPS.

[30]  E. Rolls,et al.  View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex. , 1998, Cerebral cortex.

[31]  S. Shott,et al.  Nonparametric Statistics , 2018, The Encyclopedia of Archaeological Sciences.

[32]  W. W. Daniel Applied Nonparametric Statistics , 1979 .

[33]  E. Rolls,et al.  Allocentric and egocentric spatial information processing in the hippocampal formation of the behaving primate , 1991, Psychobiology.

[34]  D C Van Essen,et al.  Neural activity in areas V1, V2 and V4 during free viewing of natural scenes compared to controlled viewing , 1998, Neuroreport.

[35]  L. Chelazzi Serial attention mechanisms in visual search: A critical look at the evidence , 1999, Psychological research.

[36]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[37]  B. Richmond,et al.  Implantation of magnetic search coils for measurement of eye position: An improved method , 1980, Vision Research.

[38]  Dana H. Ballard,et al.  Animate Vision , 1991, Artif. Intell..

[39]  E. Rolls,et al.  Functional subdivisions of the temporal lobe neocortex , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.