Object perception in natural scenes: encoding by inferior temporal cortex simultaneously recorded neurons.

The firing of inferior temporal cortex neurons is tuned to objects and faces, and in a complex scene, their receptive fields are reduced to become similar to the size of an object being fixated. These two properties may underlie how objects in scenes are encoded. An alternative hypothesis suggests that visual perception requires the binding of features of the visual target through spike synchrony in a neuronal assembly. To examine possible contributions of firing synchrony of inferior temporal neurons, we made simultaneous recordings of the activity of several neurons while macaques performed a visual discrimination task. The stimuli were presented in either plain or complex backgrounds. The encoding of information of neurons was analyzed using a decoding algorithm. Ninety-four percent to 99% of the total information was available in the firing rate spike counts, and the contribution of spike timing calculated as stimulus-dependent synchronization (SDS) added only 1-6% of information to the total that was independent of the spike counts in the complex background. Similar results were obtained in the plain background. The quantitatively small contribution of spike timing to the overall information available in spike patterns suggests that information encoding about which stimulus was shown by inferior temporal neurons is achieved mainly by rate coding. Furthermore, it was shown that there was little redundancy (6%) between the information provided by the spike counts of the simultaneously recorded neurons, making spike counts an efficient population code with a high encoding capacity.

[1]  D. B. Bender,et al.  Visual properties of neurons in inferotemporal cortex of the Macaque. , 1972, Journal of neurophysiology.

[2]  E. T. Rolls,et al.  Activity of neurones in the inferotemporal cortex of the alert monkey , 1977, Brain Research.

[3]  E. Rolls,et al.  The latency of activation of neurones in the lateral hypothalamus and substantia innominata during feeding in the monkey , 1979, Brain Research.

[4]  B. Richmond,et al.  Implantation of magnetic search coils for measurement of eye position: An improved method , 1980, Vision Research.

[5]  R. Desimone,et al.  Stimulus-selective properties of inferior temporal neurons in the macaque , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  E. Rolls,et al.  Functional subdivisions of the temporal lobe neocortex , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  E. Rolls,et al.  Allocentric and egocentric spatial information processing in the hippocampal formation of the behaving primate , 1991, Psychobiology.

[8]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[9]  D I Perrett,et al.  Organization and functions of cells responsive to faces in the temporal cortex. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[10]  James L. McGaugh,et al.  Brain Organization and Memory: Cells, Systems, and Circuits , 1992 .

[11]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  E T Rolls,et al.  Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. , 1995, Journal of neurophysiology.

[13]  M. Tovée,et al.  Information encoding in short firing rate epochs by single neurons in the primate temporal visual cortex , 1995 .

[14]  Stefano Panzeri,et al.  The Upward Bias in Measures of Information Derived from Limited Data Samples , 1995, Neural Computation.

[15]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[16]  M. Tovée,et al.  Representational capacity of face coding in monkeys. , 1996, Cerebral cortex.

[17]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[18]  H. W. Veen,et al.  Handbook of Biological Physics , 1996 .

[19]  Stefano Panzeri,et al.  Analytical estimates of limited sampling biases in different information measures. , 1996, Network.

[20]  A. Treves,et al.  The representational capacity of the distributed encoding of information provided by populations of neurons in primate temporal visual cortex , 1997, Experimental Brain Research.

[21]  L. Paninski,et al.  Information about movement direction obtained from synchronous activity of motor cortical neurons. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[22]  D. Perrett,et al.  The `Ideal Homunculus': decoding neural population signals , 1998, Trends in Neurosciences.

[23]  E. Rolls,et al.  View-invariant representations of familiar objects by neurons in the inferior temporal visual cortex. , 1998, Cerebral cortex.

[24]  Y. Dan,et al.  Coding of visual information by precisely correlated spikes in the lateral geniculate nucleus , 1998, Nature Neuroscience.

[25]  Wolf Singer,et al.  Neuronal Synchrony: A Versatile Code for the Definition of Relations? , 1999, Neuron.

[26]  E T Rolls,et al.  Correlations and the encoding of information in the nervous system , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[27]  G. Orban,et al.  Shape interactions in macaque inferior temporal neurons. , 1999, Journal of neurophysiology.

[28]  Michael N. Shadlen,et al.  Synchrony Unbound A Critical Evaluation of the Temporal Binding Hypothesis , 1999, Neuron.

[29]  R. Vogels,et al.  Effect of image scrambling on inferior temporal cortical responses. , 1999, Neuroreport.

[30]  M. Gazzaniga,et al.  The new cognitive neurosciences , 2000 .

[31]  J. Maunsell,et al.  Form representation in monkey inferotemporal cortex is virtually unaltered by free viewing , 2000, Nature Neuroscience.

[32]  Alessandro Treves,et al.  Chapter 19 Information coding in higher sensory and memory areas , 2000 .

[33]  E. Rolls Functions of the Primate Temporal Lobe Cortical Visual Areas in Invariant Visual Object and Face Recognition , 2000, Neuron.

[34]  F. Mechler,et al.  Independent and Redundant Information in Nearby Cortical Neurons , 2001, Science.

[35]  B J Richmond,et al.  Excess synchrony in motor cortical neurons provides redundant direction information with that from coarse temporal measures. , 2001, Journal of neurophysiology.

[36]  H. Tamura,et al.  Visual response properties of cells in the ventral and dorsal parts of the macaque inferotemporal cortex. , 2001, Cerebral cortex.

[37]  David L. Sheinberg,et al.  Noticing Familiar Objects in Real World Scenes: The Role of Temporal Cortical Neurons in Natural Vision , 2001, The Journal of Neuroscience.

[38]  Gustavo Deco,et al.  Computational neuroscience of vision , 2002 .

[39]  Steven Reece,et al.  An information theoretic approach to the contributions of the firing rates and the correlations between the firing of neurons. , 2003, Journal of neurophysiology.

[40]  Leonardo Franco,et al.  The use of decoding to analyze the contribution to the information of the correlations between the firing of simultaneously recorded neurons , 2004, Experimental Brain Research.

[41]  Edmund T. Rolls,et al.  Information encoding in the inferior temporal visual cortex: contributions of the firing rates and the correlations between the firing of neurons , 2010, Biological Cybernetics.

[42]  Rodrigo F. Salazar,et al.  Responses to natural scenes in cat V1. , 2003, Journal of neurophysiology.

[43]  Derek K. Jones,et al.  Responses to Natural Scenes in Cat V 1 , 2003 .

[44]  Edmund T Rolls,et al.  The Receptive Fields of Inferior Temporal Cortex Neurons in Natural Scenes , 2003, The Journal of Neuroscience.

[45]  D. Perrett,et al.  Visual neurones responsive to faces in the monkey temporal cortex , 2004, Experimental Brain Research.

[46]  M. Tovée,et al.  The responses of neurons in the temporal cortex of primates, and face identification and detection , 1994, Experimental Brain Research.

[47]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .