Dynamically Modulated Spike Correlation in Monkey Inferior Temporal Cortex Depending on the Feature Configuration within a Whole Object

The mechanism underlying the processing of spatially separated multiple local features to form a unique whole object is an important issue in visual object recognition. We tested whether, in behaving monkeys, the spike correlation between pairs of inferior temporal (IT) neurons dynamically changes depending on the spatial configuration of the local features within a whole object. We prepared more than 60,000 face-like objects (FOs) and their corresponding non-face-like objects (NFOs) that consisted of random arrangements of the same set of local features as those in FOs. The spike correlation between a pair of neurons was quantified by the peak height of the shift predictor-subtracted cross-correlogram. For both neurons of the pair, the local features in a whole object were determined so that they elicited as high a response as possible to enable a reliable cross-correlation analysis. We found that the FOs thus constructed elicited neuronal activities that were more strongly correlated than the corresponding NFOs. Firing rates of the same neurons did not show such a consistent bias depending on the feature configuration. Furthermore, receiver operating characteristic analysis revealed that this FO dominance of spike correlation was robust enough to discriminate between different feature configurations at the population level. Spike correlation of the cell pairs exhibited significant FO dominance within 300 ms after stimulus onset. The present results suggest that feature configuration within a unique whole object can be reflected in the rapid modulation of spike correlation among a population of neurons in the IT cortex.

[1]  E. Rolls,et al.  Selectivity between faces in the responses of a population of neurons in the cortex in the superior temporal sulcus of the monkey , 1985, Brain Research.

[2]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[3]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[4]  Carlos D. Brody,et al.  Correlations Without Synchrony , 1999, Neural Computation.

[5]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[6]  Stephane A. Roy,et al.  Coincidence Detection or Temporal Integration? What the Neurons in Somatosensory Cortex Are Doing , 2001, The Journal of Neuroscience.

[7]  M. Farah,et al.  Parts and Wholes in Face Recognition , 1993, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[8]  A. Thiele,et al.  Neuronal synchrony does not correlate with motion coherence in cortical area MT , 2003, Nature.

[9]  E. Rolls,et al.  Object perception in natural scenes: encoding by inferior temporal cortex simultaneously recorded neurons. , 2005, Journal of neurophysiology.

[10]  P. Goldman-Rakic,et al.  Coding Specificity in Cortical Microcircuits: A Multiple-Electrode Analysis of Primate Prefrontal Cortex , 2001, The Journal of Neuroscience.

[11]  Edmund T. Rolls,et al.  Functions of the Primate Temporal Lobe Cortical Visual Areas in Invariant Visual Object and Face Recognition , 2000, Neuron.

[12]  Y. Yamane,et al.  Complex objects are represented in macaque inferotemporal cortex by the combination of feature columns , 2001, Nature Neuroscience.

[13]  A. Dale,et al.  New images from human visual cortex , 1996, Trends in Neurosciences.

[14]  J J Eggermont,et al.  Neural interaction in cat primary auditory cortex. Dependence on recording depth, electrode separation, and age. , 1992, Journal of neurophysiology.

[15]  C. Gilbert,et al.  Topography of contextual modulations mediated by short-range interactions in primary visual cortex , 1999, Nature.

[16]  M. Abeles.  Local Cortical Circuits: An Electrophysiological Study , 1982 .

[17]  Carrie J. McAdams,et al.  Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4 , 1999, The Journal of Neuroscience.

[18]  G. P. Moore,et al.  Neuronal spike trains and stochastic point processes. II. Simultaneous spike trains. , 1967, Biophysical journal.

[19]  Leslie G. Ungerleider,et al.  Distributed representation of objects in the human ventral visual pathway. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[20]  B. Richmond,et al.  Implantation of magnetic search coils for measurement of eye position: An improved method , 1980, Vision Research.

[21]  Y. Miyashita.  Inferior temporal cortex: where visual perception meets memory. , 1993, Annual review of neuroscience.

[22]  Hunter Nr,et al.  Nuclear boundary detection algorithm based on a minimax derivative statistic for atypical bronchial squamous epithelial cells. , 1981 .

[23]  G. DeAngelis,et al.  Does Neuronal Synchrony Underlie Visual Feature Grouping? , 2005, Neuron.

[24]  T. Allison,et al.  Human extrastriate visual cortex and the perception of faces, words, numbers, and colors. , 1994, Cerebral cortex.

[25]  G. V. Simpson,et al.  Phase Locking of Single Neuron Activity to Theta Oscillations during Working Memory in Monkey Extrastriate Visual Cortex , 2003, Neuron.

[26]  R. Desimone,et al.  Modulation of Oscillatory Neuronal Synchronization by Selective Visual Attention , 2001, Science.

[27]  I. Gauthier,et al.  Visual object understanding , 2004, Nature Reviews Neuroscience.

[28]  K. Hoffmann,et al.  Synchronization of Neuronal Activity during Stimulus Expectation in a Direction Discrimination Task , 1997, The Journal of Neuroscience.

[29]  A. J. Mistlin,et al.  Visual neurones responsive to faces , 1987, Trends in Neurosciences.

[30]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[31]  Leonardo Franco,et al.  The use of decoding to analyze the contribution to the information of the correlations between the firing of simultaneously recorded neurons , 2004, Experimental Brain Research.

[32]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[33]  E. Niebur,et al.  Growth patterns in the developing brain detected by using continuum mechanical tensor maps , 2022 .

[34]  F. Mechler,et al.  Neural coding of spatial phase in V1 of the macaque monkey. , 2003, Journal of neurophysiology.

[35]  B. Julesz,et al.  Context Superiority in a Detection Task with Line-Element Stimuli: A Low-Level Effect , 1990, Perception.

[36]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[37]  Burkhard Maess,et al.  Memory-matches evoke human gamma-responses , 2004, BMC Neuroscience.

[38]  R. Reid,et al.  Precisely correlated firing in cells of the lateral geniculate nucleus , 1996, Nature.

[39]  R. Christopher deCharms,et al.  Primary cortical representation of sounds by the coordination of action-potential timing , 1996, Nature.

[40]  R. Reid,et al.  Synaptic Interactions between Thalamic Inputs to Simple Cells in Cat Visual Cortex , 2000, The Journal of Neuroscience.

[41]  M. A. Smith,et al.  Stimulus Dependence of Neuronal Correlation in Primary Visual Cortex of the Macaque , 2005, The Journal of Neuroscience.

[42]  S. Senn,et al.  Repeated measures in clinical trials: analysis using mean summary statistics and its implications for design. , 1994, Statistics in medicine.

[43]  David L. Sheinberg,et al.  Visual object recognition. , 1996, Annual review of neuroscience.

[44]  J. Bullier,et al.  Structural basis of cortical synchronization. I. Three types of interhemispheric coupling. , 1995, Journal of neurophysiology.

[45]  G. P. Moore,et al.  Neuronal spike trains and stochastic point processes. I. The single spike train. , 1967, Biophysical journal.

[46]  Ichiro Fujita,et al.  Presumed inhibitory neurons in the macaque inferior temporal cortex: visual response properties and functional interactions with adjacent neurons. , 2004, Journal of neurophysiology.

[47]  P. Goldman-Rakic,et al.  A role for inhibition in shaping the temporal flow of information in prefrontal cortex , 2002, Nature Neuroscience.

[48]  D. Homa,et al.  Perceptibility of schematic face stimuli: Evidence for a perceptual Gestalt , 1976, Memory & cognition.

[49]  G A Orban,et al.  Imaging image processing in the human brain , 2001, Current opinion in neurology.

[50]  R. Desimone,et al.  Attention Increases Sensitivity of V4 Neurons , 2000, Neuron.

[51]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[52]  F. Varela,et al.  Perception's shadow: long-distance synchronization of human brain activity , 1999, Nature.

[53]  M. Behrmann,et al.  Impact of learning on representation of parts and wholes in monkey inferotemporal cortex , 2002, Nature Neuroscience.

[54]  D I Perrett,et al.  Organization and functions of cells responsive to faces in the temporal cortex. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[55]  Keiji Tanaka,et al.  Effects of shape-discrimination training on the selectivity of inferotemporal cells in adult monkeys. , 1998, Journal of neurophysiology.

[56]  Y. Miyashita.  Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[57]  Eytan Domany,et al.  Models of Neural Networks I , 1991 .

[58]  W. Bair,et al.  Correlated Firing in Macaque Visual Area MT: Time Scales and Relationship to Behavior , 2001, The Journal of Neuroscience.

[59]  J. Csicsvari,et al.  Reliability and State Dependence of Pyramidal Cell–Interneuron Synapses in the Hippocampus an Ensemble Approach in the Behaving Rat , 1998, Neuron.

[60]  E. K. Miller,et al.  Functional interactions among neurons in inferior temporal cortex of the awake macaque , 2004, Experimental Brain Research.

[61]  R. Desimone.  Face-Selective Cells in the Temporal Cortex of Monkeys , 1991, Journal of Cognitive Neuroscience.

[62]  J. Eggermont,et al.  Cross-correlation and joint spectro-temporal receptive field properties in auditory cortex. , 2005, Journal of neurophysiology.