Network Anisotropy Trumps Noise for Efficient Object Coding in Macaque Inferior Temporal Cortex.

UNLABELLED How neuronal ensembles compute information is actively studied in early visual cortex. Much less is known about how local ensembles function in inferior temporal (IT) cortex, the last stage of the ventral visual pathway that supports visual recognition. Previous reports suggested that nearby neurons carry information mostly independently, supporting efficient processing (Barlow, 1961). However, others postulate that noise covariation effects may depend on network anisotropy/homogeneity and on how the covariation relates to representation. Do slow trial-by-trial noise covariations increase or decrease IT's object coding capability, how does encoding capability relate to correlational structure (i.e., the spatial pattern of signal and noise redundancy/homogeneity across neurons), and does knowledge of correlational structure matter for decoding? We recorded simultaneously from ∼80 spiking neurons in ∼1 mm(3) of macaque IT under light neurolept anesthesia. Noise correlations were stronger for neurons with correlated tuning, and noise covariations reduced object encoding capability, including generalization across object pose and illumination. Knowledge of noise covariations did not lead to better decoding performance. However, knowledge of anisotropy/homogeneity improved encoding and decoding efficiency by reducing the number of neurons needed to reach a given performance level. Such correlated neurons were found mostly in supragranular and infragranular layers, supporting theories that link recurrent circuitry to manifold representation. These results suggest that redundancy benefits manifold learning of complex high-dimensional information and that subsets of neurons may be more immune to noise covariation than others. SIGNIFICANCE STATEMENT How noise affects neuronal population coding is poorly understood. By sampling densely from local populations supporting visual object recognition, we show that recurrent circuitry supports useful representations and that subsets of neurons may be more immune to noise covariation than others.

[1]  P. Sebel,et al.  Evoked potentials following diazepam or fentanyl , 1987, Anaesthesia.

[2]  Keiji Tanaka.  Columns for complex visual object features in the inferotemporal cortex: clustering of cells with similar but slightly different stimulus selectivities. , 2003, Cerebral cortex.

[3]  Tomaso Poggio,et al.  Trade-Off between Object Selectivity and Tolerance in Monkey Inferotemporal Cortex , 2007, The Journal of Neuroscience.

[4]  G. Karmos,et al.  Transient cortical excitation at the onset of visual fixation. , 2008, Cerebral cortex.

[5]  Keiji Tanaka,et al.  Optical Imaging of Functional Organization in the Monkey Inferotemporal Cortex , 1996, Science.

[6]  Go Uchida,et al.  Object Representation in Inferior Temporal Cortex Is Organized Hierarchically in a Mosaic-Like Structure , 2013, The Journal of Neuroscience.

[7]  Wei Ji Ma,et al.  A Fast and Simple Population Code for Orientation in Primate V1 , 2012, The Journal of Neuroscience.

[8]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[9]  Jeremy R. Manning,et al.  Broadband Shifts in Local Field Potential Power Spectra Are Correlated with Single-Neuron Spiking in Humans , 2009, The Journal of Neuroscience.

[10]  Jude F. Mitchell,et al.  Differential Attention-Dependent Response Modulation across Cell Classes in Macaque Visual Area V4 , 2007, Neuron.

[11]  Michael Robert DeWeese,et al.  Sparse Coding Models Can Exhibit Decreasing Sparseness while Learning Sparse Codes for Natural Images , 2013, PLoS Comput. Biol..

[12]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[13]  Randy M. Bruno,et al.  Effects and Mechanisms of Wakefulness on Local Cortical Networks , 2011, Neuron.

[14]  C. Hung,et al.  Real and illusory contour processing in area V1 of the primate: a cortical balancing act. , 2001, Cerebral cortex.

[15]  B. Willmore,et al.  Sparse coding in striate and extrastriate visual cortex. , 2011, Journal of neurophysiology.

[16]  Ding Cui,et al.  Correlated activity supports efficient cortical processing , 2015, Front. Comput. Neurosci..

[17]  Nicole C. Rust,et al.  Selectivity and Tolerance (“Invariance”) Both Increase as Visual Information Propagates from Cortical Area V4 to IT , 2010, The Journal of Neuroscience.

[18]  M. A. Smith,et al.  Spatial and Temporal Scales of Neuronal Correlation in Primary Visual Cortex , 2008, The Journal of Neuroscience.

[19]  Y. Miyashita,et al.  Reversal of Interlaminar Signal Between Sensory and Memory Processing in Monkey Temporal Cortex , 2011, Science.

[20]  N. Logothetis,et al.  fMRI of the Face-Processing Network in the Ventral Temporal Lobe of Awake and Anesthetized Macaques , 2011, Neuron.

[21]  Valentin Dragoi,et al.  Correlated Variability in Laminar Cortical Circuits , 2012, Neuron.

[22]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[23]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[24]  Inés Samengo,et al.  When and Why Noise Correlations Are Important in Neural Decoding , 2013, The Journal of Neuroscience.

[25]  Jian-Young Wu,et al.  Compression and Reflection of Visually Evoked Cortical Waves , 2007, Neuron.

[26]  Arjun K. Bansal,et al.  Neural Dynamics Underlying Target Detection in the Human Brain , 2014, The Journal of Neuroscience.

[27]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  Alexander S. Ecker,et al.  State Dependence of Noise Correlations in Macaque Primary Visual Cortex , 2014, Neuron.

[29]  Nicholas A. Steinmetz,et al.  Diverse coupling of neurons to populations in sensory cortex , 2015, Nature.

[30]  Luca Berdondini,et al.  Sloppiness in Spontaneously Active Neuronal Networks , 2015, The Journal of Neuroscience.

[31]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[32]  Carlo Baldassi,et al.  Shape Similarity, Better than Semantic Membership, Accounts for the Structure of Visual Object Representations in a Population of Monkey Inferotemporal Neurons , 2013, PLoS Comput. Biol..

[33]  K. Harris,et al.  Spontaneous Events Outline the Realm of Possible Sensory Responses in Neocortical Populations , 2009, Neuron.

[34]  Sonja Grün,et al.  Saccade-Related Modulations of Neuronal Excitability Support Synchrony of Visually Elicited Spikes , 2011, Cerebral cortex.

[35]  C. Hung,et al.  Tuning dissimilarity explains short distance decline of spontaneous spike correlation in macaque V1 , 2014, Vision Research.

[36]  H. Tamura,et al.  Organization of local horizontal functional interactions between neurons in the inferior temporal cortex of macaque monkeys. , 2014, Journal of neurophysiology.

[37]  Minami Ito,et al.  Columns for visual features of objects in monkey inferotemporal cortex , 1992, Nature.

[38]  E. Seidemann,et al.  Optimal decoding of correlated neural population responses in the primate visual cortex , 2006, Nature Neuroscience.

[39]  P. Plisnier,et al.  Is deep-water gastropod decline in the ancient lakes Malawi and Tanganyika heralding ecosystem change ? , 2016 .

[40]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[41]  James J. DiCarlo,et al.  How Does the Brain Solve Visual Object Recognition? , 2012, Neuron.

[42]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[43]  Alexander S. Ecker,et al.  Population code in mouse V1 facilitates read-out of natural scenes through increased sparseness , 2014, Nature Neuroscience.

[44]  A. Grinvald,et al.  Linking spontaneous activity of single cortical neurons and the underlying functional architecture. , 1999, Science.

[45]  E. Rolls,et al.  Object perception in natural scenes: encoding by inferior temporal cortex simultaneously recorded neurons. , 2005, Journal of neurophysiology.

[46]  Thomas Serre,et al.  Neuronal Synchrony in Complex-Valued Deep Networks , 2013, ICLR.

[47]  Maoz Shamir,et al.  Emerging principles of population coding: in search for the neural code , 2014, Current Opinion in Neurobiology.

[48]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[49]  Michael Graupner,et al.  Synaptic Input Correlations Leading to Membrane Potential Decorrelation of Spontaneous Activity in Cortex , 2013, The Journal of Neuroscience.

[50]  M. Tanifuji,et al.  Cortical Columnar Organization Is Reconsidered in Inferior Temporal Cortex , 2008, Cerebral cortex.

[51]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[52]  Yasushi Miyashita,et al.  Dynamically Modulated Spike Correlation in Monkey Inferior Temporal Cortex Depending on the Feature Configuration within a Whole Object , 2005, The Journal of Neuroscience.

[53]  H. Sompolinsky,et al.  Population coding in neuronal systems with correlated noise. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[54]  Si Wu,et al.  Population Coding and Decoding in a Neural Field: A Computational Study , 2002, Neural Computation.

[55]  Misha Tsodyks,et al.  Population spikes in cortical networks during different functional states , 2012, Front. Comput. Neurosci..

[56]  Tomaso Poggio,et al.  Fast Readout of Object Identity from Macaque Inferior Temporal Cortex , 2005, Science.

[57]  Tomaso Poggio,et al.  Generalization in vision and motor control , 2004, Nature.

[58]  C. Hung,et al.  Tuning and spontaneous spike time synchrony share a common structure in macaque inferior temporal cortex. , 2014, Journal of neurophysiology.

[59]  Britt Anderson,et al.  Joint decoding of visual stimuli by IT neurons’ spike counts is not improved by simultaneous recording , 2006, Experimental Brain Research.

[60]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[61]  E. Brown,et al.  General anesthesia and altered states of arousal: a systems neuroscience analysis. , 2011, Annual review of neuroscience.

[62]  Doris Y. Tsao,et al.  Functional Compartmentalization and Viewpoint Generalization Within the Macaque Face-Processing System , 2010, Science.

[63]  R. Segev,et al.  Sparse low-order interaction network underlies a highly correlated and learnable neural population code , 2011, Proceedings of the National Academy of Sciences.

[64]  Thomas Serre,et al.  Object decoding with attention in inferior temporal cortex , 2011, Proceedings of the National Academy of Sciences.

[65]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[66]  Bruce G. Cumming,et al.  Decision-Related Activity in Sensory Neurons May Depend on the Columnar Architecture of Cerebral Cortex , 2014, The Journal of Neuroscience.

[67]  Maximilian Riesenhuber,et al.  Time Course of Shape and Category Selectivity Revealed by EEG Rapid Adaptation , 2014, Journal of Cognitive Neuroscience.

[68]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[69]  M. A. Smith,et al.  Stimulus Dependence of Neuronal Correlation in Primary Visual Cortex of the Macaque , 2005, The Journal of Neuroscience.