Average activity, but not variability, is the dominant factor in the representation of object categories in the brain

To categorize the perceived objects, brain utilizes a broad set of its resources and encoding strategies. Yet, it remains elusive how the category information is encoded in the brain. While many classical studies have sought the category information in the across-trial-averaged activity of neurons/neural populations, several recent studies have observed category information also in the within-trial correlated variability of activities between neural populations (i.e. dependent variability). Moreover, other studies have observed that independent variability of activity, which is the variability of the measured neural activity without any influence from correlated variability with other neurons/populations, could also be modulated for improved categorization. However, it was unknown how important each of the three factors (i.e. average activity, dependent and independent variability of activities) was in category encoding. Therefore, we designed an EEG experiment in which human subjects viewed a set of object exemplars from four categories. Using a computational model, we evaluated the contribution of each factor separately in category encoding. Results showed that the average activity played a significant role while the independent variability, although effective, contributed moderately to the category encoding. The inter-channel dependent variability showed an ignorable effect on the encoding. We also investigated the role of those factors in the encoding of variations which showed similar effects. These results imply that the brain, rather than variability, seems to use the average activity to convey information on the category of the perceived objects.

[1]  Alexandre Zénon,et al.  Attention deficits without cortical neuronal deficits , 2012, Nature.

[2]  David J. Freedman,et al.  Preferential Encoding of Visual Categories in Parietal Cortex Compared to Prefrontal Cortex , 2011, Nature Neuroscience.

[3]  Andrew M. Clark,et al.  Stimulus onset quenches neural variability: a widespread cortical phenomenon , 2010, Nature Neuroscience.

[4]  David J. Freedman,et al.  Independent Category and Spatial Encoding in Parietal Cortex , 2013, Neuron.

[5]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[6]  J. S. Guntupalli,et al.  The Representation of Biological Classes in the Human Brain , 2012, The Journal of Neuroscience.

[7]  Nicholas J. Higham,et al.  Blocked Schur Algorithms for Computing the Matrix Square Root , 2012, PARA.

[8]  E. Zohary,et al.  Topographic Representation of the Human Body in the Occipitotemporal Cortex , 2010, Neuron.

[9]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[10]  Gabriele Janzen,et al.  Electrophysiological Correlates of Object Location and Object Identity Processing in Spatial Scenes , 2012, PloS one.

[11]  W. Singer,et al.  Interhemispheric synchronization of oscillatory neuronal responses in cat visual cortex , 1991, Science.

[12]  T. Poggio,et al.  What and where: A Bayesian inference theory of attention , 2010, Vision Research.

[13]  Robert Oostenveld,et al.  Identifying Object Categories from Event-Related EEG: Toward Decoding of Conceptual Representations , 2010, PloS one.

[14]  S. Edelman,et al.  Toward direct visualization of the internal shape representation space by fMRI , 1998, Psychobiology.

[15]  Doris Y. Tsao,et al.  Functional Compartmentalization and Viewpoint Generalization Within the Macaque Face-Processing System , 2010, Science.

[16]  Natasa Kovacevic,et al.  Increased Brain Signal Variability Accompanies Lower Behavioral Variability in Development , 2008, PLoS Comput. Biol..

[17]  Alexander Thiele,et al.  Attention-Induced Variance and Noise Correlation Reduction in Macaque V1 Is Mediated by NMDA Receptors , 2013, Neuron.

[18]  S. Thorpe,et al.  Dynamics of orientation coding in area V1 of the awake primate , 1993, Visual Neuroscience.

[19]  M. Riesenhuber,et al.  Categorization Training Results in Shape- and Category-Selective Human Neural Plasticity , 2007, Neuron.

[20]  J. Maunsell,et al.  Attention improves performance primarily by reducing interneuronal correlations , 2009, Nature Neuroscience.

[21]  Ha Hong,et al.  Explicit information for category-orthogonal object properties increases along the ventral stream , 2016, Nature Neuroscience.

[22]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[23]  Keiji Tanaka,et al.  Object category structure in response patterns of neuronal population in monkey inferior temporal cortex. , 2007, Journal of neurophysiology.

[24]  W. Newsome,et al.  Context-Dependent Changes in Functional Circuitry in Visual Area MT , 2008, Neuron.

[25]  Christian Gerlach,et al.  A Review of Functional Imaging Studies on Category Specificity , 2007, Journal of Cognitive Neuroscience.

[26]  Tim Gollisch,et al.  Rapid Neural Coding in the Retina with Relative Spike Latencies , 2008, Science.

[27]  Arnaud Delorme,et al.  Spike-based strategies for rapid processing , 2001, Neural Networks.

[28]  R Van Rullen,et al.  Face processing using one spike per neurone. , 1998, Bio Systems.

[29]  Thomas A. Carlson,et al.  Representational dynamics of object recognition: Feedforward and feedback information flows , 2016, NeuroImage.

[30]  Jasna Martinovic,et al.  Coding of Visual Object Features and Feature Conjunctions in the Human Brain , 2008, PloS one.

[31]  Mohammad Reza Daliri,et al.  EEG phase patterns reflect the representation of semantic categories of objects , 2015, Medical & Biological Engineering & Computing.

[32]  Erich Schröger,et al.  Filter Effects and Filter Artifacts in the Analysis of Electrophysiological Data , 2012, Front. Psychology.

[33]  R. Eckhorn,et al.  Coherent oscillations: A mechanism of feature linking in the visual cortex? , 1988, Biological Cybernetics.

[34]  K. Grill-Spector,et al.  The functional architecture of the ventral temporal cortex and its role in categorization , 2014, Nature Reviews Neuroscience.

[35]  Nobuhito Saito,et al.  Decoding visual object categories from temporal correlations of ECoG signals , 2014, NeuroImage.

[36]  E. Denman,et al.  The matrix sign function and computations in systems , 1976 .

[37]  B J Richmond,et al.  Stochastic nature of precisely timed spike patterns in visual system neuronal responses. , 1999, Journal of neurophysiology.

[38]  A. Mognon,et al.  ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. , 2011, Psychophysiology.

[39]  Mohammad Reza Daliri,et al.  EEG Signature of Object Categorization from Event-related Potentials , 2013, Journal of medical signals and sensors.

[40]  Majid Nili Ahmadabadi,et al.  Temporal dynamics of visual category representation in the macaque inferior temporal cortex. , 2016, Journal of neurophysiology.

[41]  Brian A. Lopez,et al.  P3a from visual stimuli: task difficulty effects. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[42]  G. Kreiman,et al.  Timing, Timing, Timing: Fast Decoding of Object Information from Intracranial Field Potentials in Human Visual Cortex , 2009, Neuron.

[43]  Joel Z. Leibo,et al.  The dynamics of invariant object recognition in the human visual system. , 2014, Journal of neurophysiology.

[44]  A. Norcia,et al.  A Representational Similarity Analysis of the Dynamics of Object Processing Using Single-Trial EEG Classification , 2015, PloS one.

[45]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[46]  Thomas Serre,et al.  Explaining the Timing of Natural Scene Understanding with a Computational Model of Perceptual Categorization , 2015, PLoS Comput. Biol..

[47]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  Douglas A Ruff,et al.  Attention Increases Spike Count Correlations between Visual Cortical Areas , 2016, The Journal of Neuroscience.

[49]  Bruce G Cumming,et al.  Decision-related activity in sensory neurons: correlations among neurons and with behavior. , 2012, Annual review of neuroscience.

[50]  Nikolaus Kriegeskorte,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[51]  Mohammad Reza Daliri,et al.  Decoding Objects of Basic Categories from Electroencephalographic Signals Using Wavelet Transform and Support Vector Machines , 2014, Brain Topography.

[52]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[53]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[54]  Carrie J. McAdams,et al.  Effects of Attention on the Reliability of Individual Neurons in Monkey Visual Cortex , 1999, Neuron.

[55]  P. Milner A model for visual shape recognition. , 1974, Psychological review.

[56]  T. Poggio,et al.  Neural mechanisms of object recognition , 2002, Current Opinion in Neurobiology.

[57]  Leslie G. Ungerleider,et al.  Distributed representation of objects in the human ventral visual pathway. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[58]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[59]  Keiji Tanaka,et al.  Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey , 2008, Neuron.

[60]  Leslie G. Ungerleider Two cortical visual systems , 1982 .

[61]  Guillaume Thierry,et al.  Face-Sensitive Processes One Hundred Milliseconds after Picture Onset , 2011, Front. Hum. Neurosci..

[62]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.