Population Code Dynamics in Categorical Perception

Categorical perception is a ubiquitous function in sensory information processing, and is reported to have important influences on the recognition of presented and/or memorized stimuli. However, such complex interactions among categorical perception and other aspects of sensory processing have not been explained well in a unified manner. Here, we propose a recurrent neural network model to process categorical information of stimuli, which approximately realizes a hierarchical Bayesian estimation on stimuli. The model accounts for a wide variety of neurophysiological and cognitive phenomena in a consistent framework. In particular, the reported complexity of categorical effects, including (i) task-dependent modulation of neural response, (ii) clustering of neural population representation, (iii) temporal evolution of perceptual color memory, and (iv) a non-uniform discrimination threshold, are explained as different aspects of a single model. Moreover, we directly examine key model behaviors in the monkey visual cortex by analyzing neural population dynamics during categorization and discrimination of color stimuli. We find that the categorical task causes temporally-evolving biases in the neuronal population representations toward the focal colors, which supports the proposed model. These results suggest that categorical perception can be achieved by recurrent neural dynamics that approximates optimal probabilistic inference in the changing environment.

[1]  Peter Dayan,et al.  Acetylcholine in cortical inference , 2002, Neural Networks.

[2]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[3]  Albert Compte,et al.  Sensory integration dynamics in a hierarchical network explains choice probabilities in cortical area MT , 2015, Nature Communications.

[4]  D. Gudbjartsson,et al.  Variants in ELL2 influencing immunoglobulin levels associate with multiple myeloma , 2015, Nature Communications.

[5]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[6]  E. Koechlin,et al.  The Architecture of Cognitive Control in the Human Prefrontal Cortex , 2003, Science.

[7]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[8]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[9]  David J. Freedman,et al.  Choice-correlated activity fluctuations underlie learning of neuronal category representation , 2015, Nature Communications.

[10]  Bevil R. Conway,et al.  Specialized Color Modules in Macaque Extrastriate Cortex , 2007, Neuron.

[11]  Alexandra Clifford,et al.  Neurophysiological evidence for categorical perception of color , 2009, Brain and Cognition.

[12]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[13]  N. Sigala,et al.  Dynamic Coding for Cognitive Control in Prefrontal Cortex , 2013, Neuron.

[14]  E. R. Heider Universals in color naming and memory. , 1972, Journal of experimental psychology.

[15]  Angela M. Brown,et al.  Universality of color names , 2006, Proceedings of the National Academy of Sciences.

[16]  S Yamane,et al.  Color selectivity of neurons in the inferior temporal cortex of the awake macaque monkey , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  J. Rauschecker,et al.  Cortical Representation of Natural Complex Sounds: Effects of Acoustic Features and Auditory Object Category , 2010, The Journal of Neuroscience.

[18]  A. Treves,et al.  Converging Neuronal Activity in Inferior Temporal Cortex during the Classification of Morphed Stimuli , 2008, Cerebral cortex.

[19]  S. Jbabdi,et al.  How can a Bayesian approach inform neuroscience? , 2012, The European journal of neuroscience.

[20]  Jean-François Démonet,et al.  Category-specific cortical mapping: color-naming areas. , 2006, Journal of neurosurgery.

[21]  Kazuyuki Aihara,et al.  Representational Switching by Dynamical Reorganization of Attractor Structure in a Network Model of the Prefrontal Cortex , 2011, PLoS Comput. Biol..

[22]  Christopher R Fetsch,et al.  Neural correlates of reliability-based cue weighting during multisensory integration , 2011, Nature Neuroscience.

[23]  S. Grossberg,et al.  Neural network models of categorical perception , 2000, Perception & psychophysics.

[24]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[25]  S. Yamane,et al.  Population dynamics of face-responsive neurons in the inferior temporal cortex. , 2005, Cerebral cortex.

[26]  H. Komatsu,et al.  Effects of task demands on the responses of color-selective neurons in the inferior temporal cortex , 2007, Nature Neuroscience.

[27]  Scott R Sponheim,et al.  Prefrontal neurons transmit signals to parietal neurons that reflect executive control of cognition , 2013, Nature Neuroscience.

[28]  S. Zeki,et al.  Colour coding in rhesus monkey prestriate cortex. , 1973, Brain research.

[29]  Joshua I. Sanders,et al.  Cortical interneurons that specialize in disinhibitory control , 2013, Nature.

[30]  Karl R Gegenfurtner,et al.  Categorical sensitivity to color differences. , 2013, Journal of vision.

[31]  M. Dolores de Fez,et al.  Color memory matching: time effect and other factors , 1998 .

[32]  Harvey S. Smallman,et al.  Category effects in color memory , 1989 .

[33]  Guillaume A. Rousselet,et al.  Rapid visual categorization of natural scene contexts with equalized amplitude spectrum and increasing phase noise. , 2009, Journal of vision.

[34]  D. Perrett,et al.  Time course of neural responses discriminating different views of the face and head. , 1992, Journal of neurophysiology.

[35]  David J. Freedman,et al.  Biased Associative Representations in Parietal Cortex , 2013, Neuron.

[36]  Peter Földiák,et al.  Learning Invariance from Transformation Sequences , 1991, Neural Comput..

[37]  D. Perrett,et al.  Facial expression megamix: Tests of dimensional and category accounts of emotion recognition , 1997, Cognition.

[38]  R. A. Schmiedt,et al.  Age-related loss of activity of auditory-nerve fibers. , 1996, Journal of neurophysiology.

[39]  David J. Freedman,et al.  Experience-dependent representation of visual categories in parietal cortex , 2006, Nature.

[40]  F. Pulvermüller,et al.  Category-specific conceptual processing of color and form in left fronto-temporal cortex. , 2006, Cerebral cortex.

[41]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[42]  S. Thorpe,et al.  Rapid categorization of natural images by rhesus monkeys , 1998, Neuroreport.

[43]  Gouki Okazawa,et al.  Effects of Luminance Contrast on the Color Selectivity of Neurons in the Macaque Area V4 and Inferior Temporal Cortex , 2014, The Journal of Neuroscience.

[44]  K. Gegenfurtner,et al.  Is there a lateralized category effect for color? , 2011, Journal of vision.

[45]  David J. Freedman,et al.  Generalized associative representations in parietal cortex , 2011, Nature Neuroscience.

[46]  T. Sanger,et al.  Probability density estimation for the interpretation of neural population codes. , 1996, Journal of neurophysiology.

[47]  J. Movshon,et al.  A new perceptual illusion reveals mechanisms of sensory decoding , 2007, Nature.

[48]  K. Uchikawa,et al.  Influence of basic color categories on color memory discrimination. , 1996 .

[49]  David J. Freedman,et al.  Independent Category and Spatial Encoding in Parietal Cortex , 2013, Neuron.

[50]  David J. Freedman,et al.  Preferential Encoding of Visual Categories in Parietal Cortex Compared to Prefrontal Cortex , 2011, Nature Neuroscience.

[51]  Noël Staeren,et al.  Sound Categories Are Represented as Distributed Patterns in the Human Auditory Cortex , 2009, Current Biology.

[52]  Bevil R. Conway,et al.  Cerebral Cortex Advance Access published December 28, 2005 Color Architecture in Alert Macaque Cortex , 2022 .

[53]  Alexandra Clifford,et al.  Categorical effects in children's colour search : A cross-linguistic comparison , 2006 .

[54]  Michael C. Frank,et al.  Russian blues reveal effects of language on color discrimination , 2007, Proceedings of the National Academy of Sciences.

[55]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[56]  G. Davies,et al.  Knowns and Unknowns , 2003 .

[57]  M. Paradiso,et al.  A theory for the use of visual orientation information which exploits the columnar structure of striate cortex , 2004, Biological Cybernetics.

[58]  Jonathan Winawer,et al.  Effects of language on color discriminability , 2010 .

[59]  Masaaki Kawahashi,et al.  Renovation of Journal of Visualization , 2010, J. Vis..

[60]  T. Sejnowski,et al.  Representation of Color Stimuli in Awake Macaque Primary Visual Cortex , 2003, Neuron.

[61]  W. Freeman,et al.  Change in pattern of ongoing cortical activity with auditory category learning , 2001, Nature.

[62]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[63]  A. Pouget,et al.  Marginalization in Neural Circuits with Divisive Normalization , 2011, The Journal of Neuroscience.

[64]  A. Mizuno,et al.  A change of the leading player in flow Visualization technique , 2006, J. Vis..

[65]  S. Zeki,et al.  Three cortical stages of colour processing in the human brain. , 1998, Brain : a journal of neurology.

[66]  James L. McClelland,et al.  The TRACE model of speech perception , 1986, Cognitive Psychology.

[67]  D. Heeger,et al.  Categorical Clustering of the Neural Representation of Color , 2013, The Journal of Neuroscience.

[68]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[69]  N. Sigala,et al.  Visual categorization shapes feature selectivity in the primate temporal cortex , 2002, Nature.

[70]  B. Cumming,et al.  Decision-related activity in sensory neurons reflects more than a neuron’s causal effect , 2009, Nature.

[71]  Anthony J. Movshon,et al.  Optimal representation of sensory information by neural populations , 2006, Nature Neuroscience.

[72]  K. Gegenfurtner,et al.  Cortical mechanisms of colour vision , 2003, Nature Reviews Neuroscience.