Recurrent circuit based neural population codes for stimulus representation and inference

A large part of the synaptic input received by cortical neurons comes from local cortico-cortical connectivity. Despite their abundance, the role of local recurrent connections in cortical function is unclear, and in simple coding schemes it is often the case that a circuit with no recurrent connections performs optimally. We consider a recurrent excitatory-inhibitory circuit model of a cortical hypercolumn which performs sampling-based Bayesian inference to infer latent hierarchical stimulus features. We show that local recurrent connections can store an internal model of the correlations between stimulus features that are present in the external world. When the resulting recurrent input is combined with feedforward input it produces a population code from which the posterior over the stimulus features can be linearly read out. Internal Poisson spiking variability provides the proper fluctuations for the population to sample stimulus features, yet the resultant population variability is aligned along the stimulus feature direction, producing differential correlations. Importantly, the amplitude of these internally generated differential correlations is determined by the associative prior in the model stored in the recurrent connections. This provides experimentally testable predictions for how population connectivity and response variability are related to the structure of latent external stimuli.

[1]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[2]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[3]  Haim Sompolinsky,et al.  Nonlinear Population Codes , 2004, Neural Computation.

[4]  J. H. Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998 .

[5]  A. Pouget,et al.  Reading population codes: a neural implementation of ideal observers , 1999, Nature Neuroscience.

[6]  Eero P. Simoncelli,et al.  Partitioning neuronal variability , 2014, Nature Neuroscience.

[7]  A. Yuille,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Vision as Bayesian inference: analysis by synthesis? , 2022 .

[8]  S. Nelson,et al.  An emergent model of orientation selectivity in cat visual cortical simple cells , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Brent Doiron,et al.  Short Term Synaptic Depression Imposes a Frequency Dependent Filter on Synaptic Information Transfer , 2012, PLoS Comput. Biol..

[10]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[11]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[12]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[13]  Rajesh P. N. Rao,et al.  Bayesian brain : probabilistic approaches to neural coding , 2006 .

[14]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[16]  Anthony J. Movshon,et al.  Optimal representation of sensory information by neural populations , 2006, Nature Neuroscience.

[17]  Si Wu,et al.  Population Coding and Decoding in a Neural Field: A Computational Study , 2002, Neural Computation.

[18]  Gustavo Deco,et al.  Stimulus-dependent variability and noise correlations in cortical MT neurons , 2013, Proceedings of the National Academy of Sciences.

[19]  Wolfgang Maass,et al.  Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[20]  W. Wildman,et al.  Theoretical Neuroscience , 2014 .

[21]  G. DeAngelis,et al.  Neural correlates of multisensory cue integration in macaque MSTd , 2008, Nature Neuroscience.

[22]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[23]  Wen-Hao Zhang,et al.  Distributed Sampling-based Bayesian Inference in Coupled Neural Circuits , 2020, bioRxiv.

[24]  A. Pouget,et al.  Correlations and Neuronal Population Information. , 2016, Annual review of neuroscience.

[25]  Aapo Hyvärinen,et al.  Interpreting Neural Response Variability as Monte Carlo Sampling of the Posterior , 2002, NIPS.

[26]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[27]  Amy M. Ni,et al.  Learning and attention reveal a general relationship between population activity and behavior , 2018, Science.

[28]  József Fiser,et al.  Neural Variability and Sampling-Based Probabilistic Representations in the Visual Cortex , 2016, Neuron.

[29]  Konrad Paul Kording,et al.  Causal Inference in Multisensory Perception , 2007, PloS one.

[30]  M. Rasch,et al.  Decentralized Multisensory Information Integration in Neural Systems , 2016, The Journal of Neuroscience.

[31]  M. London,et al.  Sensitivity to perturbations in vivo implies high noise and suggests rate coding in cortex , 2010, Nature.

[32]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[33]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[34]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[35]  K. Harris,et al.  Cortical connectivity and sensory coding , 2013, Nature.

[36]  Si Wu,et al.  Information processing in a neuron ensemble with the multiplicative correlation structure , 2004, Neural Networks.

[37]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[38]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[39]  T. Sejnowski,et al.  Reliability of spike timing in neocortical neurons. , 1995, Science.

[40]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[41]  Allan R. Jones,et al.  A mesoscale connectome of the mouse brain , 2014, Nature.

[42]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[43]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[44]  Yun Wang,et al.  Hierarchical organization of cortical and thalamic connectivity , 2019, Nature.

[45]  Kenneth D. Harris,et al.  Excitatory and inhibitory intracortical circuits for orientation and direction selectivity , 2019, bioRxiv.

[46]  Eric Shea-Brown,et al.  Impact of Network Structure and Cellular Response on Spike Time Correlations , 2011, PLoS Comput. Biol..

[47]  Alexandre Pouget,et al.  Internally generated population activity in cortical networks hinders information transmission , 2020, bioRxiv.

[48]  Alexandre Pouget,et al.  Origin of information-limiting noise correlations , 2015, Proceedings of the National Academy of Sciences.

[49]  Adam N. Sanborn,et al.  Bridging Levels of Analysis for Probabilistic Models of Cognition , 2012 .

[50]  A. Pouget,et al.  Information-limiting correlations , 2014, Nature Neuroscience.

[51]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[52]  J. C. MacKay Information Theory, Inference, and Learning Algorithms—David , 2004 .

[53]  Si Wu,et al.  Dynamics and Computation of Continuous Attractors , 2008, Neural Computation.

[54]  J. Movshon,et al.  The statistical reliability of signals in single neurons in cat and monkey visual cortex , 1983, Vision Research.

[55]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[56]  D. Scott Perceptual learning. , 1974, Queen's nursing journal.

[57]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[58]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[59]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[60]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[61]  József Fiser,et al.  Perceptual Decision-Making as Probabilistic Inference by Neural Sampling , 2014, Neuron.

[62]  D. Fitzpatrick,et al.  Orientation Selectivity and the Arrangement of Horizontal Connections in Tree Shrew Striate Cortex , 1997, The Journal of Neuroscience.

[63]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[64]  Brent Doiron,et al.  The mechanics of state-dependent neural correlations , 2016, Nature Neuroscience.

[65]  Si Wu,et al.  Continuous Attractor Neural Networks: Candidate of a Canonical Model for Neural Information Representation , 2016, F1000Research.

[66]  Guillaume Hennequin,et al.  Cortical-like dynamics in recurrent circuits optimized for sampling-based probabilistic inference , 2020, Nature Neuroscience.

[67]  R C Reid,et al.  Efficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory , 1996, The Journal of Neuroscience.

[68]  Guillaume Hennequin,et al.  Cortical-like dynamics in recurrent circuits optimized for sampling-based probabilistic inference , 2019, Nature Neuroscience.

[69]  A. Litwin-Kumar,et al.  Slow dynamics and high variability in balanced cortical networks with clustered connections , 2012, Nature Neuroscience.

[70]  Byron M. Yu,et al.  Dimensionality reduction for large-scale neural recordings , 2014, Nature Neuroscience.

[71]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[72]  A. Compte,et al.  Bump attractor dynamics in prefrontal cortex explains behavioral precision in spatial working memory , 2014, Nature Neuroscience.

[73]  R. Jacobs,et al.  Optimal integration of texture and motion cues to depth , 1999, Vision Research.

[74]  J. V. van Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[75]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[76]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[77]  David Mumford,et al.  Neuronal Architectures for Pattern-theoretic Problems , 1995 .

[78]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[79]  Guillaume Hennequin,et al.  The Dynamical Regime of Sensory Cortex: Stable Dynamics around a Single Stimulus-Tuned Attractor Account for Patterns of Noise Variability , 2018, Neuron.

[80]  Daniel B. Rubin,et al.  The Stabilized Supralinear Network: A Unifying Circuit Motif Underlying Multi-Input Integration in Sensory Cortex , 2015, Neuron.

[81]  Stefan Rotter,et al.  How Structure Determines Correlations in Neuronal Networks , 2011, PLoS Comput. Biol..