Emergence of Optimal Decoding of Population Codes Through STDP

The brain faces the problem of inferring reliable hidden causes from large populations of noisy neurons, for example, the direction of a moving object from spikes in area MT. It is known that a theoretically optimal likelihood decoding could be carried out by simple linear readout neurons if weights of synaptic connections were set to certain values that depend on the tuning functions of sensory neurons. We show here that such theoretically optimal readout weights emerge autonomously through STDP in conjunction with lateral inhibition between readout neurons. In particular, we identify a class of optimal STDP learning rules with homeostatic plasticity, for which the autonomous emergence of optimal readouts can be explained on the basis of a rigorous learning theory. This theory shows that the network motif we consider approximates expectation-maximization for creating internal generative models for hidden causes of high-dimensional spike inputs. Notably, we find that this optimal functionality can be well approximated by a variety of STDP rules beyond those predicted by theory. Furthermore, we show that this learning process is very stable and automatically adjusts weights to changes in the number of readout neurons, the tuning functions of sensory neurons, and the statistics of external stimuli.

[1]  André van Schaik,et al.  Racing to learn: statistical inference and learning in a single spiking neuron with adaptive kernels , 2014, Front. Neurosci..

[2]  Wolfgang Maass,et al.  Noise as a Resource for Computation and Learning in Networks of Spiking Neurons , 2014, Proceedings of the IEEE.

[3]  Jörg Lücke,et al.  Feedforward Inhibition and Synaptic Scaling – Two Sides of the Same Coin? , 2012, PLoS Comput. Biol..

[4]  P. Glimcher,et al.  Reward Value-Based Gain Control: Divisive Normalization in Parietal Cortex , 2011, The Journal of Neuroscience.

[5]  A. Pouget,et al.  Perceptual learning as improved probabilistic inference in early sensory areas , 2011, Nature Neuroscience.

[6]  Kris S Chaisanguanthum,et al.  A Neurally Efficient Implementation of Sensory Population Decoding , 2011, The Journal of Neuroscience.

[7]  G. DeAngelis,et al.  A Normalization Model of Multisensory Integration , 2011, Nature Neuroscience.

[8]  R. Yuste,et al.  Dense Inhibitory Connectivity in Neocortex , 2011, Neuron.

[9]  Arnulf B. A. Graf,et al.  Decoding the activity of neuronal populations in macaque primary visual cortex , 2011, Nature Neuroscience.

[10]  Matthieu Gilson,et al.  Frontiers in Computational Neuroscience Computational Neuroscience , 2022 .

[11]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[12]  D. Gregory.  A normalization model of multi-sensory integration , 2010 .

[13]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[14]  Wolfgang Maass,et al.  STDP enables spiking neurons to detect hidden causes of their inputs , 2009, NIPS.

[15]  Kikuro Fukushima,et al.  Relating Neuronal Firing Patterns to Functional Differentiation of Cerebral Cortex , 2009, PLoS Comput. Biol..

[16]  C. Gilbert,et al.  Perceptual learning and adult cortical plasticity , 2009, The Journal of physiology.

[17]  Xin Huang,et al.  Noise correlations in cortical area MT and their potential impact on trial-by-trial variation in the direction and speed of smooth-pursuit eye movements. , 2009, Journal of neurophysiology.

[18]  Lee M. Miller,et al.  Populations of auditory cortical neurons can accurately encode acoustic space across stimulus intensity , 2009, Proceedings of the National Academy of Sciences.

[19]  C. Law,et al.  Reinforcement learning can account for associative and perceptual learning on a visual decision task , 2009, Nature Neuroscience.

[20]  Aaron R. Seitz,et al.  Rewards Evoke Learning of Unconsciously Processed Visual Stimuli in Adult Humans , 2009, Neuron.

[21]  M. A. Smith,et al.  Spatial and Temporal Scales of Neuronal Correlation in Primary Visual Cortex , 2008, The Journal of Neuroscience.

[22]  G. Turrigiano.  The Self-Tuning Neuron: Synaptic Scaling of Excitatory Synapses , 2008, Cell.

[23]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[24]  Sophie Denève,et al.  Bayesian Spiking Neurons II: Learning , 2008, Neural Computation.

[25]  Eric Moulines,et al.  On‐line expectation–maximization algorithm for latent data models , 2007, ArXiv.

[26]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[27]  Anubhuthi Goel,et al.  Persistence of Experience-Induced Homeostatic Synaptic Plasticity through Adulthood in Superficial Layers of Mouse Visual Cortex , 2007, The Journal of Neuroscience.

[28]  D. Feldman,et al.  Spike Timing-Dependent Synaptic Depression in the In Vivo Barrel Cortex of the Rat , 2007, The Journal of Neuroscience.

[29]  Patrick R Hof,et al.  Life and death of neurons in the aging cerebral cortex. , 2007, International review of neurobiology.

[30]  Rajesh P. N. Rao,et al.  Bayesian brain : probabilistic approaches to neural coding , 2006 .

[31]  J. Tenenbaum,et al.  Optimal Predictions in Everyday Cognition , 2006, Psychological science.

[32]  Y. Dan,et al.  Spike timing-dependent plasticity: from synapse to perception. , 2006, Physiological reviews.

[33]  Anthony J. Movshon,et al.  Optimal representation of sensory information by neural populations , 2006, Nature Neuroscience.

[34]  Wulfram Gerstner,et al.  Predicting spike timing of neocortical pyramidal neurons by simple threshold models , 2006, Journal of Computational Neuroscience.

[35]  E. Miller,et al.  Experience-dependent sharpening of visual shape selectivity in inferior temporal cortex. , 2005, Cerebral cortex.

[36]  James J DiCarlo,et al.  Multiple Object Response Normalization in Monkey Inferotemporal Cortex , 2005, The Journal of Neuroscience.

[37]  Aaron R. Seitz,et al.  A unified model for perceptual learning , 2005, Trends in Cognitive Sciences.

[38]  Stephen D. Van Hooser,et al.  Orientation Selectivity without Orientation Maps in Visual Cortex of a Highly Visual Mammal , 2005, The Journal of Neuroscience.

[39]  Nicholas J. Priebe,et al.  The contribution of spike threshold to the dichotomy of cortical simple and complex cells , 2004, Nature Neuroscience.

[40]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[41]  K. Svoboda,et al.  Long-term in vivo imaging of experience-dependent synaptic plasticity in adult cortex , 2002, Nature.

[42]  M. Diamond,et al.  Population coding in somatosensory cortex , 2002, Current Opinion in Neurobiology.

[43]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[44]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[45]  P. Pavlidis,et al.  Pair Recordings Reveal All-Silent Synaptic Connections and the Postsynaptic Expression of Long-Term Potentiation , 2001, Neuron.

[46]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[47]  R. Zemel,et al.  Information processing with population codes , 2000, Nature Reviews Neuroscience.

[48]  M. Carandini,et al.  Membrane Potential and Firing Rate in Cat Primary Visual Cortex , 2000, The Journal of Neuroscience.

[49]  A. Pouget,et al.  Reading population codes: a neural implementation of ideal observers , 1999, Nature Neuroscience.

[50]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[51]  Masa-aki Sato.  Fast Learning of On-line EM Algorithm , 1999 .

[52]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[53]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[54]  D. Buonomano,et al.  Cortical plasticity: from synapses to maps. , 1998, Annual review of neuroscience.

[55]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[56]  R. Malinow,et al.  Direct measurement of quantal changes underlying long-term potentiation in CA1 hippocampus , 1992, Neuron.

[57]  D. Hubel,et al.  Shape and arrangement of columns in cat's striate cortex , 1963, The Journal of physiology.