Network Plasticity as Bayesian Inference

General results from statistical learning theory suggest to understand not only brain computations, but also brain plasticity as probabilistic inference. But a model for that has been missing. We propose that inherently stochastic features of synaptic plasticity and spine motility enable cortical networks of neurons to carry out probabilistic inference by sampling from a posterior distribution of network configurations. This model provides a viable alternative to existing models that propose convergence of parameters to maximum likelihood values. It explains how priors on weight distributions and connection probabilities can be merged optimally with learned experience, how cortical networks can generalize learned information so well to novel experiences, and how they can compensate continuously for unforeseen disturbances of the network. The resulting new theory of network plasticity explains from a functional perspective a number of experimental data on stochastic aspects of synaptic plasticity that previously appeared to be quite puzzling.

[1]  Günther Palm,et al.  Artificial Neural Networks and Machine Learning – ICANN 2014 , 2014, Lecture Notes in Computer Science.

[2]  Mark J. Schnitzer,et al.  Impermanence of dendritic spines in live adult CA1 hippocampus , 2015, Nature.

[3]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[4]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[5]  Yee Whye Teh,et al.  Bayesian Learning via Stochastic Gradient Langevin Dynamics , 2011, ICML.

[6]  G. Buzsáki,et al.  The log-dynamic brain: how skewed distributions affect network operations , 2014, Nature Reviews Neuroscience.

[7]  H. Kasai,et al.  Principles of Long-Term Dynamics of Dendritic Spines , 2008, The Journal of Neuroscience.

[8]  E. Marder,et al.  Variability, compensation and homeostasis in neuron and network function , 2006, Nature Reviews Neuroscience.

[9]  P. Pavlidis,et al.  Pair Recordings Reveal All-Silent Synaptic Connections and the Postsynaptic Expression of Long-Term Potentiation , 2001, Neuron.

[10]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[11]  A. Triller,et al.  From the stochasticity of molecular processes to the variability of synaptic transmission , 2011, Nature Reviews Neuroscience.

[12]  Yonatan Loewenstein,et al.  Predicting the Dynamics of Network Connectivity in the Neocortex , 2015, The Journal of Neuroscience.

[13]  Rajesh P. N. Rao,et al.  Bayesian brain : probabilistic approaches to neural coding , 2006 .

[14]  G. Hatfield Perception as Unconscious Inference , 2005 .

[15]  David Kappel,et al.  STDP Installs in Winner-Take-All Circuits an Online Approximation to Hidden Markov Model Learning , 2014, PLoS Comput. Biol..

[16]  Geoffrey E. Hinton,et al.  An Efficient Learning Procedure for Deep Boltzmann Machines , 2012, Neural Computation.

[17]  C. Gilbert,et al.  Rapid Axonal Sprouting and Pruning Accompany Functional Reorganization in Primary Visual Cortex , 2009, Neuron.

[18]  C. Gilbert,et al.  Axons and Synaptic Boutons Are Highly Dynamic in Adult Visual Cortex , 2006, Neuron.

[19]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[20]  H. Markram,et al.  Interneurons of the neocortical inhibitory system , 2004, Nature Reviews Neuroscience.

[21]  Stefan Habenschuss,et al.  Homeostatic plasticity in Bayesian spiking networks as Expectation Maximization with posterior constraints , 2012, NIPS.

[22]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[23]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[24]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[25]  H. Markram,et al.  Differential signaling via the same axon of neocortical pyramidal neurons. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Lacey J. Kitch,et al.  Long-term dynamics of CA1 hippocampal place codes , 2013, Nature Neuroscience.

[27]  E. Marder,et al.  Similar network activity from disparate circuit parameters , 2004, Nature Neuroscience.

[28]  G. Shepherd,et al.  Transient and Persistent Dendritic Spines in the Neocortex In Vivo , 2005, Neuron.

[29]  Wulfram Gerstner,et al.  Predicting spike timing of neocortical pyramidal neurons by simple threshold models , 2006, Journal of Computational Neuroscience.

[30]  E. Bizzi,et al.  Motor Learning with Unstable Neural Representations , 2007, Neuron.

[31]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[32]  Y. Loewenstein,et al.  Multiplicative Dynamics Underlie the Emergence of the Log-Normal Distribution of Spine Sizes in the Neocortex In Vivo , 2011, The Journal of Neuroscience.

[33]  Wulfram Gerstner,et al.  From Stochastic Nonlinear Integrate-and-Fire to Generalized Linear Models , 2011, NIPS.

[34]  K. Martin,et al.  The Cell Biology of Synaptic Plasticity , 2011, Science.

[35]  E. Marder,et al.  Compensation for Variable Intrinsic Neuronal Excitability by Circuit-Synaptic Interactions , 2010, The Journal of Neuroscience.

[36]  Eve Marder,et al.  Precise Temperature Compensation of Phase in a Rhythmic Motor Pattern , 2010, PLoS biology.

[37]  Wolfgang Maass,et al.  Emergence of Dynamic Memory Traces in Cortical Microcircuit Models through STDP , 2013, The Journal of Neuroscience.

[38]  W. Gan,et al.  Development of Long-Term Dendritic Spine Stability in Diverse Regions of Cerebral Cortex , 2005, Neuron.

[39]  W. Gan,et al.  Stably maintained dendritic spines are associated with lifelong memories , 2009, Nature.

[40]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[41]  E. Bizzi,et al.  A theory for how sensorimotor skills are learned and retained in noisy and nonstationary neural circuits , 2013, Proceedings of the National Academy of Sciences.

[42]  T. Bonhoeffer,et al.  Experience leaves a lasting structural trace in cortical circuits , 2008, Nature.

[43]  E. Marder,et al.  Multiple models to capture the variability in biological neurons and networks , 2011, Nature Neuroscience.

[44]  P. Caroni,et al.  Structural plasticity upon learning: regulation and functions , 2012, Nature Reviews Neuroscience.

[45]  S. Swamy,et al.  Neurotransmitters Drive Combinatorial Multistate Postsynaptic Density Networks , 2009, Science Signaling.

[46]  W. Maass,et al.  Efficient temporal processing with biologically realistic dynamic synapses , 2001, Network.

[47]  Christopher D. Harvey,et al.  Choice-specific sequences in parietal cortex during a virtual-navigation decision task , 2012, Nature.

[48]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[49]  Karel Svoboda,et al.  Rapid Redistribution of Synaptic PSD-95 in the Neocortex In Vivo , 2006, PLoS biology.

[50]  Yann LeCun,et al.  Regularization of Neural Networks using DropConnect , 2013, ICML.

[51]  Susan Denham,et al.  Multistability in auditory stream segregation: a predictive coding view , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[52]  A. May Experience-dependent structural plasticity in the adult human brain , 2011, Trends in Cognitive Sciences.

[53]  Stefan Habenschuss,et al.  Emergence of Optimal Decoding of Population Codes Through STDP , 2013, Neural Computation.

[54]  R. Malinow,et al.  Direct measurement of quantal changes underlying long-term potentiation in CA1 hippocampus , 1992, Neuron.

[55]  L. Abbott,et al.  A Quantitative Description of Short-Term Plasticity at Excitatory Synapses in Layer 2/3 of Rat Primary Visual Cortex , 1997, The Journal of Neuroscience.

[56]  W. Senn,et al.  Matching Recall and Storage in Sequence Learning with Spiking Neural Networks , 2013, The Journal of Neuroscience.

[57]  D. Long Probabilistic Models of the Brain. , 2002 .

[58]  K. Svoboda,et al.  Long-term in vivo imaging of experience-dependent synaptic plasticity in adult cortex , 2002, Nature.

[59]  K. Svoboda,et al.  Experience-dependent structural synaptic plasticity in the mammalian brain , 2009, Nature Reviews Neuroscience.

[60]  M. Carandini From circuits to behavior: a bridge too far? , 2012, Nature Neuroscience.

[61]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[62]  Mark R Morgan,et al.  Syndecans Shed Their Reputation as Inert Molecules , 2009, Science Signaling.

[63]  Arjen van Ooyen,et al.  Homeostatic structural plasticity can account for topology changes following deafferentation and focal stroke , 2014, Front. Neuroanat..

[64]  Andreas Knoblauch,et al.  Structural Synaptic Plasticity Has High Memory Capacity and Can Explain Graded Amnesia, Catastrophic Forgetting, and the Spacing Effect , 2014, PloS one.

[65]  Markus Butz,et al.  A Simple Rule for Dendritic Spine and Axonal Bouton Formation Can Account for Cortical Reorganization after Focal Retinal Lesions , 2013, PLoS Comput. Biol..

[66]  E. S. Ruthazer,et al.  Inhibitory Mechanism by Polysialic Acid for Lamina-Specific Branch Formation of Thalamocortical Axons , 2000, The Journal of Neuroscience.

[67]  Karel Svoboda,et al.  Structural Plasticity within the Barrel Cortex during Initial Phases of Whisker-Dependent Learning , 2014, The Journal of Neuroscience.

[68]  F. Engert,et al.  Dendritic spine changes associated with hippocampal long-term synaptic plasticity , 1999, Nature.

[69]  E. Marder Variability, compensation, and modulation in neurons and circuits , 2011, Proceedings of the National Academy of Sciences.

[70]  Nigel Shadbolt,et al.  Competition for Neurotrophic Factors: Mathematical Analysis , 1998, Neural Computation.

[71]  Christian K. Machens,et al.  Predictive Coding of Dynamical Variables in Balanced Spiking Networks , 2013, PLoS Comput. Biol..

[72]  C. Gardiner Handbook of Stochastic Methods , 1983 .

[73]  John Rinzel,et al.  Dynamics of Feature Categorization , 2013, Neural Computation.

[74]  R. Mausfeld,et al.  Perception and the Physical World: Psychological and Philosophical Issues in Perception , 2002 .

[75]  Wolfgang Maass,et al.  Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity , 2013, PLoS Comput. Biol..

[76]  Christian Tetzlaff,et al.  The formation of multi-synaptic connections by the interaction of synaptic and structural plasticity and their functional consequences , 2014, BMC Neuroscience.

[77]  Wolfgang Maass,et al.  E?cient Temporal Processing with Biolog-ically Realistic Dynamic Synapses , 2001 .

[78]  U. Bhalla,et al.  Emergent properties of networks of biological signaling pathways. , 1999, Science.

[79]  N. Shadbolt,et al.  Competition for Neurotrophic Factors: Ocular Dominance Columns , 1998, The Journal of Neuroscience.

[80]  Mark C. W. van Rossum,et al.  Dendritic Spine Dynamics Regulate the Long-Term Stability of Synaptic Plasticity , 2011, The Journal of Neuroscience.

[81]  Moritz Helias,et al.  Spike-Timing Dependence of Structural Plasticity Explains Cooperative Synapse Formation in the Neocortex , 2012, PLoS Comput. Biol..

[82]  J J Hopfield,et al.  What is a moment? Transient synchrony as a collective mechanism for spatiotemporal integration. , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[83]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[84]  Justus H. Piater,et al.  Towards Sparsity and Selectivity: Bayesian Learning of Restricted Boltzmann Machine for Early Visual Features , 2014, ICANN.