Signal Variability Reduction and Prior Expectation Generation through Wiring Plasticity

In the adult mammalian cortex, a small fraction of spines are created and eliminated every day, and the resultant synaptic connection structure is highly non-random, even in local circuits. However, it remains unknown whether a particular synaptic connection structure is functionally advantageous in local circuits, and why creation and elimination of synaptic connections is necessary in addition to rich synaptic weight plasticity. To answer these questions, we studied an inference task model through theoretical and numerical analyses. We show that a connection structure helps synaptic weight learning when it provides prior expectations. We further demonstrate that an adequate network structure naturally emerges from dual Hebbian learning for both synaptic weight plasticity and wiring plasticity. Especially in a sparsely connected network, wiring plasticity achieves reliable computation by enabling efficient information transmission. Correlations between spine dynamics and task performance generated by the proposed rule are consistent with experimental observations.

[1]  G. Ellis‐Davies,et al.  Structural basis of long-term potentiation in single dendritic spines , 2004, Nature.

[2]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[3]  Wolfgang Maass,et al.  Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity , 2013, PLoS Comput. Biol..

[4]  T. Bliss,et al.  A synaptic model of memory: long-term potentiation in the hippocampus , 1993, Nature.

[5]  H. Sompolinsky,et al.  Sparseness and Expansion in Sensory Representations , 2014, Neuron.

[6]  Christian Tetzlaff,et al.  The formation of multi-synaptic connections by the interaction of synaptic and structural plasticity and their functional consequences , 2014, BMC Neuroscience.

[7]  Thomas K. Berger,et al.  A synaptic organizing principle for cortical neuronal groups , 2011, Proceedings of the National Academy of Sciences.

[8]  Sho Yagishita,et al.  Learning rules and persistence of dendritic spines , 2010, The European journal of neuroscience.

[9]  H. Kasai,et al.  Principles of Long-Term Dynamics of Dendritic Spines , 2008, The Journal of Neuroscience.

[10]  Stefan Habenschuss,et al.  Emergence of Optimal Decoding of Population Codes Through STDP , 2013, Neural Computation.

[11]  Mark C. W. van Rossum,et al.  Dendritic Spine Dynamics Regulate the Long-Term Stability of Synaptic Plasticity , 2011, The Journal of Neuroscience.

[12]  W. Gan,et al.  Sleep promotes branch-specific formation of dendritic spines after learning , 2014, Science.

[13]  E Salinas,et al.  Conversion of Sensory Signals into Motor Commands in Primary Motor Cortex , 1998, The Journal of Neuroscience.

[14]  G. Buzsáki,et al.  The log-dynamic brain: how skewed distributions affect network operations , 2014, Nature Reviews Neuroscience.

[15]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[16]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[17]  Bruno A. Olshausen,et al.  Book Review , 2003, Journal of Cognitive Neuroscience.

[18]  Günther Palm,et al.  Memory Capacities for Synaptic and Structural Plasticity G ¨ Unther Palm , 2022 .

[19]  S. Nelson,et al.  Homeostatic plasticity in the developing nervous system , 2004, Nature Reviews Neuroscience.

[20]  K. Svoboda,et al.  Experience-dependent structural synaptic plasticity in the mammalian brain , 2009, Nature Reviews Neuroscience.

[21]  M. Bethge,et al.  Inferring decoding strategies from choice probabilities in the presence of correlated variability , 2013, Nature Neuroscience.

[22]  E. Callaway,et al.  Excitatory cortical neurons form fine-scale functional networks , 2005, Nature.

[23]  D. Chklovskii,et al.  Wiring optimization can relate neuronal structure and function. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Tomoki Fukai,et al.  Associative memory model with long-tail-distributed Hebbian synaptic connections , 2013, Front. Comput. Neurosci..

[25]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[26]  Bartlett W. Mel,et al.  Cortical rewiring and information storage , 2004, Nature.

[27]  D. Chklovskii,et al.  Geometry and Structural Plasticity of Synaptic Connectivity , 2002, Neuron.

[28]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[29]  Yoshikazu Isomura,et al.  Two distinct layer-specific dynamics of cortical ensembles during learning of a motor task , 2014, Nature Neuroscience.

[30]  J. Nadal,et al.  Optimal Information Storage and the Distribution of Synaptic Weights Perceptron versus Purkinje Cell , 2004, Neuron.

[31]  J. Simon Wiegert,et al.  Long-term depression triggers the selective elimination of weakly integrated synapses , 2013, Proceedings of the National Academy of Sciences.

[32]  W. Gan,et al.  Stably maintained dendritic spines are associated with lifelong memories , 2009, Nature.

[33]  Christos Dimitrakakis,et al.  Network Self-Organization Explains the Statistics and Dynamics of Synaptic Connection Strengths in Cortex , 2013, PLoS Comput. Biol..

[34]  Bartlett W. Mel,et al.  Impact of Active Dendrites and Structural Plasticity on the Memory Capacity of Neural Tissue , 2001, Neuron.

[35]  Rafael Yuste,et al.  Activity-dependent dendritic spine neck changes are correlated with synaptic strength , 2014, Proceedings of the National Academy of Sciences.

[36]  H. Sompolinsky,et al.  Compressed sensing, sparsity, and dimensionality in neuronal information processing and data analysis. , 2012, Annual review of neuroscience.

[37]  E. Miller,et al.  A Neural Circuit Model of Flexible Sensorimotor Mapping: Learning and Forgetting on Multiple Timescales , 2007, Neuron.

[38]  Daeyeol Lee,et al.  Role of rodent secondary motor cortex in value-based action selection , 2011, Nature Neuroscience.

[39]  Kaspar Podgorski,et al.  Rapid Hebbian axonal remodeling mediated by visual stimulation , 2014, Science.

[40]  K. Svoboda,et al.  Spine growth precedes synapse formation in the adult neocortex in vivo , 2006, Nature Neuroscience.

[41]  W. Gan,et al.  Development of Long-Term Dendritic Spine Stability in Diverse Regions of Cerebral Cortex , 2005, Neuron.

[42]  Masaharu Ogawa,et al.  BTBD3 Controls Dendrite Orientation Toward Active Axons in Mammalian Neocortex , 2013, Science.

[43]  N. Matsuki,et al.  Interpyramid spike transmission stabilizes the sparseness of recurrent network activity. , 2013, Cerebral cortex.

[44]  D. Feldman Synaptic mechanisms for plasticity in neocortex. , 2009, Annual review of neuroscience.

[45]  S. Denéve,et al.  Neural processing as causal inference , 2011, Current Opinion in Neurobiology.

[46]  C. Petersen,et al.  The Excitatory Neuronal Network of the C2 Barrel Column in Mouse Primary Somatosensory Cortex , 2009, Neuron.

[47]  L. Pinneo On noise in the nervous system. , 1966, Psychological review.

[48]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[49]  P. Caroni,et al.  Structural plasticity upon learning: regulation and functions , 2012, Nature Reviews Neuroscience.

[50]  Willie F. Tobin,et al.  Rapid formation and selective stabilization of synapses for enduring motor memories , 2009, Nature.

[51]  Karl J. Friston,et al.  Information and Efficiency in the Nervous System—A Synthesis , 2013, PLoS Comput. Biol..

[52]  G. Shepherd,et al.  Transient and Persistent Dendritic Spines in the Neocortex In Vivo , 2005, Neuron.