The formation of multi-synaptic connections by the interaction of synaptic and structural plasticity and their functional consequences

The connectivity between neurons i.e., the number of synapses and their transmission efficacies (weights) determines information processing and storage in neural networks as, for instance, the cortex. Thus, in order to understand the functionality of cortical neural networks, we have to understand how they generate their connectivity. Along this line, there are two major mechanisms to modify connectivity: First, on a timescale of minutes to hours, synaptic plasticity (long-term depression or potentiation) adapts the transmission efficacies (weights) of existing synapses. Second, on a timescale of hours to days, structural plasticity creates and removes synapses. Hereby, the main influence is the volume of the dendritic spine [1] hosting the synapse. This volume is closely linked to the synaptic weight [2], which, in turn, is adapted by synaptic plasticity. All these mechanisms are influenced and determined by the activity pattern of the neural network. Hence, to understand how the connectivity of adult neural networks is adapted or maintained, it is important to understand the interaction of neural activity and the different plasticity mechanisms. In the following we will focus on one property of the cortical connectivity, namely the characteristic, bimodal distributions of the number of synapses connecting two neurons [3-5]. These distributions show high probabilities for two neurons to be either unconnected or connected with multiple (3-8) synapses. To investigate how these distributions can emerge from the interaction between synaptic and structural plasticity, we use a probabilistic model, which captures the process of structural plasticity by abstracting it with weight-dependent probability functions. This allows us to analytically calculate the distribution of the number of synapses between two neurons and show that the bimodal synapse distributions from cortex will arise when using synaptic plasticity rules with synaptic weights growing with the postsynaptic activity. This is generically fulfilled, for instance, by a combination of Hebb-like plasticity and synaptic scaling [7,8]. Given such a combination, we show that a single set of rules and parameters yields the different biologically observed distributions for different cortical layers of synapses at corresponding activities. However, to guarantee stable connectivity, the distributions should not change spuriously whenever the neural activity varies. Albeit using a probabilistic model, this type of long-term stability surprisingly arises naturally due to a hysteresis which safeguards a connection against overly fast changes. As this hysteresis cannot emerge for connections with single synapse, it can be regarded as a feature of multi-synaptic connections, which may add to the stability of information storage in the network.

[1]  T. Bliss,et al.  Long‐lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path , 1973, The Journal of physiology.

[2]  Tarec Fares,et al.  Structural Plasticity of Circuits in Cortical Neuropil , 2008, The Journal of Neuroscience.

[3]  Marc Timme,et al.  Synaptic Scaling in Combination with Many Generic Plasticity Mechanisms Stabilizes Circuit Connectivity , 2011, Front. Comput. Neurosci..

[4]  Mark C. W. van Rossum,et al.  Stable Hebbian Learning from Spike Timing-Dependent Plasticity , 2000, The Journal of Neuroscience.

[5]  William B. Levy Contrasting rules for synaptogenesis, modification of existing synapses, and synaptic removal as a function of neuronal computation , 2004, Neurocomputing.

[6]  Marc Timme,et al.  Analysis of Synaptic Scaling in Combination with Hebbian Plasticity in Several Simple Networks , 2012, Front. Comput. Neurosci..

[7]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[8]  William B. Levy,et al.  The influence of limited presynaptic growth and synapse removal on adaptive synaptogenesis , 2004, Biological Cybernetics.

[9]  S. Grossberg,et al.  ART 2: self-organization of stable category recognition codes for analog input patterns. , 1987, Applied optics.

[10]  H. Markram,et al.  Physiology and anatomy of synaptic connections between thick tufted pyramidal neurones in the developing rat neocortex. , 1997, The Journal of physiology.

[11]  J. Wixted,et al.  On the Form of Forgetting , 1991 .

[12]  D. Rubin,et al.  One Hundred Years of Forgetting : A Quantitative Description of Retention , 1996 .

[13]  G. Edelman,et al.  Spike-timing dynamics of neuronal groups. , 2004, Cerebral cortex.

[14]  Florentin Wörgötter,et al.  Time scales of memory, learning, and plasticity , 2012, Biological Cybernetics.

[15]  S. B. Kater,et al.  Outgrowth-regulating actions of glutamate in isolated hippocampal pyramidal neurons , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  T. Bonhoeffer,et al.  Experience leaves a lasting structural trace in cortical circuits , 2008, Nature.

[17]  Willie F. Tobin,et al.  Rapid formation and selective stabilization of synapses for enduring motor memories , 2009, Nature.

[18]  C. Petersen,et al.  The Excitatory Neuronal Network of the C2 Barrel Column in Mouse Primary Somatosensory Cortex , 2009, Neuron.

[19]  J. Lübke,et al.  Efficacy and connectivity of intracolumnar pairs of layer 2/3 pyramidal cells in the barrel cortex of juvenile rats , 2006, The Journal of physiology.

[20]  T. Bonhoeffer,et al.  Massive restructuring of neuronal circuits during functional reorganization of adult visual cortex , 2008, Nature Neuroscience.

[21]  Miri Goldin,et al.  Functional Plasticity Triggers Formation and Pruning of Dendritic Spines in Cultured Hippocampal Networks , 2001, The Journal of Neuroscience.

[22]  B. Sabatini,et al.  Glutamate induces de novo growth of functional spines in developing cortex , 2011, Nature.

[23]  Markus Butz,et al.  A Simple Rule for Dendritic Spine and Axonal Bouton Formation Can Account for Cortical Reorganization after Focal Retinal Lesions , 2013, PLoS Comput. Biol..

[24]  F. Engert,et al.  Dendritic spine changes associated with hippocampal long-term synaptic plasticity , 1999, Nature.

[25]  Yali Amit,et al.  Capacity analysis in multi-state synaptic models: a retrieval probability perspective , 2011, Journal of Computational Neuroscience.

[26]  S. B. Kater,et al.  Calcium‐Induced Neuronal Degeneration: A Normal Growth Cone Regulating Signal Gone Awry (?) , 1989, Annals of the New York Academy of Sciences.

[27]  H. Kasai,et al.  Principles of Long-Term Dynamics of Dendritic Spines , 2008, The Journal of Neuroscience.

[28]  Paul Miller,et al.  Excitatory, Inhibitory, and Structural Plasticity Produce Correlated Connectivity in Random Networks Trained to Solve Paired-Stimulus Tasks , 2011, Front. Comput. Neurosci..

[29]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[30]  L. Abbott,et al.  Cascade Models of Synaptically Stored Memories , 2005, Neuron.

[31]  L. Squire,et al.  On the course of forgetting in very long-term memory. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[32]  K. Svoboda,et al.  Rapid dendritic morphogenesis in CA1 hippocampal dendrites induced by synaptic activity. , 1999, Science.

[33]  R. Silver,et al.  Synaptic connections between layer 4 spiny neurone‐ layer 2/3 pyramidal cell pairs in juvenile rat barrel cortex: physiology and anatomy of interlaminar signalling within a cortical column , 2002, The Journal of physiology.

[34]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[35]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[36]  A. Stepanyants,et al.  Cooperative synapse formation in the neocortex , 2009, Proceedings of the National Academy of Sciences.

[37]  Nicolas Brunel,et al.  Can Attractor Network Models Account for the Statistics of Firing During Persistent Activity in Prefrontal Cortex? , 2008, Front. Neurosci..

[38]  F. Wörgötter,et al.  Activity-dependent structural plasticity , 2009, Brain Research Reviews.

[39]  Wulfram Gerstner,et al.  Mathematical formulations of Hebbian learning , 2002, Biological Cybernetics.

[40]  H. Markram,et al.  Spontaneous and evoked synaptic rewiring in the neonatal neocortex , 2006, Proceedings of the National Academy of Sciences.

[41]  D. Chklovskii,et al.  Geometry and Structural Plasticity of Synaptic Connectivity , 2002, Neuron.

[42]  Florentin Wörgötter,et al.  A Model for Cortical Rewiring Following Deafferentation and Focal Stroke , 2008, Front. Comput. Neurosci..

[43]  Wulfram Gerstner,et al.  Adaptive exponential integrate-and-fire model as an effective description of neuronal activity. , 2005, Journal of neurophysiology.

[44]  Wulfram Gerstner,et al.  Frontiers in Synaptic Neuroscience Synaptic Neuroscience , 2022 .

[45]  K. Harris,et al.  Laminar Structure of Spontaneous and Sensory-Evoked Population Activity in Auditory Cortex , 2009, Neuron.

[46]  Christos Dimitrakakis,et al.  Network Self-Organization Explains the Statistics and Dynamics of Synaptic Connection Strengths in Cortex , 2013, PLoS Comput. Biol..

[47]  Naren Ramakrishnan,et al.  Memory Switches in Chemical Reaction Space , 2008, PLoS Comput. Biol..

[48]  N. Kasthuri,et al.  Long-term dendritic spine stability in the adult cortex , 2002, Nature.

[49]  L. Brown,et al.  Interval Estimation for a Binomial Proportion , 2001 .

[50]  D. Chklovskii,et al.  Neurogeometry and potential synaptic connectivity , 2005, Trends in Neurosciences.

[51]  Mu-ming Poo,et al.  Shrinkage of Dendritic Spines Associated with Long-Term Depression of Hippocampal Synapses , 2004, Neuron.

[52]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[53]  J. Lübke,et al.  Reliable synaptic connections between pairs of excitatory layer 4 neurones within a single ‘barrel’ of developing rat somatosensory cortex , 1999, The Journal of physiology.

[54]  Wulfram Gerstner,et al.  How Good Are Neuron Models? , 2009, Science.

[55]  B. Sakmann,et al.  Spiking in primary somatosensory cortex during natural whisking in awake head-restrained rats is cell-type specific , 2009, Proceedings of the National Academy of Sciences.

[56]  Klas H. Pettersen,et al.  Laminar population analysis: estimating firing rates and evoked synaptic activity from multielectrode recordings in rat barrel cortex. , 2007, Journal of neurophysiology.

[57]  Bartlett W. Mel,et al.  Cortical rewiring and information storage , 2004, Nature.

[58]  J. Wixted,et al.  Genuine power curves in forgetting: A quantitative analysis of individual subject forgetting functions , 1997, Memory & cognition.

[59]  Ernst Niebur,et al.  A Generalized Linear Integrate-and-Fire Neural Model Produces Diverse Spiking Behaviors , 2009, Neural Computation.

[60]  A. V. Ooyen,et al.  Activity-dependent outgrowth of neurons and overshoot phenomena in developing neural networks , 1994 .

[61]  Masao Ito,et al.  Long-lasting depression of parallel fiber-Purkinje cell transmission induced by conjunctive stimulation of parallel fibers and climbing fibers in the cerebellar cortex , 1982, Neuroscience Letters.

[62]  Thomas K. Berger,et al.  A synaptic organizing principle for cortical neuronal groups , 2011, Proceedings of the National Academy of Sciences.

[63]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[64]  Moritz Helias,et al.  Spike-Timing Dependence of Structural Plasticity Explains Cooperative Synapse Formation in the Neocortex , 2012, PLoS Comput. Biol..

[65]  Lawrence C Katz,et al.  Dendritic stability in the adult olfactory bulb , 2003, Nature Neuroscience.

[66]  K. Fox,et al.  Presynaptic efficacy directs normalization of synaptic strength in layer 2/3 rat neocortex after paired activity. , 2007, Journal of neurophysiology.

[67]  Ewan Cameron,et al.  On the Estimation of Confidence Intervals for Binomial Population Proportions in Astronomy: The Simplicity and Superiority of the Bayesian Approach , 2010, Publications of the Astronomical Society of Australia.

[68]  Karel Svoboda,et al.  Structural Plasticity Underlies Experience-Dependent Functional Plasticity of Cortical Circuits , 2010, The Journal of Neuroscience.

[69]  Wulfram Gerstner,et al.  A benchmark test for a quantitative assessment of simple neuron models , 2008, Journal of Neuroscience Methods.

[70]  Yasushi Miyashita,et al.  Dendritic spine geometry is critical for AMPA receptor expression in hippocampal CA1 pyramidal neurons , 2001, Nature Neuroscience.

[71]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[72]  SM Dudek,et al.  Bidirectional long-term modification of synaptic effectiveness in the adult and immature hippocampus , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[73]  Davide Badoni,et al.  Spike-Driven Synaptic Plasticity: Theory, Simulation, VLSI Implementation , 2000, Neural Computation.

[74]  Jean-Pascal Pfister,et al.  Optimality Model of Unsupervised Spike-Timing-Dependent Plasticity: Synaptic Memory and Weight Distribution , 2007, Neural Computation.

[75]  Joseph K Jun,et al.  Development of Neural Circuitry for Precise Temporal Sequences through Spontaneous Activity, Axon Remodeling, and Synaptic Plasticity , 2007, PloS one.

[76]  W. Wildman,et al.  Theoretical Neuroscience , 2014 .

[77]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[78]  Nils Berglund,et al.  Dynamic Bifurcations: Hysteresis, Scaling Laws and Feedback Control , 1999, chao-dyn/9912008.

[79]  S. B. Kater,et al.  Neurotransmitter regulation of neuronal outgrowth, plasticity and survival in the year 2001 , 1995, Trends in Neurosciences.

[80]  K. Svoboda,et al.  Long-term in vivo imaging of experience-dependent synaptic plasticity in adult cortex , 2002, Nature.

[81]  S. Nelson,et al.  Homeostatic plasticity in the developing nervous system , 2004, Nature Reviews Neuroscience.

[82]  Florentin Wörgötter,et al.  The Formation of Multi-synaptic Connections by the Interaction of Synaptic and Structural Plasticity and Their Functional Consequences , 2014, BMC Neuroscience.

[83]  M. Sheng,et al.  Dentritic spines : structure, dynamics and regulation , 2001, Nature Reviews Neuroscience.

[84]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[85]  Shigeru Shinomoto,et al.  Made-to-Order Spiking Neuron Model Equipped with a Multi-Timescale Adaptive Threshold , 2009, Front. Comput. Neurosci..

[86]  N. Brunel,et al.  Calcium-based plasticity model explains sensitivity of synaptic changes to spike pattern, rate, and dendritic location , 2012, Proceedings of the National Academy of Sciences.

[87]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[88]  G. Ellis‐Davies,et al.  Structural basis of long-term potentiation in single dendritic spines , 2004, Nature.

[89]  W. Gan,et al.  Stably maintained dendritic spines are associated with lifelong memories , 2009, Nature.

[90]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[91]  Robert Miller,et al.  Neural assemblies and laminar interactions in the cerebral cortex , 1996, Biological Cybernetics.

[92]  Shigeru Shinomoto,et al.  Elemental Spiking Neuron Model for Reproducing Diverse Firing Patterns and Predicting Precise Firing Times , 2011, Front. Comput. Neurosci..