Emergence of Stable Synaptic Clusters on Dendrites Through Synaptic Rewiring

The connectivity structure of neuronal networks in cortex is highly dynamic. This ongoing cortical rewiring is assumed to serve important functions for learning and memory. We analyze in this article a model for the self-organization of synaptic inputs onto dendritic branches of pyramidal cells. The model combines a generic stochastic rewiring principle with a simple synaptic plasticity rule that depends on local dendritic activity. In computer simulations, we find that this synaptic rewiring model leads to synaptic clustering, that is, temporally correlated inputs become locally clustered on dendritic branches. This empirical finding is backed up by a theoretical analysis which shows that rewiring in our model favors network configurations with synaptic clustering. We propose that synaptic clustering plays an important role in the organization of computation and memory in cortical circuits: we find that synaptic clustering through the proposed rewiring mechanism can serve as a mechanism to protect memories from subsequent modifications on a medium time scale. Rewiring of synaptic connections onto specific dendritic branches may thus counteract the general problem of catastrophic forgetting in neural networks.

[1]  Bartlett W. Mel,et al.  Cortical rewiring and information storage , 2004, Nature.

[2]  Jochen Triesch,et al.  Plasticity-Driven Self-Organization under Topological Constraints Accounts for Non-random Features of Cortical Synaptic Wiring , 2015, bioRxiv.

[3]  F. Helmchen,et al.  Dendritic NMDA spikes are necessary for timing-dependent associative LTP in CA3 pyramidal cells , 2016, Nature Communications.

[4]  Claudia Clopath,et al.  Modeling somatic and dendritic spike mediated plasticity at the single neuron and network level , 2017, Nature Communications.

[5]  Alcino J. Silva,et al.  A shared neural ensemble links distinct contextual memories encoded close in time , 2016, Nature.

[6]  N. Spruston,et al.  Postsynaptic depolarization requirements for LTP and LTD: a critique of spike timing-dependent plasticity , 2005, Nature Neuroscience.

[7]  Moritz Helias,et al.  Spike-Timing Dependence of Structural Plasticity Explains Cooperative Synapse Formation in the Neocortex , 2012, PLoS Comput. Biol..

[8]  Jochen Triesch,et al.  Robust development of synfire chains from multiple plasticity mechanisms , 2014, Front. Comput. Neurosci..

[9]  J. Magee,et al.  Integrative Properties of Radial Oblique Dendrites in Hippocampal CA1 Pyramidal Neurons , 2006, Neuron.

[10]  Anna R. Chambers,et al.  A stable brain from unstable components: Emerging concepts and implications for neural computation , 2017, Neuroscience.

[11]  Claudia Clopath,et al.  Modelling plasticity in dendrites: from single cells to networks , 2017, Current Opinion in Neurobiology.

[12]  Wolfgang Maass,et al.  Branch-Specific Plasticity Enables Self-Organization of Nonlinear Computation in Single Neurons , 2011, The Journal of Neuroscience.

[13]  Nace L. Golding,et al.  Dendritic spikes as a mechanism for cooperative long-term potentiation , 2002, Nature.

[14]  H. Kasai,et al.  Principles of Long-Term Dynamics of Dendritic Spines , 2008, The Journal of Neuroscience.

[15]  Panayiota Poirazi,et al.  Linking Memories across Time via Neuronal and Dendritic Overlaps in Model Neurons with Active Dendrites , 2016, Cell reports.

[16]  Jun Noguchi,et al.  Structural dynamics of dendritic spines in memory and cognition , 2010, Trends in Neurosciences.

[17]  S. Tonegawa,et al.  A clustered plasticity model of long-term memory engrams , 2006, Nature Reviews Neuroscience.

[18]  Andreas Knoblauch,et al.  Structural Synaptic Plasticity Has High Memory Capacity and Can Explain Graded Amnesia, Catastrophic Forgetting, and the Spacing Effect , 2014, PloS one.

[19]  William M. DeBello,et al.  Micro-rewiring as a substrate for learning , 2008, Trends in Neurosciences.

[20]  Bartlett W. Mel,et al.  Capacity-Enhancing Synaptic Learning Rules in a Medial Temporal Lobe Online Learning Model , 2009, Neuron.

[21]  E. Eidelberg,et al.  Dendritic Mechanisms , 1961 .

[22]  Dheeraj S. Roy,et al.  Memory engram storage and retrieval , 2015, Current Opinion in Neurobiology.

[23]  N. Ziv,et al.  Long-Term Relationships between Synaptic Tenacity, Synaptic Remodeling, and Network Activity , 2009, PLoS biology.

[24]  Bartlett W. Mel The Clusteron: Toward a Simple Abstraction for a Complex Neuron , 1991, NIPS.

[25]  Nathalie L Rochefort,et al.  Dendritic organization of sensory input to cortical neurons in vivo , 2010, Nature.

[26]  Tobias Bonhoeffer,et al.  Activity-Dependent Clustering of Functional Synaptic Inputs on Developing Hippocampal Dendrites , 2011, Neuron.

[27]  Florentin Wörgötter,et al.  The Formation of Multi-synaptic Connections by the Interaction of Synaptic and Structural Plasticity and Their Functional Consequences , 2014, BMC Neuroscience.

[28]  A. Holtmaat,et al.  Sensory-evoked LTP driven by dendritic plateau potentials in vivo , 2014, Nature.

[29]  W. Gan,et al.  Branch-specific dendritic Ca2+ spikes cause persistent synaptic plasticity , 2015, Nature.

[30]  Paul W. Frankland,et al.  Competition between engrams influences fear memory formation and recall , 2016, Science.

[31]  Wen-Liang L Zhou,et al.  The decade of the dendritic NMDA spike , 2010, Journal of neuroscience research.

[32]  Jochen Triesch,et al.  The dynamic connectome , 2016, e-Neuroforum.

[33]  Denise J. Cai,et al.  Synaptic tagging during memory allocation , 2014, Nature Reviews Neuroscience.

[34]  G. E. Smith The Human Brain , 1924, Nature.

[35]  Alcino J. Silva,et al.  Synaptic clustering within dendrites: An emerging theory of memory formation , 2015, Progress in Neurobiology.

[36]  Yee Whye Teh,et al.  Bayesian Learning via Stochastic Gradient Langevin Dynamics , 2011, ICML.

[37]  Stefan Rotter,et al.  Associative properties of structural plasticity based on firing rate homeostasis in recurrent neuronal networks , 2017, Scientific Reports.

[38]  Jackie Schiller,et al.  Spatiotemporally graded NMDA spike/plateau potentials in basal dendrites of neocortical pyramidal neurons. , 2008, Journal of neurophysiology.

[39]  H. Markram,et al.  The neocortical microcircuit as a tabula rasa. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[40]  Wulfram Gerstner,et al.  Multicontact Co-operativity in Spike-Timing–Dependent Structural Plasticity Stabilizes Networks , 2016, Cerebral cortex.

[41]  Richard George,et al.  Structural Plasticity Denoises Responses and Improves Learning Speed , 2016, Front. Comput. Neurosci..

[42]  A. Polsky,et al.  Synaptic Integration in Tuft Dendrites of Layer 5 Pyramidal Neurons: A New Unifying Principle , 2009, Science.

[43]  K. Holthoff,et al.  Single‐shock LTD by local dendritic spikes in pyramidal neurons of mouse visual cortex , 2004, The Journal of physiology.

[44]  R. French Catastrophic forgetting in connectionist networks , 1999, Trends in Cognitive Sciences.

[45]  Bartlett W. Mel,et al.  Impact of Active Dendrites and Structural Plasticity on the Memory Capacity of Neural Tissue , 2001, Neuron.

[46]  Ju Lu,et al.  REPETITIVE MOTOR LEARNING INDUCES COORDINATED FORMATION OF CLUSTERED DENDRITIC SPINES IN VIVO , 2012, Nature.

[47]  David Kappel,et al.  A Dynamic Connectome Supports the Emergence of Stable Computational Function of Neural Circuits through Reward-Based Learning , 2017, eNeuro.

[48]  Paul A. Rhodes Recoding Patterns of Sensory Input: Higher-Order Features and the Function of Nonlinear Dendritic Trees , 2008, Neural Computation.

[49]  David Kappel,et al.  Network Plasticity as Bayesian Inference , 2015, PLoS Comput. Biol..

[50]  Johannes J. Letzkus,et al.  Dendritic mechanisms controlling spike-timing-dependent synaptic plasticity , 2007, Trends in Neurosciences.

[51]  C. Gilbert,et al.  Axons and Synaptic Boutons Are Highly Dynamic in Adult Visual Cortex , 2006, Neuron.

[52]  Y. Loewenstein,et al.  Multiplicative Dynamics Underlie the Emergence of the Log-Normal Distribution of Spine Sizes in the Neocortex In Vivo , 2011, The Journal of Neuroscience.

[53]  David Kappel,et al.  Deep Rewiring: Training very sparse deep networks , 2017, ICLR.

[54]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[55]  W. Gan,et al.  Stably maintained dendritic spines are associated with lifelong memories , 2009, Nature.

[56]  Noam E. Ziv,et al.  Relative Contributions of Specific Activity Histories and Spontaneous Processes to Size Remodeling of Glutamatergic Synapses , 2016, PLoS biology.

[57]  Bartlett W. Mel,et al.  Information Processing in Dendritic Trees , 1994, Neural Computation.

[58]  M. Häusser,et al.  Dendritic Discrimination of Temporal Input Sequences in Cortical Neurons , 2010, Science.

[59]  E. Ahissar,et al.  Neuroscience: New tricks and old spines , 2009, Nature.

[60]  I. Fried,et al.  Rapid Encoding of New Memories by Individual Neurons in the Human Brain , 2015, Neuron.

[61]  M. Bear,et al.  Homosynaptic long-term depression in area CA1 of hippocampus and effects of N-methyl-D-aspartate receptor blockade. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[62]  Alcino J. Silva,et al.  Molecular and Cellular Approaches to Memory Allocation in Neural Circuits , 2009, Science.

[63]  Razvan Pascanu,et al.  Overcoming catastrophic forgetting in neural networks , 2016, Proceedings of the National Academy of Sciences.

[64]  Nathalie L Rochefort,et al.  Functional mapping of single spines in cortical neurons in vivo , 2011, Nature.

[65]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[66]  Urit Gordon,et al.  Plasticity Compartments in Basal Dendrites of Neocortical Pyramidal Neurons , 2006, The Journal of Neuroscience.

[67]  G. Shepherd,et al.  Transient and Persistent Dendritic Spines in the Neocortex In Vivo , 2005, Neuron.

[68]  Wulfram Gerstner,et al.  Predicting spike timing of neocortical pyramidal neurons by simple threshold models , 2006, Journal of Computational Neuroscience.