Stable memory with unstable synapses

What is the physiological basis of long-term memory? The prevailing view in Neuroscience attributes changes in synaptic efficacy to memory acquisition, implying that stable memories correspond to stable connectivity patterns. However, an increasing body of experimental evidence points to significant, activity-independent fluctuations in synaptic strengths. How memories can survive these fluctuations and the accompanying stabilizing homeostatic mechanisms is a fundamental open question. Here we explore the possibility of memory storage within a global component of network connectivity, while individual connections fluctuate. We find that homeostatic stabilization of fluctuations differentially affects different aspects of network connectivity. Specifically, memories stored as time-varying attractors of neural dynamics are more resilient to erosion than fixed-points. Such dynamic attractors can be learned by biologically plausible learning-rules and support associative retrieval. Our results suggest a link between the properties of learning-rules and those of network-level memory representations, and point at experimentally measurable signatures. How are stable memories maintained in the brain despite significant ongoing fluctuations in synaptic strengths? Here, the authors show that a model consistent with fluctuations, homeostasis and biologically plausible learning rules, naturally leads to memories implemented as dynamic attractors.

[1]  Y. Loewenstein,et al.  Multiplicative Dynamics Underlie the Emergence of the Log-Normal Distribution of Spine Sizes in the Neocortex In Vivo , 2011, The Journal of Neuroscience.

[2]  G. Mongillo,et al.  Inhibitory connectivity defines the realm of excitatory plasticity , 2018, Nature Neuroscience.

[3]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[4]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[5]  Selmaan N. Chettih,et al.  Dynamic Reorganization of Neuronal Activity Patterns in Parietal Cortex , 2017, Cell.

[6]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[7]  G. Turrigiano The Self-Tuning Neuron: Synaptic Scaling of Excitatory Synapses , 2008, Cell.

[8]  Misha Tsodyks,et al.  Chaos in Highly Diluted Neural Networks , 1991 .

[9]  Sompolinsky,et al.  Neural networks with nonlinear synapses and a static noise. , 1986, Physical review. A, General physics.

[10]  A. Stepanyants,et al.  Cooperative synapse formation in the neocortex , 2009, Proceedings of the National Academy of Sciences.

[11]  W. Gan,et al.  Stably maintained dendritic spines are associated with lifelong memories , 2009, Nature.

[12]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[13]  A. Litwin-Kumar,et al.  Formation and maintenance of neuronal assemblies through synaptic plasticity , 2014, Nature Communications.

[14]  Jochen Triesch,et al.  Chapter 11 – Structural Plasticity and the Generation of Bidirectional Connectivity , 2017 .

[15]  Dawn R. Collins,et al.  Amygdala oscillations and the consolidation of emotional memories , 2002, Trends in Cognitive Sciences.

[16]  Noam E. Ziv,et al.  Relative Contributions of Specific Activity Histories and Spontaneous Processes to Size Remodeling of Glutamatergic Synapses , 2016, PLoS biology.

[17]  N. Ziv,et al.  Long-Term Relationships between Synaptic Tenacity, Synaptic Remodeling, and Network Activity , 2009, PLoS biology.

[18]  K. Deisseroth,et al.  Optogenetic stimulation of a hippocampal engram activates fear memory recall , 2012, Nature.

[19]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[20]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[21]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[22]  W. Gerstner,et al.  Connectivity reflects coding: a model of voltage-based STDP with homeostasis , 2010, Nature Neuroscience.

[23]  W. Marsden I and J , 2012 .

[24]  Noam E. Ziv,et al.  Synaptic Tenacity or Lack Thereof: Spontaneous Remodeling of Synapses , 2017, Trends in Neurosciences.

[25]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[26]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[27]  Claudia Clopath,et al.  Variance and invariance of neuronal long-term representations , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[28]  Yonatan Loewenstein,et al.  Predicting the Dynamics of Network Connectivity in the Neocortex , 2015, The Journal of Neuroscience.

[29]  Dean V Buonomano,et al.  A learning rule for the emergence of stable dynamics and timing in recurrent networks. , 2005, Journal of neurophysiology.

[30]  Anna R. Chambers,et al.  A stable brain from unstable components: Emerging concepts and implications for neural computation , 2017, Neuroscience.

[31]  Sompolinsky,et al.  Storing infinite numbers of patterns in a spin-glass model of neural networks. , 1985, Physical review letters.

[32]  H. Kasai,et al.  Principles of Long-Term Dynamics of Dendritic Spines , 2008, The Journal of Neuroscience.

[33]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[34]  E. Goles Antisymmetrical neural networks , 1986, Discrete Applied Mathematics.

[35]  J. Tsien,et al.  Synaptic reentry reinforcement based network model for long‐term memory consolidation , 2002, Hippocampus.

[36]  A. Dickinson,et al.  Can animals recall the past and plan for the future? , 2003, Nature Reviews Neuroscience.

[37]  M. Magnasco,et al.  Self-tuned critical anti-Hebbian networks. , 2009, Physical review letters.

[38]  S. Raghavachari,et al.  Gating of Human Theta Oscillations by a Working Memory Task , 2001, The Journal of Neuroscience.

[39]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[40]  Youngjin Park,et al.  Symmetry of learning rate in synaptic plasticity modulates formation of flexible and stable memories , 2017, Scientific Reports.

[41]  Kunihiko Kaneko,et al.  Embedding Responses in Spontaneous Neural Activity Shaped through Sequential Learning , 2013, PLoS Comput. Biol..

[42]  Kanter,et al.  Associative recall of memory without errors. , 1987, Physical review. A, General physics.

[43]  N. Brunel,et al.  Toward a Neurocentric View of Learning , 2017, Neuron.

[44]  M. Sur,et al.  Locally coordinated synaptic plasticity of visual cortex neurons in vivo , 2018, Science.

[45]  R. Oostenveld,et al.  Theta and Gamma Oscillations Predict Encoding and Retrieval of Declarative Memory , 2006, The Journal of Neuroscience.

[46]  Naama Brenner,et al.  Synaptic Size Dynamics as an Effectively Stochastic Process , 2014, PLoS Comput. Biol..

[47]  G. Mongillo,et al.  Intrinsic volatility of synaptic connections — a challenge to the synaptic trace theory of memory , 2017, Current Opinion in Neurobiology.

[48]  Alexei Koulakov,et al.  Long-term memory stabilized by noise-induced rehearsal , 2012, The Journal of Neuroscience.

[49]  Michael J. Kahana,et al.  Foundations of Human Memory , 2012 .

[50]  O. Amaral,et al.  A Mismatch-Based Model for Memory Reconsolidation and Extinction in Attractor Networks , 2011, PloS one.

[51]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[52]  Dmitri B. Chklovskii,et al.  Neuronal Circuits Underlying Persistent Representations Despite Time Varying Activity , 2012, Current Biology.

[53]  Roger Y Tsien,et al.  Very long-term memories may be stored in the pattern of holes in the perineuronal net , 2013, Proceedings of the National Academy of Sciences.

[54]  E. Bizzi,et al.  A theory for how sensorimotor skills are learned and retained in noisy and nonstationary neural circuits , 2013, Proceedings of the National Academy of Sciences.

[55]  D. Johnston,et al.  Target Cell-Dependent Normalization of Transmitter Release at Neocortical Synapses , 2005, Science.

[56]  Peter Sollich,et al.  Theory of Neural Information Processing Systems , 2005 .

[57]  Fred H. Gage,et al.  What is memory? The present state of the engram , 2016, BMC Biology.