Computational principles of synaptic memory consolidation

Memories are stored and retained through complex, coupled processes operating on multiple timescales. To understand the computational principles behind these intricate networks of interactions, we construct a broad class of synaptic models that efficiently harness biological complexity to preserve numerous memories by protecting them against the adverse effects of overwriting. The memory capacity scales almost linearly with the number of synapses, which is a substantial improvement over the square root scaling of previous models. This was achieved by combining multiple dynamical processes that initially store memories in fast variables and then progressively transfer them to slower variables. Notably, the interactions between fast and slow variables are bidirectional. The proposed models are robust to parameter perturbations and can explain several properties of biological memory, including delayed expression of synaptic modifications, metaplasticity, and spacing effects.

[1]  E. Kandel,et al.  Long-term habituation of a defensive withdrawal reflex in aplysia. , 1972, Science.

[2]  F. Crick.  Neurobiology: Memory and molecular turnover , 1984, Nature.

[3]  F. Crick.  Memory and molecular turnover. , 1984, Nature.

[4]  J. Lisman.  A mechanism for memory storage insensitive to molecular turnover: a bistable autophosphorylating kinase. , 1985, Proceedings of the National Academy of Sciences of the United States of America.

[5]  G. Parisi.  A memory which forgets , 1986 .

[6]  W. Krauth,et al.  Learning algorithms with optimal stability in neural networks , 1987 .

[7]  M. Tsodyks,et al.  The Enhanced Storage Capacity in Neural Networks with Low Activity Level , 1988 .

[8]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .

[9]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[10]  J. Wixted,et al.  On the Form of Forgetting , 1991 .

[11]  A. Treves,et al.  Why the simplest notion of neocortex as an autoassociative memory would not work , 1992 .

[12]  Daniel J. Amit,et al.  Learning in Neural Networks with Material Synapses , 1994, Neural Computation.

[13]  Gerald Sommer,et al.  Pattern Recognition by Self-Organizing Neural Networks , 1994 .

[14]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[15]  J. Wixted,et al.  Genuine power curves in forgetting: A quantitative analysis of individual subject forgetting functions , 1997, Memory & cognition.

[16]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[17]  Davide Badoni,et al.  Spike-Driven Synaptic Plasticity: Theory, Simulation, VLSI Implementation , 2000, Neural Computation.

[18]  Stefano Fusi,et al.  Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates , 2002, Biological Cybernetics.

[19]  M. Poo,et al.  Reversal and Stabilization of Synaptic Modifications in a Developing Visual System , 2003, Science.

[20]  E. Kandel,et al.  A Neuronal Isoform of the Aplysia CPEB Has Prion-Like Properties , 2003, Cell.

[21]  S. Wang,et al.  Graded bidirectional synaptic plasticity is composed of switch-like unitary events. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Xiao-Jing Wang,et al.  The Stability of a Stochastic CaMKII Switch: Dependence on the Number of Enzyme Molecules and Protein Turnover , 2005, PLoS biology.

[23]  L. Abbott,et al.  Cascade Models of Synaptically Stored Memories , 2005, Neuron.

[24]  H. Shouval.  Clusters of interacting receptors can stabilize synaptic efficacies. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Peter E. Latham,et al.  A Balanced Memory Network , 2007, PLoS Comput. Biol..

[26]  J. Frey,et al.  The late maintenance of hippocampal LTP: Requirements, phases, ‘synaptic tagging’, ‘late-associativity’ and implications , 2007, Neuropharmacology.

[27]  L. Abbott,et al.  Limits on the memory storage capacity of bounded synapses , 2007, Nature Neuroscience.

[28]  Walter Senn,et al.  Learning Real-World Stimuli in a Neural Network with Spike-Driven Synaptic Dynamics , 2007, Neural Computation.

[29]  M. Wilson,et al.  Coordinated memory replay in the visual cortex and hippocampus during sleep , 2007, Nature Neuroscience.

[30]  W. Abraham.  Metaplasticity: tuning synapses and networks for plasticity , 2008, Nature Reviews Neuroscience.

[31]  Richard D Emes,et al.  Evolutionary expansion and anatomical specialization of synapse proteome complexity , 2008, Nature Neuroscience.

[32]  Shaomin Li,et al.  Amyloid-β protein dimers isolated directly from Alzheimer's brains impair synaptic plasticity and memory , 2008, Nature Medicine.

[33]  Aude Oliva,et al.  Visual long-term memory has a massive storage capacity for object details , 2008, Proceedings of the National Academy of Sciences.

[34]  Wulfram Gerstner,et al.  Tag-Trigger-Consolidation: A Model of Early and Late Long-Term-Potentiation and Depression , 2008, PLoS Comput. Biol..

[35]  Bartlett W. Mel,et al.  Capacity-Enhancing Synaptic Learning Rules in a Medial Temporal Lobe Online Learning Model , 2009, Neuron.

[36]  M. Khamassi,et al.  Replay of rule-learning related neural patterns in the prefrontal cortex during sleep , 2009, Nature Neuroscience.

[37]  Mark C. W. van Rossum,et al.  State Based Model of Long-Term Potentiation and Synaptic Tagging and Capture , 2009, PLoS Comput. Biol..

[38]  R. Morris,et al.  Making memories last: the synaptic tagging and capture hypothesis , 2010, Nature Reviews Neuroscience.

[39]  P. Bearman,et al.  Correction for Graupner and Brunel, Calcium-based plasticity model explains sensitivity of synaptic changes to spike pattern, rate, and dendritic location , 2012, Proceedings of the National Academy of Sciences.

[40]  Surya Ganguli,et al.  A memory frontier for complex synapses , 2013, NIPS.

[41]  Stefano Fusi,et al.  Efficient Partitioning of Memory Systems and Its Importance for Memory Consolidation , 2013, PLoS Comput. Biol..

[42]  Stefano Fusi,et al.  The Sparseness of Mixed Selectivity Neurons Controls the Generalization–Discrimination Trade-Off , 2013, The Journal of Neuroscience.

[43]  Peter Dayan,et al.  Optimal Recall from Bounded Metaplastic Synapses: Predicting Functional Adaptations in Hippocampal Area CA3 , 2014, PLoS Comput. Biol..

[44]  U. Bhalla.  Molecular computation in neurons: a modeling perspective , 2014, Current Opinion in Neurobiology.

[45]  W. Gerstner,et al.  Synaptic Consolidation: From Synapses to Behavioral Modeling , 2015, The Journal of Neuroscience.

[46]  Paul Smolen,et al.  The right time to learn: mechanisms and optimization of spaced learning , 2016, Nature Reviews Neuroscience.