Synaptic tagging, evaluation of memories, and the distal reward problem.

Long-term synaptic plasticity exhibits distinct phases. The synaptic tagging hypothesis suggests an early phase in which synapses are prepared, or "tagged," for protein capture, and a late phase in which those proteins are integrated into the synapses to achieve memory consolidation. The synapse specificity of the tags is consistent with conventional neural network models of associative memory. Memory consolidation through protein synthesis, however, is neuron specific, and its functional role in those models has not been assessed. Here, using a theoretical network model, we test the tagging hypothesis on its potential to prolong memory lifetimes in an online-learning paradigm. We find that protein synthesis, though not synapse specific, prolongs memory lifetimes if it is used to evaluate memory items on a cellular level. In our model we assume that only "important" memory items evoke protein synthesis such that these become more stable than "unimportant" items, which do not evoke protein synthesis. The network model comprises an equilibrium distribution of synaptic states that is very susceptible to the storage of new items: Most synapses are in a state in which they are plastic and can be changed easily, whereas only those synapses that are essential for the retrieval of the important memory items are in the stable late phase. The model can solve the distal reward problem, where the initial exposure of a memory item and its evaluation are temporally separated. Synaptic tagging hence provides a viable mechanism to consolidate and evaluate memories on a synaptic basis.

[1]  J. A. McGeoch Forgetting and the law of disuse. , 1932 .

[2]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[3]  L R Squire,et al.  Retrograde amnesia: temporal gradient in very long term memory following electroconvulsive therapy. , 1975, Science.

[4]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[5]  M. Krug,et al.  Anisomycin blocks the late phase of long-term potentiation in the dentate gyrus of freely moving rats , 1984, Brain Research Bulletin.

[6]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[7]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[8]  U. Frey,et al.  Anisomycin, an inhibitor of protein synthesis, blocks late phases of LTP phenomena in the hippocampal CA1 region in vitro , 1988, Brain Research.

[9]  R. Bjork Retrieval inhibition as an adaptive mechanism in human memory. , 1989 .

[10]  A I I,et al.  Associative memory : on the ( puzzling ) sparse coding limit , 1990 .

[11]  U. Frey,et al.  Dopaminergic antagonists prevent long-term maintenance of posttetanic LTP in the CA1 region of rat hippocampal slices , 1990, Brain Research.

[12]  J. Nadal,et al.  Associative memory: on the (puzzling) sparse coding limit , 1991 .

[13]  David Willshaw,et al.  On setting unit thresholds in an incompletely connected associative net Network: Comput , 1993 .

[14]  Daniel J. Amit,et al.  Learning in Neural Networks with Material Synapses , 1994, Neural Computation.

[15]  P Alvarez,et al.  Memory consolidation and the medial temporal lobe: a simple network model. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[16]  J. Isaac,et al.  Evidence for silent synapses: Implications for the expression of LTP , 1995, Neuron.

[17]  R. Malinow,et al.  Activation of postsynaptically silent synapses during pairing-induced LTP in CA1 region of hippocampal slice , 1995, Nature.

[18]  G. Radvansky,et al.  Studies of directed forgetting in older adults. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[19]  U. Frey,et al.  Synaptic tagging and long-term potentiation , 1997, Nature.

[20]  U. Frey,et al.  Synaptic tagging: implications for late maintenance of hippocampal long-term potentiation , 1998, Trends in Neurosciences.

[21]  U. Frey,et al.  Weak before strong: dissociating synaptic tagging and plasticity-factor accounts of late-LTP , 1998, Neuropharmacology.

[22]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[23]  David A. Nembhard,et al.  The Effects of Task Complexity and Experience on Learning and Forgetting: A Field Study , 2000, Hum. Factors.

[24]  J. Donoghue,et al.  Learning-induced LTP in neocortex. , 2000, Science.

[25]  S. J. Martin,et al.  Synaptic plasticity and memory: an evaluation of the hypothesis. , 2000, Annual review of neuroscience.

[26]  T. Bliss,et al.  A requirement for the immediate early gene Zif268 in the expression of late LTP and long-term memories , 2001, Nature Neuroscience.

[27]  T Seidenbecher,et al.  Reinforcement of Early Long-Term Potentiation (Early-LTP) in Dentate Gyrus by Stimulation of the Basolateral Amygdala: Heterosynaptic Induction Mechanisms of Late-LTP , 2001, The Journal of Neuroscience.

[28]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[29]  Albert K. Lee,et al.  Memory of Sequential Experience in the Hippocampus during Slow Wave Sleep , 2002, Neuron.

[30]  S. Sajikumar,et al.  Late-associativity, synaptic tagging, and the role of dopamine during LTP and LTD , 2004, Neurobiology of Learning and Memory.

[31]  S. Sajikumar,et al.  Resetting of ‘synaptic tags’ is time- and activity-dependent in rat hippocampal CA1in vitro , 2004, Neuroscience.

[32]  M. Wilson,et al.  NMDA receptors, place cells and hippocampal spatial memory , 2004, Nature Reviews Neuroscience.

[33]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[34]  L. Abbott,et al.  Cascade Models of Synaptically Stored Memories , 2005, Neuron.

[35]  T. Sacktor,et al.  Synaptic Tagging and Cross-Tagging: The Role of Protein Kinase Mζ in Maintaining Long-Term Potentiation But Not Long-Term Depression , 2005, The Journal of Neuroscience.

[36]  Richard Kempter,et al.  Memory Capacity for Sequences in a Recurrent Network with Biological Constraints , 2006, Neural Computation.

[37]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.

[38]  J. Frey,et al.  The late maintenance of hippocampal LTP: Requirements, phases, ‘synaptic tagging’, ‘late-associativity’ and implications , 2007, Neuropharmacology.

[39]  L. Abbott,et al.  Limits on the memory storage capacity of bounded synapses , 2007, Nature Neuroscience.

[40]  G. Buzsáki,et al.  Forward and reverse hippocampal place-cell sequences during ripples , 2007, Nature Neuroscience.

[41]  E. Izhikevich Solving the distal reward problem through linkage of STDP and dopamine signaling , 2007, BMC Neuroscience.

[42]  Stefano Fusi,et al.  Long Memory Lifetimes Require Complex Synapses and Limited Sparseness , 2007, Frontiers Comput. Neurosci..

[43]  Yu Tian Wang,et al.  Synaptic plasticity in learning and memory: stress effects in the hippocampus. , 2008, Progress in brain research.

[44]  R. Kempter,et al.  Sparseness constrains the prolongation of memory lifetime via synaptic metaplasticity. , 2008, Cerebral cortex.

[45]  Mark C. W. van Rossum,et al.  Optimal Learning Rules for Discrete Synapses , 2008, PLoS Comput. Biol..

[46]  Wulfram Gerstner,et al.  Tag-Trigger-Consolidation: A Model of Early and Late Long-Term-Potentiation and Depression , 2008, PLoS Comput. Biol..

[47]  Yali Amit,et al.  Optimizing One-Shot Learning with Binary Synapses , 2008, Neural Computation.

[48]  Willie F. Tobin,et al.  Rapid formation and selective stabilization of synapses for enduring motor memories , 2009, Nature.

[49]  Mark C. W. van Rossum,et al.  State Based Model of Long-Term Potentiation and Synaptic Tagging and Capture , 2009, PLoS Comput. Biol..

[50]  Matthew A. Wilson,et al.  Hippocampal Replay of Extended Experience , 2009, Neuron.

[51]  Yali Amit,et al.  Precise Capacity Analysis in Binary Networks with Multiple Coding Level Inputs , 2010, Neural Computation.