A model of bi-directional interactions between complementary learning systems for memory consolidation of sequential experiences

The standard theory of memory consolidation posits a dual-store memory system: a fast-learning fast-decaying hippocampus that transfers memories to slow-learning long-term cortical storage. Hippocampal lesions interrupt this transfer, so recent memories are more likely to be lost than more remote memories. Existing models of memory consolidation that simulate this temporally graded retrograde amnesia operate only on static patterns or unitary variables as memories. However, the mechanisms underlying the consolidation of episodes, which are sequential in nature and comprise multiple events, are not well understood. There is currently no computational theory for how memory replays of sequential experiences emerge dynamically during offline periods and how they are coordinated between the hippocampus and cortex to facilitate the stabilization of episodic memories. Further, there is evidence for a bi-directional interaction between the two memory systems during offline periods (Ji & Wilson, 2007), whereby the reactivation of waking neural patterns originating in the cortex triggers time-compressed sequential replays in the hippocampus, which in turn drive the consolidation of the pertinent sequence in the cortex. We have developed a computational model of memory encoding, consolidation, and recall for storing temporal sequences that explores the dynamics of this bi-directional interaction and time-compressed replays in four simulation experiments, providing novel insights into whether hippocampal learning needs to be suppressed for stable memory consolidation and into how new and old memories compete for limited replay opportunities during offline periods. The salience of experienced events, based on factors such as recency and frequency of use, is shown to have considerable impact on memory consolidation because it biases the relative probability that a particular event will be cued in the cortex during offline periods. In the presence of hippocampal learning during sleep, our model predicts that the fast-forgetting hippocampus can continually refresh the memory traces of a given episodic sequence if there are no competing experiences to be replayed.

[1]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[2]  J. Born,et al.  Odor Cues During Slow-Wave Sleep Prompt Declarative Memory Consolidation , 2007, Science.

[3]  B. Nolan Boosting slow oscillations during sleep potentiates memory , 2008 .

[4]  Shane M. Roach,et al.  One-Shot Tagging During Wake and Cueing During Sleep With Spatiotemporal Patterns of Transcranial Electrical Stimulation Can Boost Long-Term Metamemory of Individual Episodes in Humans , 2019, bioRxiv.

[5]  Andrew M. Wikenheiser,et al.  The balance of forward and backward hippocampal sequences shifts across behavioral states , 2013, Hippocampus.

[6]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[7]  R. A. Fuchs,et al.  The role of the basolateral amygdala in stimulus–reward memory and extinction memory consolidation and in subsequent conditioned cued reinstatement of cocaine seeking , 2006, The European journal of neuroscience.

[8]  Yadin Dudai,et al.  Reconsolidation: the advantage of being refocused , 2006, Current Opinion in Neurobiology.

[9]  G. Buzsáki,et al.  Forward and reverse hippocampal place-cell sequences during ripples , 2007, Nature Neuroscience.

[10]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[11]  J. Born,et al.  About sleep's role in memory. , 2013, Physiological reviews.

[12]  M. Wilson,et al.  Coordinated memory replay in the visual cortex and hippocampus during sleep , 2007, Nature Neuroscience.

[13]  S. Grossberg,et al.  How does a brain build a cognitive code? , 1980, Psychological review.

[14]  L. Nadel,et al.  Multiple trace theory of human memory: Computational, neuroimaging, and neuropsychological results , 2000, Hippocampus.

[15]  D. Dupret,et al.  Dopaminergic neurons promote hippocampal reactivation and spatial memory persistence , 2014, Nature Neuroscience.

[16]  Roy Cox,et al.  UvA-DARE ( Digital Academic Repository ) Sound asleep : Processing and retention of slow oscillation phase-targeted stimuli , 2014 .

[17]  A. Yonelinas,et al.  The slow forgetting of emotional episodic memories: an emotional binding account , 2015, Trends in Cognitive Sciences.

[18]  J. Born,et al.  Declarative memory consolidation: mechanisms acting during human sleep. , 2004, Learning & memory.

[19]  N. Spruston,et al.  Properties of slow, cumulative sodium channel inactivation in rat hippocampal CA1 pyramidal neurons. , 1999, Biophysical journal.

[20]  Maxim Volgushev,et al.  Precise Long-Range Synchronization of Activity and Silence in Neocortical Neurons during Slow-Wave Sleep , 2006, The Journal of Neuroscience.

[21]  G. Buzsáki,et al.  Selective activation of deep layer (V-VI) retrohippocampal cortical neurons during hippocampal sharp waves in the behaving rat , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  Joel L. Voss,et al.  Memory reactivation and consolidation during sleep. , 2004, Learning & memory (Cold Spring Harbor, N.Y.).

[23]  Albert K. Lee,et al.  Memory of Sequential Experience in the Hippocampus during Slow Wave Sleep , 2002, Neuron.

[24]  K. Deisseroth,et al.  Optogenetic stimulation of a hippocampal engram activates fear memory recall , 2012, Nature.

[25]  Eric W. Gobel,et al.  Cued Memory Reactivation During Sleep Influences Skill Learning , 2012, Nature Neuroscience.

[26]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[27]  Y. Dudai The neurobiology of consolidations, or, how stable is the engram? , 2004, Annual review of psychology.

[28]  Edwin M Robertson,et al.  New Insights in Human Memory Interference and Consolidation , 2012, Current Biology.

[29]  Simon Hanslmayr,et al.  Speed of time-compressed forward replay flexibly changes in human episodic memory , 2018, Nature Human Behaviour.

[30]  Joel L. Voss,et al.  Strengthening Individual Memories by Reactivating Them During Sleep , 2009, Science.

[31]  I. Izquierdo,et al.  Memory Formation: The Sequence of Biochemical Events in the Hippocampus and Its Connection to Activity in Other Brain Structures , 1997, Neurobiology of Learning and Memory.

[32]  P. Dayan,et al.  Off-line replay maintains declarative memories in a model of hippocampal-neocortical interactions , 2004, Nature Neuroscience.

[33]  I. Wilhelm,et al.  System consolidation of memory during sleep , 2011, Psychological Research.

[34]  Romain Brette,et al.  Impact of Fast Sodium Channel Inactivation on Spike Threshold Dynamics and Synaptic Integration , 2011, PLoS Comput. Biol..

[35]  D. R. Euston,et al.  Fast-Forward Playback of Recent Memory Sequences in Prefrontal Cortex During Sleep , 2007, Science.

[36]  Kaoru Inokuchi,et al.  Overlapping memory trace indispensable for linking, but not recalling, individual memories , 2017, Science.

[37]  S. Tonegawa,et al.  Creating a False Memory in the Hippocampus , 2013, Science.

[38]  G. Buzsáki Theta rhythm of navigation: Link between path integration and landmark navigation, episodic and semantic memory , 2005, Hippocampus.

[39]  G Buzsáki,et al.  Memory consolidation during sleep: a neurophysiological perspective. , 1998, Journal of sleep research.

[40]  Natalie B. Bryant,et al.  Transcranial Current Stimulation During Sleep Facilitates Insight into Temporal Rules, but does not Consolidate Memories of Individual Sequential Experiences , 2019, Scientific Reports.

[41]  B. McNaughton,et al.  Replay of Neuronal Firing Sequences in Rat Hippocampus During Sleep Following Spatial Experience , 1996, Science.

[42]  B. L. McNaughton,et al.  Suppression of hippocampal synaptic plasticity during slow-wave sleep , 1987, Brain Research.

[43]  L. Squire,et al.  The primate hippocampal formation: evidence for a time-limited role in memory storage. , 1990, Science.

[44]  E. Tulving,et al.  Episodic and declarative memory: Role of the hippocampus , 1998, Hippocampus.

[45]  J. Born,et al.  The contribution of sleep to hippocampus-dependent memory consolidation , 2007, Trends in Cognitive Sciences.

[46]  Donald A. Wilson,et al.  Slow-Wave Sleep-Imposed Replay Modulates Both Strength and Precision of Memory , 2014, The Journal of Neuroscience.

[47]  J. Csicsvari,et al.  Replay and Time Compression of Recurring Spike Sequences in the Hippocampus , 1999, The Journal of Neuroscience.

[48]  L. Squire Declarative and Nondeclarative Memory: Multiple Brain Systems Supporting Learning and Memory , 1992, Journal of Cognitive Neuroscience.

[49]  Natalie B. Bryant,et al.  Closed-Loop Slow-Wave tACS Improves Sleep-Dependent Long-Term Memory Generalization by Modulating Endogenous Oscillations , 2018, The Journal of Neuroscience.

[50]  Laura A. Atherton,et al.  Memory trace replay: the shaping of memory consolidation by neuromodulation , 2015, Trends in Neurosciences.

[51]  Margaret F. Carr,et al.  Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval , 2011, Nature Neuroscience.

[52]  Itamar Lerner,et al.  Sleep and the extraction of hidden regularities: A systematic review and the importance of temporal rules. , 2019, Sleep medicine reviews.

[53]  G. Buzsáki Two-stage model of memory trace formation: A role for “noisy” brain states , 1989, Neuroscience.

[54]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[55]  L. Squire,et al.  Retrograde amnesia and memory consolidation: a neurobiological perspective , 1995, Current Opinion in Neurobiology.

[56]  R Ratcliff,et al.  Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. , 1990, Psychological review.

[57]  C. Bramham,et al.  Synaptic plasticity in the hippocampus is modulated by behavioral state , 1989, Brain Research.

[58]  Loren M. Frank,et al.  Specific hippocampal representations are linked to generalized cortical representations in memory , 2018, Nature Communications.

[59]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[60]  E. Tulving,et al.  Episodic and semantic memory , 1972 .

[61]  L. Frank,et al.  Rewarded Outcomes Enhance Reactivation of Experience in the Hippocampus , 2009, Neuron.

[62]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[63]  Robert C. Malenka,et al.  Synaptic plasticity in the hippocampus: LTP and LTD , 1994, Cell.

[64]  K. Nader,et al.  Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval , 2000, Nature.

[65]  L. Frank,et al.  New Experiences Enhance Coordinated Neural Activity in the Hippocampus , 2008, Neuron.

[66]  P Alvarez,et al.  Memory consolidation and the medial temporal lobe: a simple network model. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[67]  Alcino J. Silva,et al.  A shared neural ensemble links distinct contextual memories encoded close in time , 2016, Nature.