The content of hippocampal “replay”

One of the most striking features of the hippocampal network is its ability to self‐generate neuronal sequences representing temporally compressed, spatially coherent paths. These brief events, often termed “replay” in the scientific literature, are largely confined to non‐exploratory states such as sleep or quiet rest. Early studies examining the content of replay noted a strong correlation between the encoded spatial information and the animal's prior behavior; thus, replay was initially hypothesized to play a role in memory formation and/or systems‐level consolidation via “off‐line” reactivation of previous experiences. However, recent findings indicate that replay may also serve as a memory retrieval mechanism to guide future behavior or may be an incidental reflection of pre‐existing network assemblies. Here, I will review what is known regarding the content of replay events and their correlation with past and future actions, and I will discuss how this knowledge might inform or constrain models which seek to explain the circuit‐level mechanisms underlying these events and their role in mnemonic processes.

[1]  David C Rowland,et al.  Generation of a Synthetic Memory Trace , 2012, Science.

[2]  Nachum Ulanovsky,et al.  Vectorial representation of spatial goals in the hippocampus of bats , 2017, Science.

[3]  Susumu Tonegawa,et al.  Direct Medial Entorhinal Cortex Input to Hippocampal CA1 Is Crucial for Extended Quiet Awake Replay , 2017, Neuron.

[4]  G. Buzsáki,et al.  Selective suppression of hippocampal ripples impairs spatial memory , 2009, Nature Neuroscience.

[5]  Margaret F. Carr,et al.  Hippocampal replay in the awake state: a potential physiological substrate of memory consolidation and retrieval , 2011 .

[6]  M. Wilson,et al.  Coordinated memory replay in the visual cortex and hippocampus during sleep , 2007, Nature Neuroscience.

[7]  Y. Dan,et al.  Spike Timing-Dependent Plasticity of Neural Circuits , 2004, Neuron.

[8]  Andres D. Grosmark,et al.  Diversity in neural firing dynamics supports both rigid and learned hippocampal sequences , 2016, Science.

[9]  T. Bliss,et al.  Long‐lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path , 1973, The Journal of physiology.

[10]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.

[11]  Yaniv Ziv,et al.  Hippocampal ensemble dynamics timestamp events in long-term memory , 2015, eLife.

[12]  G. Buzsáki.  Two-stage model of memory trace formation: A role for “noisy” brain states , 1989, Neuroscience.

[13]  G. Buzsáki,et al.  Cellular activity of intracerebrally transplanted fetal hippocampus during behavior , 1987, Neuroscience.

[14]  Jozsef Csicsvari,et al.  Optogenetically Blocking Sharp Wave Ripple Events in Sleep Does Not Interfere with the Formation of Stable Spatial Representation in the CA1 Area of the Hippocampus , 2016, PloS one.

[15]  Pawel Cichosz,et al.  An Analysis of Experience Replay in Temporal Difference Learning , 1999, Cybern. Syst..

[16]  A. Kirkwood,et al.  Neuromodulators Control the Polarity of Spike-Timing-Dependent Synaptic Plasticity , 2007, Neuron.

[17]  J. Csicsvari,et al.  Replay and Time Compression of Recurring Spike Sequences in the Hippocampus , 1999, The Journal of Neuroscience.

[18]  J. Isaac,et al.  Hippocampal Place Cell Firing Patterns Can Induce Long-Term Synaptic Plasticity In Vitro , 2009, The Journal of Neuroscience.

[19]  G. Buzsáki,et al.  Forward and reverse hippocampal place-cell sequences during ripples , 2007, Nature Neuroscience.

[20]  L. Frank,et al.  Rewarded Outcomes Enhance Reactivation of Experience in the Hippocampus , 2009, Neuron.

[21]  George Dragoi,et al.  Distinct preplay of multiple novel spatial experiences in the rat , 2013, Proceedings of the National Academy of Sciences.

[22]  Caswell Barry,et al.  Coordinated grid and place cell replay during rest , 2016, Nature Neuroscience.

[23]  L. Colgin.  Mechanisms and functions of theta rhythms. , 2013, Annual review of neuroscience.

[24]  Matthew A. Wilson,et al.  Hippocampal Replay of Extended Experience , 2009, Neuron.

[25]  A. Draguhn,et al.  Downstream effects of hippocampal sharp wave ripple oscillations on medial entorhinal cortex layer V neurons in vitro , 2016, Hippocampus.

[26]  G. Buzsáki,et al.  Temporal Encoding of Place Sequences by Hippocampal Cell Assemblies , 2006, Neuron.

[27]  P. Frankland,et al.  Finding the engram , 2015, Nature Reviews Neuroscience.

[28]  Bruce McNaughton,et al.  Reactivation of neuronal ensembles in hippocampal dentate gyrus during sleep after spatial experience , 1998, Journal of sleep research.

[29]  Mark J. Schnitzer,et al.  Impermanence of dendritic spines in live adult CA1 hippocampus , 2015, Nature.

[30]  Charlotte N. Boccara,et al.  Superficial layers of the medial entorhinal cortex replay independently of the hippocampus , 2017, Science.

[31]  R. Clark,et al.  The medial temporal lobe. , 2004, Annual review of neuroscience.

[32]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[33]  B. McNaughton,et al.  Replay of Neuronal Firing Sequences in Rat Hippocampus During Sleep Following Spatial Experience , 1996, Science.

[34]  M. Witter,et al.  Anatomical Organization of the Parahippocampal‐Hippocampal Network , 2000, Annals of the New York Academy of Sciences.

[35]  G Buzsáki,et al.  Memory consolidation during sleep: a neurophysiological perspective. , 1998, Journal of sleep research.

[36]  David S. Touretzky,et al.  The Role of the Hippocampus in Solving the Morris Water Maze , 1998, Neural Computation.

[37]  Eran Stark,et al.  Sharp wave ripples during learning stabilize hippocampal spatial map , 2017, Nature Neuroscience.

[38]  B. McNaughton,et al.  Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences , 1996, Hippocampus.

[39]  N. Matsuki,et al.  Dopamine Receptor Activation Reorganizes Neuronal Ensembles during Hippocampal Sharp Waves In Vitro , 2014, PloS one.

[40]  Brad E. Pfeiffer,et al.  Reverse Replay of Hippocampal Place Cells Is Uniquely Modulated by Changing Reward , 2016, Neuron.

[41]  R. N. Spreng,et al.  Imagining the future: Evidence for a hippocampal contribution to constructive processing , 2013, Hippocampus.

[42]  Lacey J. Kitch,et al.  Long-term dynamics of CA1 hippocampal place codes , 2013, Nature Neuroscience.

[43]  David J Foster,et al.  Hippocampal Replay Captures the Unique Topological Structure of a Novel Environment , 2014, The Journal of Neuroscience.

[44]  Susumu Tonegawa,et al.  Hippocampal CA3 Output Is Crucial for Ripple-Associated Reactivation and Consolidation of Memory , 2009, Neuron.

[45]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[46]  R. Muller,et al.  On the directional firing properties of hippocampal place cells , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[47]  Markku Penttonen,et al.  This Reprint May Differ from the Original in Pagination and Typographic Detail. Disrupting Neural Activity Related to Awake-state Sharp Wave-ripple Complexes Prevents Hippocampal Learning Disrupting Neural Activity Related to Awake-state Sharp Wave-ripple Complexes Prevents Hippocampal Learning , 2022 .

[48]  B. McNaughton,et al.  The contributions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats , 1983, Experimental Brain Research.

[49]  D. Feldman.  The Spike-Timing Dependence of Plasticity , 2012, Neuron.

[50]  Katie C. Bittner,et al.  Behavioral time scale synaptic plasticity underlies CA1 place fields , 2017, Science.

[51]  J. O’Neill,et al.  Place-Selective Firing of CA1 Pyramidal Cells during Sharp Wave/Ripple Network Patterns in Exploratory Behavior , 2006, Neuron.

[52]  G. Buzsáki.  Hippocampal sharp wave‐ripple: A cognitive biomarker for episodic memory and planning , 2015, Hippocampus.

[53]  Mattias P. Karlsson,et al.  Awake replay of remote experiences in the hippocampus , 2009, Nature Neuroscience.

[54]  S. Sajikumar,et al.  Distinct single but not necessarily repeated tetanization is required to induce hippocampal late-LTP in the rat CA1. , 2008, Learning & memory.

[55]  J. O’Neill,et al.  Play it again: reactivation of waking experience and memory , 2010, Trends in Neurosciences.

[56]  David C Rowland,et al.  Place cells, grid cells, and memory. , 2015, Cold Spring Harbor perspectives in biology.

[57]  G. Buzsáki.  Hippocampal sharp waves: Their origin and significance , 1986, Brain Research.

[58]  Dorothy Tse,et al.  References and Notes Supporting Online Material Materials and Methods Figs. S1 to S5 Tables S1 to S3 Electron Impact (ei) Mass Spectra Chemical Ionization (ci) Mass Spectra References Schemas and Memory Consolidation Research Articles Research Articles Research Articles Research Articles , 2022 .

[59]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[60]  P. Jonas,et al.  Symmetric spike timing-dependent plasticity at CA3–CA3 synapses optimizes storage and recall in autoassociative networks , 2016, Nature Communications.

[61]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[62]  G. Dragoi,et al.  Preplay of future place cell sequences by hippocampal cellular assemblies , 2011, Nature.

[63]  S. Siegelbaum,et al.  Midbrain dopamine neurons bidirectionally regulate CA3-CA1 synaptic drive , 2015, Nature Neuroscience.

[64]  E. Tolman.  Cognitive maps in rats and men. , 1948, Psychological review.

[65]  S. Tonegawa,et al.  Creating a False Memory in the Hippocampus , 2013, Science.

[66]  C. Pavlides,et al.  Influences of hippocampal place cell firing in the awake state on the activity of these cells during subsequent sleep episodes , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[67]  J. Knott.  The organization of behavior: A neuropsychological theory , 1951 .

[68]  D. Ji,et al.  Hippocampal awake replay in fear memory retrieval , 2017, Nature Neuroscience.

[69]  Jadin C. Jackson,et al.  Hippocampal Sharp Waves and Reactivation during Awake States Depend on Repeated Sequential Experience , 2006, The Journal of Neuroscience.

[70]  J. Born,et al.  Labile or stable: opposing consequences for memory when reactivated during waking and sleep , 2011, Nature Neuroscience.

[71]  Susumu Takahashi.  Episodic-like memory trace in awake replay of hippocampal place cell activity sequences , 2015, eLife.

[72]  J. Csicsvari,et al.  Firing rates of hippocampal neurons are preserved during subsequent sleep episodes and modified by novel awake experience , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[73]  E. Godaux,et al.  Long-Lasting LTP Requires Neither Repeated Trains for Its Induction Nor Protein Synthesis for Its Development , 2012, PloS one.

[74]  S. Romani,et al.  Theta sequences are essential for internally generated hippocampal firing fields , 2014, Nature Neuroscience.

[75]  Michael E Hasselmo,et al.  Head direction cells in the postsubiculum do not show replay of prior waking sequences during sleep , 2012, Hippocampus.

[76]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[77]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[78]  D. Dupret,et al.  Dopaminergic neurons promote hippocampal reactivation and spatial memory persistence , 2014, Nature Neuroscience.

[79]  Wei Xu,et al.  A Neural Circuit for Memory Specificity and Generalization , 2013, Science.

[80]  M. Wilson,et al.  Disruption of ripple‐associated hippocampal activity during rest impairs spatial learning in the rat , 2009, Hippocampus.

[81]  John B. Trimper,et al.  Methodological Caveats in the Detection of Coordinated Replay between Place Cells and Grid Cells , 2017, Front. Syst. Neurosci..

[82]  Emilio Kropff,et al.  Place cells, grid cells, and the brain's spatial representation system. , 2008, Annual review of neuroscience.

[83]  David J. Foster,et al.  Dissociation between the Experience-Dependent Development of Hippocampal Theta Sequences and Single-Trial Phase Precession , 2015, The Journal of Neuroscience.

[84]  Daniel Bendor,et al.  Biasing the content of hippocampal replay during sleep , 2012, Nature Neuroscience.

[85]  Matthijs A. A. van der Meer,et al.  Theta Phase Precession in Rat Ventral Striatum Links Place and Reward Information , 2011, The Journal of Neuroscience.

[86]  Albert K. Lee,et al.  Memory of Sequential Experience in the Hippocampus during Slow Wave Sleep , 2002, Neuron.

[87]  G Buzsáki,et al.  The hippocampo-neocortical dialogue. , 1996, Cerebral cortex.

[88]  J. O’Keefe,et al.  Phase relationship between hippocampal place units and the EEG theta rhythm , 1993, Hippocampus.

[89]  R. Morris,et al.  Place navigation impaired in rats with hippocampal lesions , 1982, Nature.

[90]  Adam Johnson,et al.  Neural Ensembles in CA3 Transiently Encode Paths Forward of the Animal at a Decision Point , 2007, The Journal of Neuroscience.

[91]  Demetris K. Roumis,et al.  Coordinated Excitation and Inhibition of Prefrontal Ensembles during Awake Hippocampal Sharp-Wave Ripple Events , 2016, Neuron.

[92]  G. Buzsáki,et al.  Cellular bases of hippocampal EEG in the behaving rat , 1983, Brain Research Reviews.

[93]  György Buzsáki,et al.  Reactivations of emotional memory in the hippocampus–amygdala system during sleep , 2017, Nature Neuroscience.

[94]  Li I. Zhang,et al.  A critical window for cooperation and competition among developing retinotectal synapses , 1998, Nature.

[95]  Satoshi Ikemoto,et al.  Mesopontine median raphe regulates hippocampal ripple oscillation and memory consolidation , 2015, Nature Neuroscience.

[96]  Margaret F. Carr,et al.  Hippocampal SWR Activity Predicts Correct Decisions during the Initial Learning of an Alternation Task , 2013, Neuron.

[97]  N. Burgess,et al.  Evidence for Encoding versus Retrieval Scheduling in the Hippocampus by Theta Phase and Acetylcholine , 2013, The Journal of Neuroscience.

[98]  George Dragoi,et al.  Development of schemas revealed by prior experience and NMDA receptor knock-out , 2013, eLife.

[99]  Delia Silva,et al.  Trajectory events across hippocampal place-cells require previous experience , 2015, Nature Neuroscience.

[100]  Wulfram Gerstner,et al.  Spike-timing dependent plasticity , 2010, Scholarpedia.

[101]  J. O’Neill,et al.  Place-selective firing contributes to the reverse-order reactivation of CA1 pyramidal cells during sharp waves in open-field exploration , 2007, The European journal of neuroscience.

[102]  P. Lewis,et al.  Overlapping memory replay during sleep builds cognitive schemata , 2011, Trends in Cognitive Sciences.

[103]  Roger L Redondo,et al.  Synaptic Tagging and Capture: Differential Role of Distinct Calcium/Calmodulin Kinases in Protein Synthesis-Dependent Long-Term Potentiation , 2010, The Journal of Neuroscience.

[104]  E. Kandel,et al.  Theta frequency stimulation induces a local form of late phase LTP in the CA1 region of the hippocampus. , 2005, Learning & memory.

[105]  B. McNaughton,et al.  Reactivation of Hippocampal Cell Assemblies: Effects of Behavioral State, Experience, and EEG Dynamics , 1999, The Journal of Neuroscience.

[106]  David J. Foster,et al.  Hippocampal theta sequences , 2007, Hippocampus.

[107]  D. Hassabis,et al.  Hippocampal place cells construct reward related sequences through unexplored space , 2015, eLife.

[108]  David J. Foster.  Replay Comes of Age. , 2017, Annual review of neuroscience.

[109]  Andrew M. Wikenheiser,et al.  The balance of forward and backward hippocampal sequences shifts across behavioral states , 2013, Hippocampus.

[110]  J. O’Neill,et al.  Reactivation of experience-dependent cell assembly patterns in the hippocampus , 2008, Nature Neuroscience.

[111]  Brad E. Pfeiffer,et al.  Autoassociative dynamics in the generation of sequences of hippocampal place cells , 2015, Science.

[112]  R. Buckner.  The role of the hippocampus in prediction and imagination. , 2010, Annual review of psychology.

[113]  J. O’Neill,et al.  The reorganization and reactivation of hippocampal maps predict spatial memory performance , 2010, Nature Neuroscience.

[114]  L. Frank,et al.  Awake Hippocampal Sharp-Wave Ripples Support Spatial Memory , 2012, Science.

[115]  Matthijs A. A. van der Meer,et al.  Hippocampal Replay Is Not a Simple Function of Experience , 2010, Neuron.

[116]  Margaret F. Carr,et al.  Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval , 2011, Nature Neuroscience.