Progress and issues in second-order analysis of hippocampal replay

Patterns of neural activity that occur spontaneously during sharp-wave ripple (SWR) events in the hippocampus are thought to play an important role in memory formation, consolidation and retrieval. Typical studies examining the content of SWRs seek to determine whether the identity and/or temporal order of cell firing is different from chance. Such ‘first-order’ analyses are focused on a single time point and template (map), and have been used to show, for instance, the existence of preplay. The major methodological challenge in first-order analyses is the construction and interpretation of different chance distributions. By contrast, ‘second-order’ analyses involve a comparison of SWR content between different time points, and/or between different templates. Typical second-order questions include tests of experience-dependence (replay) that compare SWR content before and after experience, and comparisons or replay between different arms of a maze. Such questions entail additional methodological challenges that can lead to biases in results and associated interpretations. We provide an inventory of analysis challenges for second-order questions about SWR content, and suggest ways of preventing, identifying and addressing possible analysis biases. Given evolving interest in understanding SWR content in more complex experimental scenarios and across different time scales, we expect these issues to become increasingly pervasive. This article is part of the Theo Murphy meeting issue ‘Memory reactivation: replaying events past, present and future’.

[1]  L. Nadel The hippocampus and context revisited. , 2008 .

[2]  L. Frank,et al.  Awake Hippocampal Sharp-Wave Ripples Support Spatial Memory , 2012, Science.

[3]  Mehdi Khamassi,et al.  Coherent Theta Oscillations and Reorganization of Spike Timing in the Hippocampal- Prefrontal Network upon Learning , 2010, Neuron.

[4]  J. Csicsvari,et al.  Oscillatory Coupling of Hippocampal Pyramidal Cells and Interneurons in the Behaving Rat , 1999, The Journal of Neuroscience.

[5]  Alon Rubin,et al.  Revealing neural correlates of behavior without behavioral measurements , 2019, Nature Communications.

[6]  Adam Johnson,et al.  Neural Ensembles in CA3 Transiently Encode Paths Forward of the Animal at a Decision Point , 2007, The Journal of Neuroscience.

[7]  Demetris K. Roumis,et al.  Coordinated Excitation and Inhibition of Prefrontal Ensembles during Awake Hippocampal Sharp-Wave Ripple Events , 2016, Neuron.

[8]  D. Dupret,et al.  Hippocampal Offline Reactivation Consolidates Recently Formed Cell Assembly Patterns during Sharp Wave-Ripples , 2016, Neuron.

[9]  J. B. Ranck,et al.  Studies on single neurons in dorsal hippocampal formation and septum in unrestrained rats. I. Behavioral correlates and firing repertoires. , 1973, Experimental neurology.

[10]  G. Buzsáki,et al.  Long-duration hippocampal sharp wave ripples improve memory , 2019, Science.

[11]  György Buzsáki,et al.  Routing of Hippocampal Ripples to Subcortical Structures via the Lateral Septum , 2019, Neuron.

[12]  Brendon O. Watson Cognitive and Physiologic Impacts of the Infraslow Oscillation , 2018, Front. Syst. Neurosci..

[13]  Delia Silva,et al.  Trajectory events across hippocampal place-cells require previous experience , 2015, Nature Neuroscience.

[14]  Margaret F. Carr,et al.  Hippocampal SWR Activity Predicts Correct Decisions during the Initial Learning of an Alternation Task , 2013, Neuron.

[15]  L. Colgin,et al.  Slow and Fast Gamma Rhythms Coordinate Different Spatial Coding Modes in Hippocampal Place Cells , 2014, Neuron.

[16]  Timothy E. J. Behrens,et al.  Human Replay Spontaneously Reorganizes Experience , 2019, Cell.

[17]  G. Buzsáki,et al.  Selective suppression of hippocampal ripples impairs spatial memory , 2009, Nature Neuroscience.

[18]  J. Csicsvari,et al.  Replay and Time Compression of Recurring Spike Sequences in the Hippocampus , 1999, The Journal of Neuroscience.

[19]  Mattias P. Karlsson,et al.  Awake replay of remote experiences in the hippocampus , 2009, Nature Neuroscience.

[20]  Marcelo G Mattar,et al.  Prioritized memory access explains planning and hippocampal replay , 2017, Nature Neuroscience.

[21]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[22]  M. Wilson,et al.  Temporally Structured Replay of Awake Hippocampal Ensemble Activity during Rapid Eye Movement Sleep , 2001, Neuron.

[23]  Caswell Barry,et al.  Coordinated grid and place cell replay during rest , 2016, Nature Neuroscience.

[24]  Matthew A. Wilson,et al.  Hippocampal Replay of Extended Experience , 2009, Neuron.

[25]  D. R. Euston,et al.  Fast-Forward Playback of Recent Memory Sequences in Prefrontal Cortex During Sleep , 2007, Science.

[26]  C. Pavlides,et al.  Influences of hippocampal place cell firing in the awake state on the activity of these cells during subsequent sleep episodes , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  D. Ji,et al.  Hippocampal awake replay in fear memory retrieval , 2017, Nature Neuroscience.

[28]  Wenbo Tang,et al.  Dynamics of Awake Hippocampal-Prefrontal Replay for Spatial Learning and Memory-Guided Decision Making , 2019, Neuron.

[29]  Matthijs A. A. van der Meer,et al.  Hippocampal Replay Is Not a Simple Function of Experience , 2010, Neuron.

[30]  Lacey J. Kitch,et al.  Long-term dynamics of CA1 hippocampal place codes , 2013, Nature Neuroscience.

[31]  Jozsef Csicsvari,et al.  Hippocampal Reactivation of Random Trajectories Resembling Brownian Diffusion , 2019, Neuron.

[32]  Richard S. Sutton,et al.  Dyna, an integrated architecture for learning, planning, and reacting , 1990, SGAR.

[33]  Hannah R. Joo,et al.  Dorsal and Ventral Hippocampal Sharp-Wave Ripples Activate Distinct Nucleus Accumbens Networks , 2019, Neuron.

[34]  B. McNaughton,et al.  Reactivation of Hippocampal Cell Assemblies: Effects of Behavioral State, Experience, and EEG Dynamics , 1999, The Journal of Neuroscience.

[35]  André A Fenton,et al.  Control of recollection by slow gamma dominating mid-frequency gamma in hippocampus CA1 , 2017, bioRxiv.

[36]  Jozsef Csicsvari,et al.  Assembly Responses of Hippocampal CA1 Place Cells Predict Learned Behavior in Goal-Directed Spatial Tasks on the Radial Eight-Arm Maze , 2019, Neuron.

[37]  B. McNaughton,et al.  Preferential Reactivation of Motivationally Relevant Information in the Ventral Striatum , 2008, The Journal of Neuroscience.

[38]  Zeb Kurth-Nelson,et al.  Fast Sequences of Non-spatial State Representations in Humans , 2016, Neuron.

[39]  Brad E. Pfeiffer,et al.  Reverse Replay of Hippocampal Place Cells Is Uniquely Modulated by Changing Reward , 2016, Neuron.

[40]  G. Buzsáki,et al.  Hippocampal CA1 pyramidal cells form functionally distinct sublayers , 2011, Nature Neuroscience.

[41]  C. Barry,et al.  Task Demands Predict a Dynamic Switch in the Content of Awake Hippocampal Replay , 2017, Neuron.

[42]  S. Molden,et al.  Accumulation of Hippocampal Place Fields at the Goal Location in an Annular Watermaze Task , 2001, The Journal of Neuroscience.

[43]  M. Wilson,et al.  Uncovering representations of sleep-associated hippocampal ensemble spike activity , 2016, Scientific Reports.

[44]  B. McNaughton,et al.  Replay of Neuronal Firing Sequences in Rat Hippocampus During Sleep Following Spatial Experience , 1996, Science.

[45]  David J Foster,et al.  Hippocampal Replay Captures the Unique Topological Structure of a Novel Environment , 2014, The Journal of Neuroscience.

[46]  Alyssa A. Carey,et al.  Reward revaluation biases hippocampal sequence content away from the preferred outcome , 2018, bioRxiv.

[47]  B. McNaughton,et al.  Experience-dependent, asymmetric expansion of hippocampal place fields. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[48]  M. Wilson,et al.  VTA neurons coordinate with the hippocampal reactivation of spatial experience , 2015, eLife.

[49]  Ian H. Stevenson,et al.  Modeling stimulus-dependent variability improves decoding of population neural responses , 2019, Journal of neural engineering.

[50]  Albert K. Lee,et al.  Memory of Sequential Experience in the Hippocampus during Slow Wave Sleep , 2002, Neuron.

[51]  A. David Redish,et al.  Hippocampal replay contributes to within session learning in a temporal difference reinforcement learning model , 2005, Neural Networks.

[52]  Kamran Diba,et al.  Hippocampal Reactivation Extends for Several Hours Following Novel Experience , 2018, The Journal of Neuroscience.

[53]  G. Buzsáki,et al.  Forward and reverse hippocampal place-cell sequences during ripples , 2007, Nature Neuroscience.

[54]  Matthew A. Wilson,et al.  Impaired Hippocampal Ripple-Associated Replay in a Mouse Model of Schizophrenia , 2013, Neuron.

[55]  D. Hassabis,et al.  Hippocampal place cells construct reward related sequences through unexplored space , 2015, eLife.

[56]  David J. Foster Replay Comes of Age. , 2017, Annual review of neuroscience.

[57]  Alyssa A. Carey,et al.  Optimizing for generalization in the decoding of internally generated activity in the hippocampus , 2016, bioRxiv.

[58]  R. Muller,et al.  Place cell discharge is extremely variable during individual passes of the rat through the firing field. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[59]  M. Moser,et al.  Understanding memory through hippocampal remapping , 2008, Trends in Neurosciences.

[60]  Kenneth D Harris,et al.  Stochastic transitions into silence cause noise correlations in cortical circuits , 2015, Proceedings of the National Academy of Sciences.

[61]  S. Romani,et al.  Theta sequences are essential for internally generated hippocampal firing fields , 2014, Nature Neuroscience.

[62]  M. Wilson,et al.  Disruption of ripple‐associated hippocampal activity during rest impairs spatial learning in the rat , 2009, Hippocampus.

[63]  A. Peyrache,et al.  On the methods for reactivation and replay analysis , 2020, Philosophical Transactions of the Royal Society of London. Biological Sciences.

[64]  Jadin C. Jackson,et al.  Network dynamics of hippocampal cell‐assemblies resemble multiple spatial maps within single tasks , 2007, Hippocampus.

[65]  Steven J. Middleton,et al.  Altered hippocampal replay is associated with memory impairment in mice heterozygous for the Scn2a gene , 2018, Nature Neuroscience.

[66]  Michaël Zugaro,et al.  Isolated cortical computations during delta waves support memory consolidation , 2019, Science.

[67]  Kamran Diba,et al.  Uncovering temporal structure in hippocampal output patterns , 2018, bioRxiv.

[68]  Elad Eban,et al.  A cortical–hippocampal–cortical loop of information processing during memory consolidation , 2016, Nature Neuroscience.

[69]  L. Frank,et al.  Behavioral/Systems/Cognitive Hippocampal Plasticity across Multiple Days of Exposure to Novel Environments , 2022 .

[70]  G. Buzsáki,et al.  Preconfigured, skewed distribution of firing rates in the hippocampus and entorhinal cortex. , 2013, Cell reports.

[71]  B L McNaughton,et al.  Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. , 1998, Journal of neurophysiology.

[72]  Andres D. Grosmark,et al.  Diversity in neural firing dynamics supports both rigid and learned hippocampal sequences , 2016, Science.

[73]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.

[74]  Yaniv Ziv,et al.  Hippocampal ensemble dynamics timestamp events in long-term memory , 2015, eLife.

[75]  Fabian Kloosterman,et al.  Post-learning Hippocampal Replay Selectively Reinforces Spatial Memory for Highly Rewarded Locations , 2019, Current Biology.

[76]  Kefei Liu,et al.  Strengthened Temporal Coordination within Pre-existing Sequential Cell Assemblies Supports Trajectory Replay , 2019, Neuron.

[77]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[78]  L. Frank,et al.  New Experiences Enhance Coordinated Neural Activity in the Hippocampus , 2008, Neuron.

[79]  J. O’Neill,et al.  The reorganization and reactivation of hippocampal maps predict spatial memory performance , 2010, Nature Neuroscience.

[80]  M. Khamassi,et al.  Replay of rule-learning related neural patterns in the prefrontal cortex during sleep , 2009, Nature Neuroscience.

[81]  Fraser T. Sparks,et al.  Neuronal code for extended time in the hippocampus , 2012, Proceedings of the National Academy of Sciences.

[82]  E N Brown,et al.  A Statistical Paradigm for Neural Spike Train Decoding Applied to Position Prediction from Ensemble Firing Patterns of Rat Hippocampal Place Cells , 1998, The Journal of Neuroscience.

[83]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[84]  G. Buzsáki Hippocampal sharp wave‐ripple: A cognitive biomarker for episodic memory and planning , 2015, Hippocampus.

[85]  Alex H. Williams,et al.  Unsupervised discovery of temporal sequences in high-dimensional datasets, with applications to neuroscience , 2018, bioRxiv.

[86]  L. Frank,et al.  Rewarded Outcomes Enhance Reactivation of Experience in the Hippocampus , 2009, Neuron.

[87]  George Dragoi,et al.  Distinct preplay of multiple novel spatial experiences in the rat , 2013, Proceedings of the National Academy of Sciences.

[88]  F. Kloosterman,et al.  Falcon: a highly flexible open-source software for closed-loop neuroscience , 2017, Journal of neural engineering.

[89]  D. Dupret,et al.  Dopaminergic neurons promote hippocampal reactivation and spatial memory persistence , 2014, Nature Neuroscience.

[90]  B. McNaughton,et al.  Hippocampus Leads Ventral Striatum in Replay of Place-Reward Information , 2009, PLoS biology.

[91]  John B. Trimper,et al.  Methodological Caveats in the Detection of Coordinated Replay between Place Cells and Grid Cells , 2017, Front. Syst. Neurosci..

[92]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[93]  Yazan N. Billeh,et al.  Low Activity Microstates During Sleep , 2016, bioRxiv.

[94]  G. Dragoi,et al.  Preplay of future place cell sequences by hippocampal cellular assemblies , 2011, Nature.