Coordinated hippocampal-entorhinal replay as structural inference

Constructing and maintaining useful representations of sensory experience is essential for reasoning about ones environment. High-level associative (topological) maps can be useful for efficient planning and are easily constructed from experience. Conversely, embedding new experiences within a metric structure allows them to be integrated with existing ones and novel associations to be implicitly inferred. Neurobiologically, the synaptic associations between hippocampal place cells and entorhinal grid cells are thought to represent associative and metric structures, respectively. Learning the place-grid cell associations can therefore be interpreted as learning a mapping between these two spaces. Here, we show how this map could be constructed by probabilistic message-passing through the hippocampal-entorhinal system, where messages are scheduled to reduce the propagation of redundant information. We propose that this offline inference corresponds to coordinated hippocampal-entorhinal replay during sharp wave ripples. Our results also suggest that the metric map will contain local distortions that reflect the inferred structure of the environment according to associative experience, explaining observed grid deformations.

[1]  Sebastian Thrun,et al.  Integrating Grid-Based and Topological Maps for Mobile Robot Navigation , 1996, AAAI/IAAI, Vol. 2.

[2]  RU Muller,et al.  The hippocampus as a cognitive graph , 1996, The Journal of general physiology.

[3]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[4]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[5]  Yoram Burakyy,et al.  Accurate Path Integration in Continuous Attractor Network Models of Grid Cells , 2009 .

[6]  I. Fiete,et al.  A Model of Grid Cell Development through Spatial Exploration and Spike Time-Dependent Plasticity , 2014, Neuron.

[7]  Terrence J. Sejnowski,et al.  Slow Feature Analysis: Unsupervised Learning of Invariances , 2002, Neural Computation.

[8]  Yoram Burak,et al.  Accurate Path Integration in Continuous Attractor Network Models of Grid Cells , 2008, PLoS Comput. Biol..

[9]  Bertalan K. Andrásfalvy,et al.  Location-dependent synaptic plasticity rules by dendritic spine cooperativity , 2016, Nature Communications.

[10]  Sebastian Thrun,et al.  Exploration in active learning , 1998 .

[11]  D. Marr,et al.  Representation and recognition of the movements of shapes , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[12]  Caswell Barry,et al.  Coordinated grid and place cell replay during rest , 2016, Nature Neuroscience.

[13]  B. McNaughton,et al.  Replay of Neuronal Firing Sequences in Rat Hippocampus During Sleep Following Spatial Experience , 1996, Science.

[14]  Martin Stemmler,et al.  Optimal Population Codes for Space: Grid Cells Outperform Place Cells , 2012, Neural Computation.

[15]  Judea Pearl,et al.  Reverend Bayes on Inference Engines: A Distributed Hierarchical Approach , 1982, AAAI.

[16]  Jozsef Csicsvari,et al.  Hippocampal Reactivation of Random Trajectories Resembling Brownian Diffusion , 2019, Neuron.

[17]  Razvan Pascanu,et al.  Vector-based navigation using grid-like representations in artificial agents , 2018, Nature.

[18]  G. Buzsáki,et al.  Cellular bases of hippocampal EEG in the behaving rat , 1983, Brain Research Reviews.

[19]  M. Botvinick,et al.  The hippocampus as a predictive map , 2016 .

[20]  Thomas J. Wills,et al.  Long-term plasticity in hippocampal place-cell representation of environmental geometry , 2002, Nature.

[21]  Edvard I. Moser,et al.  Grid-Cell Distortion along Geometric Borders , 2019, Current Biology.

[22]  Matthew A. Wilson,et al.  Hippocampal Replay of Extended Experience , 2009, Neuron.

[23]  Surya Ganguli,et al.  Environmental Boundaries as an Error Correction Mechanism for Grid Cells , 2015, Neuron.

[24]  Timothy Edward John Behrens,et al.  Generalisation of structural knowledge in the Hippocampal-Entorhinal system , 2018, NeurIPS.

[25]  J. Prentice,et al.  The Sense of Place: Grid Cells in the Brain and the Transcendental Number e , 2013, 1304.0031.

[26]  S. Molden,et al.  Accumulation of Hippocampal Place Fields at the Goal Location in an Annular Watermaze Task , 2001, The Journal of Neuroscience.

[27]  Edvard I. Moser,et al.  Shearing-induced asymmetry in entorhinal grid cells , 2015, Nature.

[28]  Stephen Grossberg,et al.  Space, time and learning in the hippocampus: How fine spatial and temporal scales are expanded into population codes for behavioral control , 2007, Neural Networks.

[29]  Evangelos E. Milios,et al.  Globally Consistent Range Scan Alignment for Environment Mapping , 1997, Auton. Robots.

[30]  Nace L. Golding,et al.  Dendritic spikes as a mechanism for cooperative long-term potentiation , 2002, Nature.

[31]  Mark C. Fuhs,et al.  A Spin Glass Model of Path Integration in Rat Medial Entorhinal Cortex , 2006, The Journal of Neuroscience.

[32]  J. O’Keefe,et al.  Neuronal computations underlying the firing of place cells and their role in navigation , 1996, Hippocampus.

[33]  Gordon Wyeth,et al.  Mapping a Suburb With a Single Camera Using a Biologically Inspired SLAM System , 2008, IEEE Transactions on Robotics.

[34]  Raymond J Dolan,et al.  A map of abstract relational knowledge in the human hippocampal–entorhinal cortex , 2017, eLife.

[35]  Zeb Kurth-Nelson,et al.  Fast Sequences of Non-spatial State Representations in Humans , 2016, Neuron.

[36]  Ila R Fiete,et al.  What Grid Cells Convey about Rat Location , 2008, The Journal of Neuroscience.

[37]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[38]  J. O’Keefe,et al.  Geometric determinants of the place fields of hippocampal neurons , 1996, Nature.

[39]  J. O’Keefe,et al.  Modeling place fields in terms of the cortical inputs to the hippocampus , 2000, Hippocampus.

[40]  J. O’Keefe.  Place units in the hippocampus of the freely moving rat , 1976, Experimental Neurology.

[41]  Marcelo G Mattar,et al.  Prioritized memory access explains planning and hippocampal replay , 2017, Nature Neuroscience.

[42]  Surya Ganguli,et al.  Emergent elasticity in the neural code for space , 2018, Proceedings of the National Academy of Sciences.

[43]  Ian McGraw,et al.  Residual Belief Propagation: Informed Scheduling for Asynchronous Message Passing , 2006, UAI.

[44]  Charlotte N. Boccara,et al.  Superficial layers of the medial entorhinal cortex replay independently of the hippocampus , 2017, Science.

[45]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[46]  E. Tolman.  Cognitive maps in rats and men. , 1948, Psychological review.

[47]  G. Buzsáki,et al.  Forward and reverse hippocampal place-cell sequences during ripples , 2007, Nature Neuroscience.

[48]  Mattias P. Karlsson,et al.  Constant Sub-second Cycling between Representations of Possible Futures in the Hippocampus , 2019, Cell.

[49]  Gordon Wyeth,et al.  RatSLAM: a hippocampal model for simultaneous localization and mapping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[50]  Samuel Gershman,et al.  Design Principles of the Hippocampal Cognitive Map , 2014, NIPS.

[51]  Susumu Tonegawa,et al.  Direct Medial Entorhinal Cortex Input to Hippocampal CA1 Is Crucial for Extended Quiet Awake Replay , 2017, Neuron.

[52]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[53]  Brad E. Pfeiffer,et al.  Autoassociative dynamics in the generation of sequences of hippocampal place cells , 2015, Science.

[54]  K. Jeffery,et al.  Experience-dependent rescaling of entorhinal grids , 2007, Nature Neuroscience.

[55]  M. Stemmler,et al.  Probable nature of higher-dimensional symmetries underlying mammalian grid-cell activity patterns , 2014, eLife.

[56]  Neil Burgess,et al.  Forward and Backward Inference in Spatial Cognition , 2013, PLoS Comput. Biol..

[57]  A. Holtmaat,et al.  Sensory-evoked LTP driven by dendritic plateau potentials in vivo , 2014, Nature.

[58]  Sebastian Thrun,et al.  The Graph SLAM Algorithm with Applications to Large-Scale Mapping of Urban Structures , 2006, Int. J. Robotics Res..

[59]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.