Modeling of grid cell activity demonstrates in vivo entorhinal ‘look-ahead’ properties

Recent in vivo data show ensemble activity in medial entorhinal neurons that demonstrates 'look-ahead' activity, decoding spatially to reward locations ahead of a rat deliberating at a choice point while performing a cued, appetitive T-Maze task. To model this experiment's look-ahead results, we adapted previous work that produced a model where scans along equally probable directions activated place cells, associated reward cells, grid cells, and persistent spiking cells along those trajectories. Such look-ahead activity may be a function of animals performing scans to reduce ambiguity while making decisions. In our updated model, look-ahead scans at the choice point can activate goal-associated reward and place cells, which indicate the direction the virtual rat should turn at the choice point. Hebbian associations between stimulus and reward cell layers are learned during training trials, and the reward and place layers are then used during testing to retrieve goal-associated cells based on cue presentation. This system creates representations of location and associated reward information based on only two inputs of heading and speed information which activate grid cell and place cell layers. We present spatial and temporal decoding of grid cell ensembles as rats are tested with perfect and imperfect stimuli. Here, the virtual rat reliably learns goal locations through training sessions and performs both biased and unbiased look-ahead scans at the choice point. Spatial and temporal decoding of simulated medial entorhinal activity indicates that ensembles are representing forward reward locations when the animal deliberates at the choice point, emulating in vivo results.

[1]  Torkel Hafting,et al.  Conjunctive Representation of Position, Direction, and Velocity in Entorhinal Cortex , 2006, Science.

[2]  M. Wilson,et al.  Temporally Structured Replay of Awake Hippocampal Ensemble Activity during Rapid Eye Movement Sleep , 2001, Neuron.

[3]  A. Adams,et al.  The projection of the rat's visual field on the cerebral cortex. , 1968, Quarterly journal of experimental physiology and cognate medical sciences.

[4]  N. Burgess Grid cells and theta as oscillatory interference: Theory and predictions , 2008, Hippocampus.

[5]  M. Wilson,et al.  Theta Rhythms Coordinate Hippocampal–Prefrontal Interactions in a Spatial Memory Task , 2005, PLoS biology.

[6]  J. O’Keefe,et al.  An oscillatory interference model of grid cell firing , 2007, Hippocampus.

[7]  M. Fyhn,et al.  Spatial Representation in the Entorhinal Cortex , 2004, Science.

[8]  K. F. Muenzinger Vicarious Trial and Error at a Point of Choice: I. A General Survey of its Relation to Learning Efficiency , 1938 .

[9]  Eric A. Zilli,et al.  Models of Grid Cell Spatial Firing Published 2005–2011 , 2012, Front. Neural Circuits.

[10]  M. Hasselmo,et al.  Reduced spiking in entorhinal cortex during the delay period of a cued spatial response task. , 2012, Learning & memory.

[11]  J O'Keefe,et al.  Robotic and neuronal simulation of the hippocampus and rat navigation. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[12]  M. Wilson,et al.  Trajectory Encoding in the Hippocampus and Entorhinal Cortex , 2000, Neuron.

[13]  Michael E. Hasselmo,et al.  Hippocampal Mechanisms for the Context-dependent Retrieval of Episodes Action Reward Place (state) , 2022 .

[14]  B. McNaughton,et al.  Memory trace reactivation in hippocampal and neocortical neuronal ensembles , 2000, Current Opinion in Neurobiology.

[15]  Matthijs A. A. van der Meer,et al.  Hippocampal Replay Is Not a Simple Function of Experience , 2010, Neuron.

[16]  J. O’Keefe,et al.  Dual phase and rate coding in hippocampal place cells: Theoretical significance and relationship to entorhinal grid cells , 2005, Hippocampus.

[17]  Z. Rossetti,et al.  Noradrenaline and Dopamine Elevations in the Rat Prefrontal Cortex in Spatial Working Memory , 2005, The Journal of Neuroscience.

[18]  M. Wilson,et al.  Phase precession of medial prefrontal cortical activity relative to the hippocampal theta rhythm , 2005, Hippocampus.

[19]  David N. Lee,et al.  Plummeting gannets: a paradigm of ecological optics , 1981, Nature.

[20]  廣瀬雄一,et al.  Neuroscience , 2019, Workplace Attachments.

[21]  J. O’Keefe,et al.  Geometric determinants of the place fields of hippocampal neurons , 1996, Nature.

[22]  Matthijs A. A. van der Meer,et al.  Exploring the role of context‐dependent hippocampal activity in spatial alternation behavior , 2007, Hippocampus.

[23]  Eric A. Zilli,et al.  Medial prefrontal cortex cells show dynamic modulation with the hippocampal theta rhythm dependent on behavior , 2005, Hippocampus.

[24]  Michael E. Hasselmo,et al.  Modeling Boundary Vector Cell Firing Given Optic Flow as a Cue , 2012, PLoS Comput. Biol..

[25]  Michael E Hasselmo,et al.  Head direction cells in the postsubiculum do not show replay of prior waking sequences during sleep , 2012, Hippocampus.

[26]  R U Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  André A. Fenton,et al.  Linear Look-Ahead in Conjunctive Cells: An Entorhinal Mechanism for Vector-Based Navigation , 2012, Front. Neural Circuits.

[28]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[29]  D. Hu,et al.  A simple test of the vicarious trial-and-error hypothesis of hippocampal function. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[30]  M. Moser,et al.  Spatial Memory in the Rat Requires the Dorsolateral Band of the Entorhinal Cortex , 2005, Neuron.

[31]  Matthijs A. A. van der Meer,et al.  Theta Phase Precession in Rat Ventral Striatum Links Place and Reward Information , 2011, The Journal of Neuroscience.

[32]  Jonathan R. Whitlock,et al.  Fragmentation of grid cell maps in a multicompartment environment , 2009, Nature Neuroscience.

[33]  J. Taube Head direction cells recorded in the anterior thalamic nuclei of freely moving rats , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  M. Witter,et al.  What Does the Anatomical Organization of the Entorhinal Cortex Tell Us? , 2008, Neural plasticity.

[35]  David S. Touretzky,et al.  The Role of the Hippocampus in Solving the Morris Water Maze , 1998, Neural Computation.

[36]  Daniel Bendor,et al.  Biasing the content of hippocampal replay during sleep , 2012, Nature Neuroscience.

[37]  Michael E. Hasselmo,et al.  Modeling the influence of optic flow on grid cell firing in the absence of other cues1 , 2012, Journal of Computational Neuroscience.

[38]  Michael E. Hasselmo,et al.  Decoding Movement Trajectories Through a T-Maze Using Point Process Filters Applied to Place Field Data from Rat Hippocampal Region CA1 , 2009, Neural Computation.

[39]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[40]  B L McNaughton,et al.  Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. , 1998, Journal of neurophysiology.

[41]  Bruno Poucet,et al.  Goal-Related Activity in Hippocampal Place Cells , 2007, The Journal of Neuroscience.

[42]  Mattias P. Karlsson,et al.  Awake replay of remote experiences in the hippocampus , 2009, Nature Neuroscience.

[43]  J. Knierim,et al.  Cohesiveness of spatial and directional representations recorded from neural ensembles in the anterior thalamus, parasubiculum, medial entorhinal cortex, and hippocampus , 2007, Hippocampus.

[44]  Howard Eichenbaum,et al.  Disambiguation of Overlapping Experiences by Neurons in the Medial Entorhinal Cortex , 2007, The Journal of Neuroscience.

[45]  H. Eichenbaum,et al.  Hippocampal Neurons Encode Information about Different Types of Memory Episodes Occurring in the Same Location , 2000, Neuron.

[46]  Albert K. Lee,et al.  Memory of Sequential Experience in the Hippocampus during Slow Wave Sleep , 2002, Neuron.

[47]  E. Save,et al.  Coding for spatial goals in the prelimbic/infralimbic area of the rat frontal cortex. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[48]  M. Hasselmo Grid cell mechanisms and function: Contributions of entorhinal persistent spiking and phase resetting , 2008, Hippocampus.

[49]  Eric A. Zilli,et al.  Modeling the role of working memory and episodic memory in behavioral tasks , 2008, Hippocampus.

[50]  Chao Sun,et al.  Motion states extraction with optical flow for rat-robot automatic navigation , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[51]  Aline Villavicencio,et al.  Alternating predictive and short‐term memory modes of entorhinal grid cells , 2012, Hippocampus.

[52]  M. Shapiro,et al.  Prospective and Retrospective Memory Coding in the Hippocampus , 2003, Neuron.

[53]  Matthijs A. A. van der Meer,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience Covert Expectation-of-reward in Rat Ventral Striatum at Decision Points , 2022 .

[54]  G. Einevoll,et al.  From grid cells to place cells: A mathematical model , 2006, Hippocampus.

[55]  R. Morris,et al.  Place navigation impaired in rats with hippocampal lesions , 1982, Nature.

[56]  Adam Johnson,et al.  Neural Ensembles in CA3 Transiently Encode Paths Forward of the Animal at a Decision Point , 2007, The Journal of Neuroscience.

[57]  Matthijs A. A. van der Meer,et al.  Expectancies in Decision Making, Reinforcement Learning, and Ventral Striatum , 2009, Frontiers in neuroscience.

[58]  Michael E Hasselmo,et al.  Medial entorhinal grid cells and head direction cells rotate with a T-maze more often during less recently experienced rotations. , 2014, Cerebral cortex.

[59]  R. Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. II. Effects of environmental manipulations , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[60]  M. Hasselmo,et al.  Temporally structured replay of neural activity in a model of entorhinal cortex, hippocampus and postsubiculum , 2008, The European journal of neuroscience.

[61]  Mark P. Brandon,et al.  Reduction of Theta Rhythm Dissociates Grid Cell Spatial Periodicity from Directional Tuning , 2011, Science.

[62]  H. T. Blair,et al.  Conversion of a phase‐ to a rate‐coded position signal by a three‐stage model of theta cells, grid cells, and place cells , 2008, Hippocampus.

[63]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[64]  Bruce L. McNaughton,et al.  Path integration and the neural basis of the 'cognitive map' , 2006, Nature Reviews Neuroscience.

[65]  Felipe A. Perdomo,et al.  Contents lists available at ScienceDirect , 2011 .

[66]  Uğur M Erdem,et al.  A goal‐directed spatial navigation model using forward trajectory planning based on grid cells , 2012, The European journal of neuroscience.

[67]  P. Verschure,et al.  A biologically based model for the integration of sensory–motor contingencies in rules and plans: A prefrontal cortex based extension of the Distributed Adaptive Control architecture , 2011, Brain Research Bulletin.