Using Grid Cells for Navigation

Summary Mammals are able to navigate to hidden goal locations by direct routes that may traverse previously unvisited terrain. Empirical evidence suggests that this “vector navigation” relies on an internal representation of space provided by the hippocampal formation. The periodic spatial firing patterns of grid cells in the hippocampal formation offer a compact combinatorial code for location within large-scale space. Here, we consider the computational problem of how to determine the vector between start and goal locations encoded by the firing of grid cells when this vector may be much longer than the largest grid scale. First, we present an algorithmic solution to the problem, inspired by the Fourier shift theorem. Second, we describe several potential neural network implementations of this solution that combine efficiency of search and biological plausibility. Finally, we discuss the empirical predictions of these implementations and their relationship to the anatomy and electrophysiology of the hippocampal formation.

[1]  R. Morris,et al.  Place navigation impaired in rats with hippocampal lesions , 1982, Nature.

[2]  M. Häusser,et al.  Dendritic Discrimination of Temporal Input Sequences in Cortical Neurons , 2010, Science.

[3]  J. O’Keefe,et al.  Neural Representations of Location Composed of Spatially Periodic Bands , 2012, Science.

[4]  D. Hassabis,et al.  Hippocampal place cells construct reward related sequences through unexplored space , 2015, eLife.

[5]  Richard S. J. Frackowiak,et al.  Knowing where and getting there: a human navigation network. , 1998, Science.

[6]  Marco Idiart,et al.  A Second Function of Gamma Frequency Oscillations: An E%-Max Winner-Take-All Mechanism Selects Which Cells Fire , 2009, The Journal of Neuroscience.

[7]  J. Pearce,et al.  Absence of Overshadowing and Blocking between Landmarks and the Geometric Cues Provided by the Shape of a Test Arena , 2003, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[8]  K. Jeffery,et al.  Grid Cells Form a Global Representation of Connected Environments , 2015, Current Biology.

[9]  R. Muller,et al.  Place cell discharge is extremely variable during individual passes of the rat through the firing field. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Sean M Montgomery,et al.  Relationships between Hippocampal Sharp Waves, Ripples, and Fast Gamma Oscillation: Influence of Dentate and Entorhinal Cortical Activity , 2011, The Journal of Neuroscience.

[11]  Charlotte N. Boccara,et al.  Grid cells in pre- and parasubiculum , 2010, Nature Neuroscience.

[12]  J. O’Keefe,et al.  Neuronal computations underlying the firing of place cells and their role in navigation , 1996, Hippocampus.

[13]  Michael E. Hasselmo,et al.  Grid cell firing properties vary as a function of theta phase locking preferences in the rat medial entorhinal cortex , 2014, Front. Syst. Neurosci..

[14]  Hong Sun,et al.  A neural-like network approach to residue-to-decimal conversion , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[15]  Stephen Grossberg,et al.  Space, time and learning in the hippocampus: How fine spatial and temporal scales are expanded into population codes for behavioral control , 2007, Neural Networks.

[16]  J. Lisman,et al.  Position reconstruction from an ensemble of hippocampal place cells: contribution of theta phase coding. , 2000, Journal of neurophysiology.

[17]  Yoram Burakyy,et al.  Accurate Path Integration in Continuous Attractor Network Models of Grid Cells , 2009 .

[18]  R. Passingham The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[19]  B. McNaughton,et al.  Spatial selectivity of unit activity in the hippocampal granular layer , 1993, Hippocampus.

[20]  Ehren L. Newman,et al.  Phase coding by grid cells in unconstrained environments: two‐dimensional phase precession , 2013, The European journal of neuroscience.

[21]  M. Stemmler,et al.  Multiscale codes in the nervous system: the problem of noise correlations and the ambiguity of periodic scales. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Michael Recce,et al.  A model of hippocampal function , 1994, Neural Networks.

[23]  R. Muller,et al.  The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  Uğur M Erdem,et al.  A goal‐directed spatial navigation model using forward trajectory planning based on grid cells , 2012, The European journal of neuroscience.

[25]  J. Hodges Memory, Amnesia and the Hippocampal System , 1995 .

[26]  Ila Fiete,et al.  Grid cells generate an analog error-correcting code for singularly precise neural computation , 2011, Nature Neuroscience.

[27]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.

[28]  Tomaso Poggio,et al.  From Understanding Computation to Understanding Neural Circuitry , 1976 .

[29]  H. T. Blair,et al.  Cosine Directional Tuning of Theta Cell Burst Frequencies: Evidence for Spatial Coding by Oscillatory Interference , 2011, The Journal of Neuroscience.

[30]  R U Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  André A. Fenton,et al.  Linear Look-Ahead in Conjunctive Cells: An Entorhinal Mechanism for Vector-Based Navigation , 2012, Front. Neural Circuits.

[32]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[33]  J. O’Keefe,et al.  Grid cell firing patterns signal environmental novelty by expansion , 2012, Proceedings of the National Academy of Sciences.

[34]  J. O’Keefe,et al.  Dual phase and rate coding in hippocampal place cells: Theoretical significance and relationship to entorhinal grid cells , 2005, Hippocampus.

[35]  P. Best,et al.  Place cells and silent cells in the hippocampus of freely-behaving rats , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[36]  D. Wilkin,et al.  Neuron , 2001, Brain Research.

[37]  R. Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. II. Effects of environmental manipulations , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  Armin Brandt,et al.  Neural Activity in Human Hippocampal Formation Reveals the Spatial Context of Retrieved Memories , 2013, Science.

[39]  Jonathan R. Whitlock,et al.  Fragmentation of grid cell maps in a multicompartment environment , 2009, Nature Neuroscience.

[40]  H. T. Blair,et al.  Neural network modeling of the hippocampal formation spatial signals and their possible role in navigation: A modular approach , 1996, Hippocampus.

[41]  R. Knight,et al.  The Hippocampus and Entorhinal Cortex Encode the Path and Euclidean Distances to Goals during Navigation , 2014, Current Biology.

[42]  T. H. Bullock,et al.  Coherence of compound field potentials reveals discontinuities in the CA1-subiculum of the hippocampus in freely-moving rats , 1990, Neuroscience.

[43]  D. Johnston,et al.  Temporal synchrony and gamma to theta power conversion in the dendrites of CA1 pyramidal neurons , 2013, Nature Neuroscience.

[44]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.

[45]  Simon M Stringer,et al.  Entorhinal cortex grid cells can map to hippocampal place cells by competitive learning , 2006, Network.

[46]  Matthew A. Wilson,et al.  Hippocampal Replay of Extended Experience , 2009, Neuron.

[47]  L A JEFFRESS,et al.  A place theory of sound localization. , 1948, Journal of comparative and physiological psychology.

[48]  Neil Burgess,et al.  What do grid cells contribute to place cell firing? , 2014, Trends in Neurosciences.

[49]  I. Whishaw,et al.  Fundamentals of Human Neuropsychology , 1995 .

[50]  Chris Eliasmith,et al.  A Controlled Attractor Network Model of Path Integration in the Rat , 2005, Journal of Computational Neuroscience.

[51]  J. D. McGaugh,et al.  Inactivation of Hippocampus or Caudate Nucleus with Lidocaine Differentially Affects Expression of Place and Response Learning , 1996, Neurobiology of Learning and Memory.

[52]  Mark C. Fuhs,et al.  A Spin Glass Model of Path Integration in Rat Medial Entorhinal Cortex , 2006, The Journal of Neuroscience.

[53]  Martin Stemmler,et al.  Optimal Population Codes for Space: Grid Cells Outperform Place Cells , 2012, Neural Computation.

[54]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[55]  Péter Érdi,et al.  Extraction of distance information from the activity of entorhinal grid cells: a model study , 2009, 2009 International Joint Conference on Neural Networks.

[56]  J. Keith,et al.  Latent place learning in a novel environment and the influences of prior training in rats , 1988, Psychobiology.

[57]  Neil Burgess,et al.  Distinct error-correcting and incidental learning of location relative to landmarks and boundaries , 2008, Proceedings of the National Academy of Sciences.

[58]  R. Kempter,et al.  Grid cells in rat entorhinal cortex encode physical space with independent firing fields and phase precession at the single-trial level , 2012, Proceedings of the National Academy of Sciences.

[59]  L. Squire,et al.  The medial temporal lobe memory system , 1991, Science.

[60]  S. Dehaene,et al.  The Number Sense: How the Mind Creates Mathematics. , 1998 .

[61]  Bruce L. McNaughton,et al.  Path integration and the neural basis of the 'cognitive map' , 2006, Nature Reviews Neuroscience.

[62]  E. Save,et al.  Evidence for entorhinal and parietal cortices involvement in path integration in the rat , 2004, Experimental Brain Research.

[63]  S M Kosslyn,et al.  Visual images preserve metric spatial information: evidence from studies of image scanning. , 1978, Journal of experimental psychology. Human perception and performance.

[64]  Bendig Aw Latent learning in a water maze. , 1952 .

[65]  G. Buzsáki,et al.  High-Frequency Oscillations in the Output Networks of the Hippocampal–Entorhinal Axis of the Freely Behaving Rat , 1996, The Journal of Neuroscience.

[66]  Katherine R. Sherrill,et al.  Hippocampus and Retrosplenial Cortex Combine Path Integration Signals for Successful Navigation , 2013, The Journal of Neuroscience.

[67]  E. Save,et al.  Distinct roles of medial and lateral entorhinal cortex in spatial cognition. , 2013, Cerebral cortex.

[68]  Edvard I. Moser,et al.  Shearing-induced asymmetry in entorhinal grid cells , 2015, Nature.

[69]  J. Prentice,et al.  A principle of economy predicts the functional architecture of grid cells , 2013, eLife.

[70]  A. Pickering,et al.  Spatial memory deficits in patients with unilateral damage to the right hippocampal formation , 1997, Neuropsychologia.

[71]  T. Hafting,et al.  Hippocampus-independent phase precession in entorhinal grid cells , 2008, Nature.

[72]  Stephen Grossberg,et al.  Grid cell hexagonal patterns formed by fast self‐organized learning within entorhinal cortex , 2012, Hippocampus.

[73]  M. Hasselmo Grid cell mechanisms and function: Contributions of entorhinal persistent spiking and phase resetting , 2008, Hippocampus.

[74]  Neil Burgess,et al.  Optimal configurations of spatial scale for grid cell firing under noise and uncertainty , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[75]  M. London,et al.  Dendritic computation. , 2005, Annual review of neuroscience.

[76]  Torkel Hafting,et al.  Conjunctive Representation of Position, Direction, and Velocity in Entorhinal Cortex , 2006, Science.

[77]  Caswell Barry,et al.  Grid cell symmetry is shaped by environmental geometry , 2015, Nature.

[78]  S. Becker,et al.  Remembering the past and imagining the future: a neural model of spatial memory and imagery. , 2007, Psychological review.

[79]  A W BENDIG Latent learning in a water maze. , 1952, Journal of experimental psychology.

[80]  M. Moser,et al.  Spatial Memory in the Rat Requires the Dorsolateral Band of the Entorhinal Cortex , 2005, Neuron.

[81]  J. Prentice,et al.  The Sense of Place: Grid Cells in the Brain and the Transcendental Number e , 2013, 1304.0031.

[82]  P. Gregory,et al.  February , 1890, The Hospital.

[83]  R. Morris,et al.  Delay‐dependent impairment of a matching‐to‐place task with chronic and intrahippocampal infusion of the NMDA‐antagonist D‐AP5 , 1999, Hippocampus.

[84]  P. E. Sharp,et al.  Simulation of spatial learning in the Morris water maze by a neural network model of the hippocampal formation and nucleus accumbens , 1995, Hippocampus.

[85]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[86]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[87]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[88]  David J. Foster,et al.  A model of hippocampally dependent navigation, using the temporal difference learning rule , 2000, Hippocampus.

[89]  E. Maguire,et al.  The Well-Worn Route and the Path Less Traveled Distinct Neural Bases of Route Following and Wayfinding in Humans , 2003, Neuron.

[90]  William W Lytton,et al.  Unmasking the CA1 Ensemble Place Code by Exposures to Small and Large Environments: More Place Cells and Multiple, Irregularly Arranged, and Expanded Place Fields in the Larger Space , 2008, The Journal of Neuroscience.

[91]  T. Verguts,et al.  Beyond the mental number line: A neural network model of number–space interactions , 2010, Cognitive Psychology.

[92]  Peter Dayan,et al.  Navigating Through Temporal Difference , 1990, NIPS.

[93]  T. Hafting,et al.  Finite Scale of Spatial Representation in the Hippocampus , 2008, Science.

[94]  M. Petrides,et al.  Cognitive Strategies Dependent on the Hippocampus and Caudate Nucleus in Human Navigation: Variability and Change with Practice , 2003, The Journal of Neuroscience.

[95]  William D. Richardson,et al.  Motor skill learning requires active central myelination , 2014, Science.

[96]  Xiang Ji,et al.  Does the entorhinal cortex use the Fourier transform? , 2013, Front. Comput. Neurosci..

[97]  M. Hasselmo,et al.  Graded persistent activity in entorhinal cortex neurons , 2002, Nature.

[98]  John L Kubie,et al.  Heading‐vector navigation based on head‐direction cells and path integration , 2009, Hippocampus.

[99]  Cecile Masson,et al.  Decoding the Grid Cells for Metric Navigation Using the Residue Numeral System , 2011 .

[100]  L. Nadel,et al.  The Hippocampus as a Cognitive Map , 1978 .

[101]  L. F. Abbott,et al.  A Model of Spatial Map Formation in the Hippocampus of the Rat , 1999, Neural Computation.

[102]  May-Britt Moser,et al.  The entorhinal grid map is discretized , 2012, Nature.

[103]  A. Alonso,et al.  Muscarinic modulation of the oscillatory and repetitive firing properties of entorhinal cortex layer II neurons. , 1997, Journal of neurophysiology.

[104]  G. Einevoll,et al.  From grid cells to place cells: A mathematical model , 2006, Hippocampus.

[105]  J. O’Keefe,et al.  An oscillatory interference model of grid cell firing , 2007, Hippocampus.

[106]  P. Day The Organisation of Learning , 1977 .

[107]  Ila R Fiete,et al.  What Grid Cells Convey about Rat Location , 2008, The Journal of Neuroscience.

[108]  John O'Keefe,et al.  Independent rate and temporal coding in hippocampal pyramidal cells , 2003, Nature.

[109]  C. Barry,et al.  Theta phase precession of grid and place cell firing in open environments , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[110]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[111]  E. Maguire,et al.  The Human Hippocampus and Spatial and Episodic Memory , 2002, Neuron.

[112]  Bartlett W. Mel Synaptic integration in an excitable dendritic tree. , 1993, Journal of neurophysiology.

[113]  K. Jeffery,et al.  Experience-dependent rescaling of entorhinal grids , 2007, Nature Neuroscience.

[114]  J. O’Keefe,et al.  Hippocampal place units in the freely moving rat: Why they fire where they fire , 1978, Experimental Brain Research.

[115]  Neil Burgess,et al.  Controlling Phase Noise in Oscillatory Interference Models of Grid Cell Firing , 2014, The Journal of Neuroscience.

[116]  N. Burgess Grid cells and theta as oscillatory interference: Theory and predictions , 2008, Hippocampus.

[117]  M. Hasselmo,et al.  A biologically inspired hierarchical goal directed navigation model , 2014, Journal of Physiology-Paris.

[118]  Paul F. M. J. Verschure,et al.  A Model of Grid Cells Based on a Twisted Torus Topology , 2007, Int. J. Neural Syst..

[119]  D S Touretzky,et al.  Theory of rodent navigation based on interacting representations of space , 1996, Hippocampus.

[120]  P. Dudchenko The hippocampus as a cognitive map , 2010 .