Solving Navigational Uncertainty Using Grid Cells on Robots

To successfully navigate their habitats, many mammals use a combination of two mechanisms, path integration and calibration using landmarks, which together enable them to estimate their location and orientation, or pose. In large natural environments, both these mechanisms are characterized by uncertainty: the path integration process is subject to the accumulation of error, while landmark calibration is limited by perceptual ambiguity. It remains unclear how animals form coherent spatial representations in the presence of such uncertainty. Navigation research using robots has determined that uncertainty can be effectively addressed by maintaining multiple probabilistic estimates of a robot's pose. Here we show how conjunctive grid cells in dorsocaudal medial entorhinal cortex (dMEC) may maintain multiple estimates of pose using a brain-based robot navigation system known as RatSLAM. Based both on rodent spatially-responsive cells and functional engineering principles, the cells at the core of the RatSLAM computational model have similar characteristics to rodent grid cells, which we demonstrate by replicating the seminal Moser experiments. We apply the RatSLAM model to a new experimental paradigm designed to examine the responses of a robot or animal in the presence of perceptual ambiguity. Our computational approach enables us to observe short-term population coding of multiple location hypotheses, a phenomenon which would not be easily observable in rodent recordings. We present behavioral and neural evidence demonstrating that the conjunctive grid cells maintain and propagate multiple estimates of pose, enabling the correct pose estimate to be resolved over time even without uniquely identifying cues. While recent research has focused on the grid-like firing characteristics, accuracy and representational capacity of grid cells, our results identify a possible critical and unique role for conjunctive grid cells in filtering sensory uncertainty. We anticipate our study to be a starting point for animal experiments that test navigation in perceptually ambiguous environments.

[1]  Gordon Wyeth,et al.  Spatial cognition for robots , 2009, IEEE Robotics & Automation Magazine.

[2]  Michael Milford Robot Navigation from Nature - Simultaneous Localisation, Mapping, and Path Planning based on Hippocampal Models , 2008, Springer Tracts in Advanced Robotics.

[3]  Paul F. M. J. Verschure,et al.  A Model of Grid Cells Based on a Twisted Torus Topology , 2007, Int. J. Neural Syst..

[4]  R U Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  M. V. Velzen,et al.  Self-organizing maps , 2007 .

[6]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[7]  Gordon Wyeth,et al.  Spatial Cognition for Robots Spatial Cognition for Robots Robot Navigation from Biological Inspiration , 2009 .

[8]  Charles J. Amlaner,et al.  A Handbook on Biotelemetry and Radio Tracking , 1980 .

[9]  Torkel Hafting,et al.  Conjunctive Representation of Position, Direction, and Velocity in Entorhinal Cortex , 2006, Science.

[10]  Mark C. Fuhs,et al.  A Spin Glass Model of Path Integration in Rat Medial Entorhinal Cortex , 2006, The Journal of Neuroscience.

[11]  K. D. Taylor,et al.  Radio Tracking of Rattus norvegicus on Farms , 1980 .

[12]  A. Thiele,et al.  Neuronal synchrony does not correlate with motion coherence in cortical area MT , 2003, Nature.

[13]  D. Amaral,et al.  Neurons, numbers and the hippocampal network. , 1990, Progress in brain research.

[14]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[15]  Michael A. Recht THE BIOLOGY OF DOMESTIC RATS: TELEMETRY YIELDS INSIGHTS FOR PEST CON¬TROL , 1988 .

[16]  H. T. Blair,et al.  Conversion of a phase‐ to a rate‐coded position signal by a three‐stage model of theta cells, grid cells, and place cells , 2008, Hippocampus.

[17]  Yoram Burak,et al.  Do We Understand the Emergent Dynamics of Grid Cell Activity? , 2006, The Journal of Neuroscience.

[18]  J. O’Keefe,et al.  Hippocampal place units in the freely moving rat: Why they fire where they fire , 1978, Experimental Brain Research.

[19]  Gordon Wyeth,et al.  RatSLAM: a hippocampal model for simultaneous localization and mapping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[20]  B. McNaughton,et al.  Place cells, head direction cells, and the learning of landmark stability , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[21]  Gordon Wyeth,et al.  Persistent Navigation and Mapping using a Biologically Inspired SLAM System , 2010, Int. J. Robotics Res..

[22]  Gordon Wyeth,et al.  Experience mapping: Producing spatially continuous environment representations using RatSLAM , 2005 .

[23]  J. O’Keefe,et al.  An oscillatory interference model of grid cell firing , 2007, Hippocampus.

[24]  Gerhard Lakemeyer,et al.  Exploring artificial intelligence in the new millennium , 2003 .

[25]  Gordon Wyeth,et al.  RatSLAM on the Edge: Revealing a Coherent Representation from an Overloaded Rat Brain , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  M. Hasselmo Grid cell mechanisms and function: Contributions of entorhinal persistent spiking and phase resetting , 2008, Hippocampus.

[27]  Bruce L. McNaughton,et al.  Path integration and the neural basis of the 'cognitive map' , 2006, Nature Reviews Neuroscience.

[28]  A S Etienne,et al.  Path integration in mammals and its interaction with visual landmarks. , 1996, The Journal of experimental biology.

[29]  R. Muller,et al.  On the directional firing properties of hippocampal place cells , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  B. McNaughton,et al.  The contributions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats , 1983, Experimental Brain Research.

[31]  Yoram Burakyy,et al.  Accurate Path Integration in Continuous Attractor Network Models of Grid Cells , 2009 .

[32]  R. Burwell,et al.  Neuron number in the parahippocampal region is preserved in aged rats with spatial learning deficits. , 2002, Cerebral cortex.

[33]  M. Fyhn,et al.  Spatial Representation in the Entorhinal Cortex , 2004, Science.

[34]  Hugh F. Durrant-Whyte,et al.  A computationally efficient solution to the simultaneous localisation and map building (SLAM) problem , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[35]  Gordon Wyeth,et al.  Mapping a Suburb With a Single Camera Using a Biologically Inspired SLAM System , 2008, IEEE Transactions on Robotics.

[36]  A. Stokes,et al.  Studies on Home Range in the Brown Rat , 1948 .

[37]  H. T. Blair,et al.  Anticipatory head direction signals in anterior thalamus: evidence for a thalamocortical circuit that integrates angular head motion to compute head direction , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .