Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity

Abstract. A computational model of hippocampal activity during spatial cognition and navigation tasks is presented. The spatial representation in our model of the rat hippocampus is built on-line during exploration via two processing streams. An allothetic vision-based representation is built by unsupervised Hebbian learning extracting spatio-temporal properties of the environment from visual input. An idiothetic representation is learned based on internal movement-related information provided by path integration. On the level of the hippocampus, allothetic and idiothetic representations are integrated to yield a stable representation of the environment by a population of localized overlapping CA3-CA1 place fields. The hippocampal spatial representation is used as a basis for goal-oriented spatial behavior. We focus on the neural pathway connecting the hippocampus to the nucleus accumbens. Place cells drive a population of locomotor action neurons in the nucleus accumbens. Reward-based learning is applied to map place cell activity into action cell activity. The ensemble action cell activity provides navigational maps to support spatial behavior. We present experimental results obtained with a mobile Khepera robot.

[1]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[2]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[3]  Kenneth L. Caspari,et al.  Computer techniques in image processing , 1972 .

[4]  Miss A.O. Penney.  (b) , 1974, The New Yale Book of Quotations.

[5]  T. Wiesel,et al.  Functional architecture of macaque monkey visual cortex , 1977 .

[6]  R. Passingham.  The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[7]  A. J. Hill,et al.  Effects of deafness and blindness on the spatial correlates of hippocampal unit activity in the rat , 1981, Experimental Neurology.

[8]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[9]  Yehoshua Y. Zeevi,et al.  The Generalized Gabor Scheme of Image Representation in Biological and Machine Vision , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  D. Amaral,et al.  The three-dimensional organization of the hippocampal formation: A review of anatomical data , 1989, Neuroscience.

[11]  Peter Dayan,et al.  Navigating Through Temporal Difference , 1990, NIPS.

[12]  R. Muller,et al.  The firing of hippocampal place cells in the dark depends on the rat's recent experience , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  B. McNaughton,et al.  Comparison of spatial and temporal characteristics of neuronal activity in sequential stages of hippocampal processing. , 1990, Progress in brain research.

[14]  S. Sesack,et al.  In the rat medial nucleus accumbens, hippocampal and catecholaminergic terminals converge on spiny neurons and are in apposition to each other , 1990, Brain Research.

[15]  R U Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  B. McNaughton,et al.  Dead Reckoning, Landmark Learning, and the Sense of Direction: A Neurophysiological and Computational Hypothesis , 1991, Journal of Cognitive Neuroscience.

[17]  R. Muller,et al.  The positional firing properties of medial entorhinal neurons: description and comparison with hippocampal place cells , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  B. McNaughton,et al.  Spatial selectivity of unit activity in the hippocampal granular layer , 1993, Hippocampus.

[19]  J. O’Keefe,et al.  Phase relationship between hippocampal place units and the EEG theta rhythm , 1993, Hippocampus.

[20]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[21]  R. Muller,et al.  On the directional firing properties of hippocampal place cells , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  B. McNaughton,et al.  Spatial information content and reliability of hippocampal CA1 neurons: Effects of visual input , 1994, Hippocampus.

[23]  Michael Recce,et al.  A model of hippocampal function , 1994, Neural Networks.

[24]  Bernd Fritzke,et al.  Growing cell structures--A self-organizing network for unsupervised and supervised learning , 1994, Neural Networks.

[25]  B. McNaughton,et al.  Place cells, head direction cells, and the learning of landmark stability , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[26]  H. T. Blair,et al.  Anticipatory head direction signals in anterior thalamus: evidence for a thalamocortical circuit that integrates angular head motion to compute head direction , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  E T Rolls,et al.  Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. , 1995, Journal of neurophysiology.

[28]  J. Taube.  Place cells recorded in the parasubiculum of freely moving rats , 1995, Hippocampus.

[29]  Rolf Pfeifer,et al.  Cognition - perspectives from autonomous agents , 1995, Robotics Auton. Syst..

[30]  Roland Maurer,et al.  What is modelling for? a critical review of the models of path integration , 1995 .

[31]  P. E. Sharp,et al.  Simulation of spatial learning in the Morris water maze by a neural network model of the hippocampal formation and nucleus accumbens , 1995, Hippocampus.

[32]  J. Taube.  Head direction cells recorded in the anterior thalamic nuclei of freely moving rats , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  W E Skaggs,et al.  Deciphering the hippocampal polyglot: the hippocampus as a path integration system. , 1996, The Journal of experimental biology.

[34]  José del R. Millán,et al.  Rapid, safe, and incremental learning of navigation strategies , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[35]  K M Gothard,et al.  Dynamics of Mismatch Correction in the Hippocampal Ensemble Code for Space: Interaction between Path Integration and Environmental Cues , 1996, The Journal of Neuroscience.

[36]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[37]  Jean-Arcady Meyer,et al.  Place Sequence Learning for Navigation , 1997, ICANN.

[38]  B L McNaughton,et al.  Path Integration and Cognitive Mapping in a Continuous Attractor Neural Network Model , 1997, The Journal of Neuroscience.

[39]  Bernhard Schölkopf,et al.  The View-Graph Approach to Visual Navigation and Spatial Memory , 1997, ICANN.

[40]  D. Touretzky,et al.  Cognitive maps beyond the hippocampus , 1997, Hippocampus.

[41]  Neil Burgess,et al.  Integrating hippocampal and parietal functions: a spatial point of view , 1998 .

[42]  Tom Duckett,et al.  Mobile robot self-localisation and measurement of performance in middle-scale environments , 1998, Robotics Auton. Syst..

[43]  Francesco Mondada,et al.  Evolutionary neurocontrollers for autonomous mobile robots , 1998, Neural Networks.

[44]  A. Etienne,et al.  Role of dead reckoning in navigation , 1998 .

[45]  D. Touretzky,et al.  Separating hippocampal maps , 1999 .

[46]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.