A Hierarchy of Associations in Hippocampo-Cortical Systems: Cognitive Maps and Navigation Strategies

In this letter we describe a hippocampo-cortical model of spatial processing and navigation based on a cascade of increasingly complex associative processes that are also relevant for other hippocampal functions such as episodic memory. Associative learning of different types and the related pattern encoding-recognition take place at three successive levels: (1) an object location level, which computes the landmarks from merged multimodal sensory inputs in the parahippocampal cortices; (2) a subject location level, which computes place fields by combination of local views and movement-related information in the entorhinal cortex; and (3) a spatiotemporal level, which computes place transitions from contiguous place fields in the CA3-CA1 region, which form building blocks for learning temporospatial sequences. At the cell population level, superficial entorhinal place cells encode spatial, context-independent maps as landscapes of activity; populations of transition cells in the CA3-CA1 region encode context-dependent maps as sequences of transitions, which form graphs in prefrontal-parietal cortices. The model was tested on a robot moving in a real environment; these tests produced results that could help to interpret biological data. Two different goal-oriented navigation strategies were displayed depend-ing on the type of map used by the system. Thanks to its multilevel, multimodal integration and behavioral imple-mentation, the model suggests functional interpretations for largely un-accounted structural differences between hippocampo-cortical systems. Further, spatiotemporal information, a common denominator shared by several brain structures, could serve as a cognitive processing frame and a functional link, for example, during spatial navigation and episodic memory, as suggested by the applications of the model to other domains, temporal sequence learning and imitation in particular.

[1]  Bruce L. McNaughton,et al.  A Model of the Neural Basis of the Rat's Sense of Direction , 1994, NIPS.

[2]  Y. Burnod,et al.  Spatial representation versus navigation through hippocampal, prefrontal and ganglio-basal loops , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[3]  Françoise Schenk,et al.  Dissociation Between Components of Spatial Memory in the Rat During Ontogeny , 1987 .

[4]  A. J. Hill First occurrence of hippocampal spatial firing in a new environment , 1978, Experimental Neurology.

[5]  P. E. Sharp,et al.  Spatial correlates of firing patterns of single cells in the subiculum of the freely moving rat , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  John O'Keefe,et al.  The hippocampal cognitive map and navigational strategies. , 1991 .

[7]  W. Precht The synaptic organization of the brain G.M. Shepherd, Oxford University Press (1975). 364 pp., £3.80 (paperback) , 1976, Neuroscience.

[8]  P E Sharp,et al.  Complimentary roles for hippocampal versus subicular/entorhinal place cells in coding place, context, and events , 1999, Hippocampus.

[9]  S. Mizumori,et al.  Medial septal modulation of entorhinal single unit activity in anesthetized and freely moving rats , 1992, Brain Research.

[10]  R. Muller,et al.  The positional firing properties of medial entorhinal neurons: description and comparison with hippocampal place cells , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  M. Kuperstein,et al.  Cue-sampling and goal-approach correlates of hippocampal unit activity in rats performing an odor-discrimination task , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Sorin Moga,et al.  A neural architecture for autonomous learning , 1999 .

[13]  W E Skaggs,et al.  Interactions between location and task affect the spatial and directional firing of hippocampal neurons , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  V Paz-Villagrán,et al.  Independent coding of connected environments by place cells , 2004, The European journal of neuroscience.

[15]  A. Berthoz,et al.  Neurons responding to whole-body motion in the primate hippocampus , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  H. T. Blair,et al.  Neural network modeling of the hippocampal formation spatial signals and their possible role in navigation: A modular approach , 1996, Hippocampus.

[17]  Philippe Gaussier,et al.  Cortico-hippocampal maps and navigation strategies in robots and rodents , 2002 .

[18]  B. McNaughton,et al.  Place cells, head direction cells, and the learning of landmark stability , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[20]  R. Muller,et al.  The firing of hippocampal place cells in the dark depends on the rat's recent experience , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[21]  Bruno Poucet,et al.  Remapping of place cell firing patterns after maze rotations , 2002, Experimental Brain Research.

[22]  J. Banquet,et al.  Chapter 4 Space-time, order, and hierarchy in fronto-hippocampal system: A neural basis of personality , 1997 .

[23]  Sorin Moga,et al.  From Perception-Action Loops to Imitation Processes: A Bottom-Up Approach of Learning by Imitation , 1998, Appl. Artif. Intell..

[24]  Philippe Gaussier,et al.  Motivated animat navigation: a visually guided approach , 1998 .

[25]  H. Eichenbaum,et al.  Two functional components of the hippocampal memory system , 1994, Behavioral and Brain Sciences.

[26]  E. Save,et al.  Contribution of multiple sensory information to place field stability in hippocampal place cells , 2000, Hippocampus.

[27]  W B Levy,et al.  A sequence predicting CA3 is a flexible associator that learns and uses context to solve hippocampal‐like tasks , 1996, Hippocampus.

[28]  Eleanor A. Maguire,et al.  Thoughts, behaviour, and brain dynamics during navigation in the real world , 2006, NeuroImage.

[29]  R. Muller,et al.  The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  J. Aggleton,et al.  Identifying cortical inputs to the rat hippocampus that subserve allocentric spatial processes: A simple problem with a complex answer , 2000, Hippocampus.

[31]  B. McNaughton,et al.  Spatial selectivity of unit activity in the hippocampal granular layer , 1993, Hippocampus.

[32]  Sorin Moga,et al.  From Perception-Action loops to imitation processes , 1998 .

[33]  Philippe Gaussier,et al.  L'apprentissage de scènes visuelles complexes. , 1998 .

[34]  Sorin Moga,et al.  Sequence learning and timing in hippocampus, prefrontal cortex, and accumbens , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[35]  Charles R. Goodlett,et al.  Long-term deficits in water maze spatial conditional alternation performance following retrohippocampal lesions in rats , 1989, Behavioural Brain Research.

[36]  Jean-Arcady Meyer,et al.  Animat navigation using a cognitive graph , 1998, Biological Cybernetics.

[37]  Thomas J. Wills,et al.  Long-term plasticity in hippocampal place-cell representation of environmental geometry , 2002, Nature.

[38]  V. Chan‐Palay,et al.  Neuropeptide Y innervation of the hippocampal region in the rat and monkey brain , 1986, The Journal of comparative neurology.

[39]  RU Muller,et al.  The hippocampus as a cognitive graph , 1996, The Journal of general physiology.

[40]  I. Tsuda Toward an interpretation of dynamic neural activity in terms of chaotic dynamical systems. , 2001, The Behavioral and brain sciences.

[41]  D. Amaral,et al.  Hippocampal‐neocortical interaction: A hierarchy of associativity , 2000, Hippocampus.

[42]  Philippe Gaussier,et al.  From reflex to planning: Multimodal versatile complex systems in biorobotics. , 2001, The Behavioral and brain sciences.

[43]  D K Bilkey,et al.  Is there a direct projection from perirhinal cortex to the hippocampus? , 1998, Hippocampus.

[44]  D. Bilkey,et al.  Lesions of rat perirhinal cortex exacerbate the memory deficit observed following damage to the fimbria-fornix. , 1995, Behavioral neuroscience.

[45]  R. J. McDonald,et al.  Dissociation of the medial prefrontal, posterior parietal, and posterior temporal cortex for spatial navigation and recognition memory in the rat. , 1994, Cerebral cortex.

[46]  S. Stringer,et al.  A view model which accounts for the spatial fields of hippocampal primate spatial view cells and rat place cells , 2001, Hippocampus.

[47]  M. Wilson,et al.  Trajectory Encoding in the Hippocampus and Entorhinal Cortex , 2000, Neuron.

[48]  D. Touretzky,et al.  Cognitive maps beyond the hippocampus , 1997, Hippocampus.

[49]  R. Muller,et al.  The hippocampus as a cognitive graph (abridged version) , 1991, Hippocampus.

[50]  R P Kesner,et al.  Memory for Spatial Location: Role of the Hippocampus in Mediating Spatial Pattern Separation , 1998, The Journal of Neuroscience.

[51]  M. Mishkin,et al.  Effects on visual recognition of combined and separate ablations of the entorhinal and perirhinal cortex in rhesus monkeys , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[52]  D. Amaral Emerging principles of intrinsic hippocampal organization , 1993, Current Opinion in Neurobiology.

[53]  Dave G. Mumby,et al.  Place memory is intact in rats with perirhinal cortex lesions. , 1998 .

[54]  R P Kesner,et al.  Memory for spatial location as a function of temporal lag in rats: role of hippocampus and medial prefrontal cortex. , 1994, Behavioral and neural biology.

[55]  H. Eichenbaum,et al.  Brain Aging: Impaired Coding of Novel Environmental Cues , 1997, The Journal of Neuroscience.

[56]  O. Steward,et al.  On the role of hippocampal connections in the performance of place and cue tasks: comparisons with damage to hippocampus. , 1984, Behavioral neuroscience.

[57]  W E Skaggs,et al.  Deciphering the hippocampal polyglot: the hippocampus as a path integration system. , 1996, The Journal of experimental biology.

[58]  Aude Billard,et al.  From Animals to Animats , 2004 .

[59]  Michael E. Hasselmo,et al.  A model of the hippocampus combibing self-organization and associative memory function , 1994, NIPS.

[60]  Thomas P. Trappenberg,et al.  Self-organising continuous attractor networks with multiple activity packets, and the representation of space , 2004, Neural Networks.

[61]  J. Banquet,et al.  Spatial Navigation and Hippocampal Place Cell Firing: The Problem of Goal Encoding , 2004, Reviews in the neurosciences.

[62]  D S Touretzky,et al.  Theory of rodent navigation based on interacting representations of space , 1996, Hippocampus.

[63]  D. Amaral,et al.  Lesions of the perirhinal and parahippocampal cortices in the monkey produce long-lasting memory impairment in the visual and tactual modalities , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[64]  Paul E. Gilbert,et al.  Dissociating hippocampal subregions: A double dissociation between dentate gyrus and CA1 , 2001, Hippocampus.

[65]  E. Kandel,et al.  Mice Expressing Activated CaMKII Lack Low Frequency LTP and Do Not Form Stable Place Cells in the CA1 Region of the Hippocampus , 1996, Cell.

[66]  M. Mishkin,et al.  A selective mnemonic role for the hippocampus in monkeys: memory for the location of objects , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[67]  S I Wiener,et al.  Place-independent behavioural correlates of hippocampal neurones in rats , 1995, Neuroreport.

[68]  B. McNaughton,et al.  Hippocampal granule cells are necessary for normal spatial learning but not for spatially-selective pyramidal cell discharge , 2004, Experimental Brain Research.

[69]  K. I. Blum,et al.  Impaired Hippocampal Representation of Space in CA1-Specific NMDAR1 Knockout Mice , 1996, Cell.

[70]  Philippe Gaussier,et al.  The visual homing problem: An example of robotics/biology cross fertilization , 2000, Robotics Auton. Syst..

[71]  David S. Touretzky,et al.  The Role of the Hippocampus in Solving the Morris Water Maze , 1998, Neural Computation.

[72]  H. Eichenbaum,et al.  Memory, amnesia, and the hippocampal system , 1993 .

[73]  Philippe Gaussier,et al.  Planification versus sensory-motor conditioning: what are the issues? , 1998 .

[74]  Jean-Arcady Meyer,et al.  Motivated Animat navigation: a visually guided approach , 1998 .

[75]  D. Amaral,et al.  Lesions of perirhinal and parahippocampal cortex that spare the amygdala and hippocampal formation produce severe memory impairment , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[76]  L. Squire,et al.  Damage to the perirhinal cortex exacerbates memory impairment following lesions to the hippocampal formation , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[77]  David S. Olton,et al.  A disconnection analysis of hippocampal function , 1982, Brain Research.

[78]  F. H. Lopes da Silva,et al.  Cortico‐hippocampal communication by way of parallel parahippocampal‐subicular pathways , 2000, Hippocampus.

[79]  M. Yeckel,et al.  Feedforward excitation of the hippocampus by afferents from the entorhinal cortex: redefinition of the role of the trisynaptic pathway. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[80]  Mathias Quoy,et al.  Commentary on Ishiro Tsuda: Learning and control with chaos: from biology to robotics , 2001 .

[81]  M A Arbib,et al.  Competitive Hebbian learning and the hippocampal place cell system: Modeling the interaction of visual and path integration cues , 2001, Hippocampus.

[82]  B. McNaughton,et al.  Experience-dependent, asymmetric expansion of hippocampal place fields. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[83]  Tao Xiong,et al.  A combined SVM and LDA approach for classification , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[84]  R Worden,et al.  Navigation by fragment fitting: A theory of hippocampal function , 1992, Hippocampus.

[85]  D. Mumby,et al.  Place memory is intact in rats with perirhinal cortex lesions. , 1998, Behavioral neuroscience.

[86]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[87]  Angelo Arleo,et al.  Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity , 2000, Biological Cybernetics.

[88]  B L McNaughton,et al.  Path Integration and Cognitive Mapping in a Continuous Attractor Neural Network Model , 1997, The Journal of Neuroscience.

[89]  S. Grossberg,et al.  A neural network model of adaptively timed reinforcement learning and hippocampal dynamics. , 1992, Brain research. Cognitive brain research.

[90]  H. Eichenbaum,et al.  Spatial and behavioral correlates of hippocampal neuronal activity , 1989 .

[91]  Roland S. G. Jones Entorhinal-hippocampal connections: a speculative view of their function , 1993, Trends in Neurosciences.

[92]  Philippe Gaussier,et al.  From view cells and place cells to cognitive map learning: processing stages of the hippocampal system , 2002, Biological Cybernetics.

[93]  Dario Floreano,et al.  From Animals to Animats 6 , 2000 .

[94]  Arne D. Ekstrom,et al.  Dynamics of Hippocampal Ensemble Activity Realignment: Time versus Space , 2000, The Journal of Neuroscience.

[95]  Sorin Moga,et al.  Learning and communication via imitation: an autonomous robot perspective , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[96]  K A Wiig,et al.  Perirhinal cortex lesions in rats disrupt performance in a spatial DNMS task , 1994, Neuroreport.

[97]  E. Rolls,et al.  Self-organizing continuous attractor networks and path integration: two-dimensional models of place cells , 2002, Network.

[98]  P. Best,et al.  Spatial correlates of hippocampal unit activity are altered by lesions of the fornix and entorhinal cortex , 1980, Brain Research.

[99]  Michael Recce,et al.  A model of hippocampal function , 1994, Neural Networks.

[100]  C Kentros,et al.  Abolition of long-term stability of new hippocampal place cell maps by NMDA receptor blockade. , 1998, Science.

[101]  A. Redish Beyond the Cognitive Map: From Place Cells to Episodic Memory , 1999 .

[102]  E. Rolls,et al.  Neural networks and brain function , 1998 .

[103]  J. T. Erichsen,et al.  Using Fos Imaging in the Rat to Reveal the Anatomical Extent of the Disruptive Effects of Fornix Lesions , 2000, The Journal of Neuroscience.

[104]  M. Hasselmo,et al.  Graded persistent activity in entorhinal cortex neurons , 2002, Nature.

[105]  Seth J. Ramus,et al.  Severity of memory impairment in monkeys as a function of locus and extent of damage within the medial temporal lobe memory system , 1994, Hippocampus.

[106]  P E Sharp,et al.  Influences of vestibular and visual motion information on the spatial firing patterns of hippocampal place cells , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[107]  E. Rolls,et al.  View‐responsive neurons in the primate hippocampal complex , 1995, Hippocampus.

[108]  T. Bussey,et al.  Functionally Dissociating Aspects of Event Memory: the Effects of Combined Perirhinal and Postrhinal Cortex Lesions on Object and Place Memory in the Rat , 1999, The Journal of Neuroscience.

[109]  D. Amaral,et al.  The three-dimensional organization of the hippocampal formation: A review of anatomical data , 1989, Neuroscience.

[110]  M. Hasselmo,et al.  Simulations of the Role of the Muscarinic-Activated Calcium-Sensitive Nonspecific Cation CurrentINCM in Entorhinal Neuronal Activity during Delayed Matching Tasks , 2002, The Journal of Neuroscience.

[111]  E. Bostock,et al.  Experience‐dependent modifications of hippocampal place cell firing , 1991, Hippocampus.

[112]  R. Passingham The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[113]  Mathias Quoy,et al.  Resonant spatiotemporal learning in large random recurrent networks , 2002, Biological Cybernetics.

[114]  L. Matthews Cognitive science perspectives on personality and emotion , 1997 .

[115]  J. O’Keefe,et al.  Single unit activity in the rat hippocampus during a spatial memory task , 2004, Experimental Brain Research.