Neural dynamics of the cognitive map in the hippocampus

The rodent hippocampus has been thought to represent the spatial environment as a cognitive map. In the classical theory, the cognitive map has been explained as a consequence of the fact that different spatial regions are assigned to different cell populations in the framework of rate coding. Recently, the relation between place cell firing and local field oscillation theta in terms of theta phase precession was experimentally discovered and suggested as a temporal coding mechanism leading to memory formation of behavioral sequences accompanied with asymmetric Hebbian plasticity. The cognitive map theory is apparently outside of the sequence memory view. Therefore, theoretical analysis is necessary to consider the biological neural dynamics for the sequence encoding of the memory of behavioral sequences, providing the cognitive map formation. In this article, we summarize the theoretical neural dynamics of the real-time sequence encoding by theta phase precession, called theta phase coding, and review a series of theoretical models with the theta phase coding that we previously reported. With respect to memory encoding functions, instantaneous memory formation of one-time experience was first demonstrated, and then the ability of integration of memories of behavioral sequences into a network of the cognitive map was shown. In terms of memory retrieval functions, theta phase coding enables the hippocampus to represent the spatial location in the current behavioral context even with ambiguous sensory input when multiple sequences were coded. Finally, for utilization, retrieved temporal sequences in the hippocampus can be available for action selection, through the process of reverting theta rhythm-dependent activities to information in the behavioral time scale. This theoretical approach allows us to investigate how the behavioral sequences are encoded, updated, retrieved and used in the hippocampus, as the real-time interaction with the external environment. It may indeed be the bridge to the episodic memory function in human hippocampus.

[1]  R. FitzHugh Impulses and Physiological States in Theoretical Models of Nerve Membrane. , 1961, Biophysical journal.

[2]  G. Buzsáki,et al.  Theta oscillations in somata and dendrites of hippocampal pyramidal cells in vivo: Activity‐dependent phase‐precession of action potentials , 1998, Hippocampus.

[3]  Yoko Yamaguchi,et al.  A theory of hippocampal memory based on theta phase precession , 2003, Biological Cybernetics.

[4]  B L McNaughton,et al.  Path Integration and Cognitive Mapping in a Continuous Attractor Neural Network Model , 1997, The Journal of Neuroscience.

[5]  Bruce L. McNaughton,et al.  Path integration and the neural basis of the 'cognitive map' , 2006, Nature Reviews Neuroscience.

[6]  James L. McClelland,et al.  Hippocampal conjunctive encoding, storage, and recall: Avoiding a trade‐off , 1994, Hippocampus.

[7]  Daniel J Amittt Effective neurons and attractor neural networks in cortical environment , 1992 .

[8]  Naoyuki Sato,et al.  Synchronization of neural oscillations as a possible mechanism underlying episodic memory: a study of theta rhythm in the hippocampus. , 2004, Journal of integrative neuroscience.

[9]  E. Rolls,et al.  A unified model of spatial and episodic memory , 2002, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[10]  Michael E. Hasselmo,et al.  A Proposed Function for Hippocampal Theta Rhythm: Separate Phases of Encoding and Retrieval Enhance Reversal of Prior Learning , 2002, Neural Computation.

[11]  Michael E. Hasselmo,et al.  A simulation of parahippocampal and hippocampal structures guiding spatial navigation of a virtual rat in a virtual environment: A functional framework for theta theory , 2002 .

[12]  Frank C. Hoppensteadt,et al.  An introduction to the mathematics of neurons , 1986 .

[13]  Yoko Yamaguchi,et al.  Input-dependent learning rule for the memory of spatiotemporal sequences in hippocampal network with theta phase precession , 2004, Biological Cybernetics.

[14]  M. Quirk,et al.  Requirement for Hippocampal CA3 NMDA Receptors in Associative Memory Recall , 2002, Science.

[15]  B. McNaughton,et al.  Experience-dependent, asymmetric expansion of hippocampal place fields. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[16]  J. Lisman,et al.  Hippocampal CA3 region predicts memory sequences: accounting for the phase precession of place cells. , 1996, Learning & memory.

[17]  H. Eichenbaum,et al.  The Hippocampus, Memory, and Place Cells Is It Spatial Memory or a Memory Space? , 1999, Neuron.

[18]  J. O’Keefe,et al.  Phase relationship between hippocampal place units and the EEG theta rhythm , 1993, Hippocampus.

[19]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[20]  B. McNaughton,et al.  Hippocampal synaptic enhancement and information storage within a distributed memory system , 1987, Trends in Neurosciences.

[21]  E. Rolls The representation and storage of information in neural networks in the primate cerebral cortex and hippocampus , 1989 .

[22]  RU Muller,et al.  The hippocampus as a cognitive graph , 1996, The Journal of general physiology.

[23]  G. Lynch,et al.  Theta pattern stimulation and the induction of LTP: the sequence in which synapses are stimulated determines the degree to which they potentiate , 1989, Brain Research.

[24]  Mark R. Bower,et al.  Sequential-Context-Dependent Hippocampal Activity Is Not Necessary to Learn Sequences with Repeated Elements , 2005, The Journal of Neuroscience.

[25]  S. Yoshizawa,et al.  An Active Pulse Transmission Line Simulating Nerve Axon , 1962, Proceedings of the IRE.

[26]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[27]  W B Levy,et al.  A sequence predicting CA3 is a flexible associator that learns and uses context to solve hippocampal‐like tasks , 1996, Hippocampus.

[28]  E. Tulving,et al.  Episodic and semantic memory , 1972 .

[29]  Jeffrey C Magee,et al.  A prominent role for intrinsic neuronal properties in temporal coding , 2003, Trends in Neurosciences.

[30]  Jean-Arcady Meyer,et al.  Animat navigation using a cognitive graph , 1998, Biological Cybernetics.

[31]  M. Poo,et al.  Propagation of activity-dependent synaptic depression in simple neural networks , 1997, Nature.

[32]  E. Bostock,et al.  Experience‐dependent modifications of hippocampal place cell firing , 1991, Hippocampus.

[33]  R. Passingham The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[34]  Tomoki Fukai,et al.  Sequence generation in arbitrary temporal patterns from theta-nested gamma oscillations: a model of the basal ganglia-thalamo-cortical loops , 1999, Neural Networks.

[35]  W. Levy,et al.  Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus , 1983, Neuroscience.

[36]  E. Save,et al.  Place‐cell firing does not depend on the direction of turn in a Y‐maze alternation task , 2001, The European journal of neuroscience.

[37]  Michael E. Hasselmo,et al.  A model of hippocampal circuitry mediating goal-driven navigation in a familiar environment , 2002, Neurocomputing.

[38]  Hiroaki Wagatsuma,et al.  Disambiguation of Multiple Sequence Learning by Theta Phase Coding , 2005 .

[39]  Bruce L. McNaughton,et al.  Non-Linear Dynamics Generating Theta Phase Precession in Hippocampal Closed Circuit and Generation of Episodic Memory , 1998, ICONIP.

[40]  Bruce L. McNaughton Cognitive cartography , 1996, Nature.

[41]  K M Gothard,et al.  Binding of hippocampal CA1 neural activity to multiple reference frames in a landmark-based navigation task , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[42]  Michael E. Hasselmo,et al.  Modeling goal-directed spatial navigation in the rat based on physiological data from the hippocampal formation , 2003, Neural Networks.

[43]  R. Muller,et al.  The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[44]  G. Buzsáki,et al.  Spike train dynamics predicts theta-related phase precession in hippocampal pyramidal cells , 2002, Nature.

[45]  Hiroaki Wagatsuma,et al.  Cognitive Map Formation Through Sequence Encoding by Theta Phase Precession , 2004, Neural Computation.

[46]  J. Piaget Judgement and Reasoning in the Child , 1962 .

[47]  M. Shapiro,et al.  Prospective and Retrospective Memory Coding in the Hippocampus , 2003, Neuron.

[48]  P. Dayan,et al.  The Involvement of Recurrent Connections in Area CA3 in Establishing the Properties of Place Fields: a Model , 2000, The Journal of Neuroscience.

[49]  M. Hasselmo,et al.  GABAB modulation improves sequence disambiguation in computational models of hippocampal region CA3 , 1998, Hippocampus.

[50]  Michael E. Hasselmo,et al.  Neuromodulation, theta rhythm and rat spatial navigation , 2002, Neural Networks.

[51]  M. Wilson,et al.  Trajectory Encoding in the Hippocampus and Entorhinal Cortex , 2000, Neuron.

[52]  Hiroaki Wagatsuma,et al.  A neural network model self-organizing a cognitive map using theta phase precession , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[53]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[54]  M. Lengyel,et al.  Dynamically detuned oscillations account for the coupled rate and temporal code of place cell firing , 2003, Hippocampus.

[55]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[56]  M. Kuperstein,et al.  Cue-sampling and goal-approach correlates of hippocampal unit activity in rats performing an odor-discrimination task , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[57]  Hiroaki Wagatsuma,et al.  Disambiguation in spatial navigation with theta phase coding , 2006, Neurocomputing.

[58]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[59]  E. Tulving,et al.  Organization of memory. , 1973 .

[60]  L. F. Abbott,et al.  A Model of Spatial Map Formation in the Hippocampus of the Rat , 1999, Neural Computation.

[61]  K. I. Blum,et al.  Functional significance of long-term potentiation for sequence learning and prediction. , 1996, Cerebral cortex.

[62]  David S. Touretzky,et al.  The Role of the Hippocampus in Solving the Morris Water Maze , 1998, Neural Computation.

[63]  B. McNaughton,et al.  Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences , 1996, Hippocampus.

[64]  C. Barnes,et al.  Impact of aging on hippocampal function: plasticity, network dynamics, and cognition , 2003, Progress in Neurobiology.

[65]  R. Muller,et al.  The hippocampus as a cognitive graph (abridged version) , 1991, Hippocampus.

[66]  Arne D. Ekstrom,et al.  NMDA Receptor Antagonism Blocks Experience-Dependent Expansion of Hippocampal “Place Fields” , 2001, Neuron.

[67]  A Bose,et al.  Phase precession and phase‐locking of hippocampal pyramidal cells , 2001, Hippocampus.

[68]  Richard Durbin,et al.  The computing neuron , 1989 .

[69]  Naoyuki Sato,et al.  Memory Encoding by Theta Phase Precession in the Hippocampal Network , 2003, Neural Computation.

[70]  B. McNaughton,et al.  Population dynamics and theta rhythm phase precession of hippocampal place cell firing: A spiking neuron model , 1998, Hippocampus.

[71]  P. Culicover,et al.  Neural connections, mental computation , 1988 .

[72]  M. Hasselmo,et al.  Laminar selectivity of the cholinergic suppression of synaptic transmission in rat hippocampal region CA1: computational modeling and brain slice physiology , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[73]  B. McNaughton,et al.  Multistability of cognitive maps in the hippocampus of old rats , 1997, Nature.

[74]  M. R. Mehta,et al.  Role of experience and oscillations in transforming a rate code into a temporal code , 2002, Nature.

[75]  Wulfram Gerstner,et al.  Learning Navigational Maps Through Potentiation and Modulation of Hippocampal Place Cells , 2004, Journal of Computational Neuroscience.

[76]  B. McNaughton,et al.  Hebb-Marr networks and the neurobiological representation of action in space. , 1990 .

[77]  J. Magee Dendritic mechanisms of phase precession in hippocampal CA1 pyramidal neurons. , 2001, Journal of neurophysiology.

[78]  H. Eichenbaum The hippocampus and declarative memory: cognitive mechanisms and neural codes , 2001, Behavioural Brain Research.

[79]  H. Eichenbaum,et al.  Hippocampal Neurons Encode Information about Different Types of Memory Episodes Occurring in the Same Location , 2000, Neuron.

[80]  M. Hasselmo,et al.  GABAergic modulation of hippocampal population activity: sequence learning, place field development, and the phase precession effect. , 1997, Journal of neurophysiology.

[81]  G Buzsáki,et al.  Sustained activation of hippocampal pyramidal cells by ‘space clamping’ in a running wheel , 1999, The European journal of neuroscience.

[82]  Hiroaki Wagatsuma,et al.  A Neural Network Model Self-Organizing the Cognitive Map Using Theta Phase Coding , 2000 .

[83]  J E Lisman,et al.  Storage of 7 +/- 2 short-term memories in oscillatory subcycles , 1995, Science.

[84]  Michael Recce,et al.  A model of hippocampal function , 1994, Neural Networks.

[85]  M. Hasselmo Neuromodulation: acetylcholine and memory consolidation , 1999, Trends in Cognitive Sciences.

[86]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[87]  A. Redish Beyond the Cognitive Map: From Place Cells to Episodic Memory , 1999 .

[88]  我妻 広明 A theory of the cognitive map formation in the hippocampus by using theta phase coding , 2005 .

[89]  H. Markram,et al.  Coding and learning of behavioral sequences , 2004, Trends in Neurosciences.

[90]  Naoyuki Sato,et al.  Online formation of a hierarchical cognitive map for object–place association by theta phase coding , 2005, Hippocampus.

[91]  M. Quirk,et al.  Hippocampal CA3 NMDA Receptors Are Crucial for Memory Acquisition of One-Time Experience , 2003, Neuron.