Integrative hippocampal and decision-making neurocircuitry during goal-relevant predictions and encoding.

It has become clear that the hippocampus plays a critical role in the identification of new contexts and for the detection of changes in familiar contexts. The hippocampus accomplishes these goals through a continual process of comparing predicted features of a context or situation to those actually experienced. A mismatch between expected and experienced context expectations is thought to lead to the generation of a context prediction error (Mizumori, 2013) that functionally alerts connected brain areas to alter subsequent decision making and response selection. Little is understood about how hippocampal context analyses impact downstream decision processes. This issue is evaluated here first by comparing the nature of the information represented in hippocampus and decision-related midbrain-striatal structures, while rats perform a hippocampal-dependent spatial memory task in which rewards of different value are found at different locations. In contrast to place-specific and egocentric neural representations, neural representations of goal information are broadly distributed in hippocampal and decision neural circuitry, but they appear in different forms for different brain structures. It is suggested that further researching on how goal information processing occurs in hippocampus and decision neural circuitry may reveal insights into the nature of the interaction between memory and decision systems. The second part of this review describes neural pathways by which hippocampal context information might arrive within the decision circuit. The third section presents a hypothesis that the nature of the interactions between hippocampal and midbrain-striatal circuitry is regulated by the prefrontal cortex.

[1]  L. Nadel,et al.  The Hippocampus, Wayfinding and Episodic Memory , 2002 .

[2]  M. Shapiro,et al.  Bidirectional changes to hippocampal theta–gamma comodulation predict memory for recent spatial episodes , 2010, Proceedings of the National Academy of Sciences.

[3]  Oxana Eschenko,et al.  Non-commercial Research and Educational Use including without Limitation Use in Instruction at Your Institution, Sending It to Specific Colleagues That You Know, and Providing a Copy to Your Institution's Administrator. All Other Uses, Reproduction and Distribution, including without Limitation Comm , 2022 .

[4]  N. Daw,et al.  The ubiquity of model-based reinforcement learning , 2012, Current Opinion in Neurobiology.

[5]  W. Pan,et al.  Dopamine Cells Respond to Predicted Events during Classical Conditioning: Evidence for Eligibility Traces in the Reward-Learning Network , 2005, The Journal of Neuroscience.

[6]  D. Shohamy,et al.  Feedback Timing Modulates Brain Systems for Learning in Humans , 2011, The Journal of Neuroscience.

[7]  Bryan Kolb,et al.  Structural plasticity associated with exposure to drugs of abuse , 2004, Neuropharmacology.

[8]  S. Mizumori,et al.  Ventral tegmental area and substantia nigra neural correlates of spatial learning. , 2011, Learning & memory.

[9]  S. Nicola,et al.  Firing of nucleus accumbens neurons during the consummatory phase of a discriminative stimulus task depends on previous reward predictive cues. , 2004, Journal of neurophysiology.

[10]  R. C. Honey,et al.  Conditioning and contextual retrieval in hippocampal rats. , 1991 .

[11]  M. Shapiro,et al.  Prospective and Retrospective Memory Coding in the Hippocampus , 2003, Neuron.

[12]  J. Fuster Prefrontal Cortex , 2018 .

[13]  H. Eichenbaum,et al.  The global record of memory in hippocampal neuronal activity , 1999, Nature.

[14]  D. Buonomano,et al.  The neural basis of temporal processing. , 2004, Annual review of neuroscience.

[15]  S. Mizumori,et al.  Conjunctive encoding of movement and reward by ventral tegmental area neurons in the freely navigating rodent. , 2010, Behavioral neuroscience.

[16]  Benjamin J. Kraus,et al.  Hippocampal “Time Cells”: Time versus Path Integration , 2013, Neuron.

[17]  J. Lisman,et al.  The Hippocampal-VTA Loop: Controlling the Entry of Information into Long-Term Memory , 2005, Neuron.

[18]  A D Redish,et al.  Prediction, sequences and the hippocampus , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[19]  G. Turrigiano Homeostatic synaptic plasticity: local and global mechanisms for stabilizing neuronal function. , 2012, Cold Spring Harbor perspectives in biology.

[20]  C. Schreiner,et al.  A synaptic memory trace for cortical receptive field plasticity , 2007, Nature.

[21]  J. O’Keefe Place units in the hippocampus of the freely moving rat , 1976, Experimental Neurology.

[22]  S. Nelson,et al.  Homeostatic plasticity in the developing nervous system , 2004, Nature Reviews Neuroscience.

[23]  L. Nadel,et al.  Context and conditioning: A place for space , 1980 .

[24]  John W Krakauer,et al.  Adaptation to visuomotor rotation through interaction between posterior parietal and motor cortical areas. , 2009, Journal of neurophysiology.

[25]  Matthew L Shapiro,et al.  Double dissociation and hierarchical organization of strategy switches and reversals in the rat PFC. , 2009, Behavioral neuroscience.

[26]  H. T. Blair,et al.  Putting Fear in Its Place: Remapping of Hippocampal Place Cells during Fear Conditioning , 2004, The Journal of Neuroscience.

[27]  Bruno Poucet,et al.  Goal-Related Activity in Hippocampal Place Cells , 2007, The Journal of Neuroscience.

[28]  S. Mizumori,et al.  Neural systems analysis of decision making during goal-directed navigation , 2012, Progress in Neurobiology.

[29]  Michael E Hasselmo,et al.  The role of hippocampal regions CA3 and CA1 in matching entorhinal input with retrieval of associations between objects and context: theoretical comment on Lee et al. (2005). , 2005, Behavioral neuroscience.

[30]  W. Schultz Dopamine neurons and their role in reward mechanisms , 1997, Current Opinion in Neurobiology.

[31]  R. Knight Contribution of human hippocampal region to novelty detection , 1996, Nature.

[32]  E. Marder,et al.  Variability, compensation and homeostasis in neuron and network function , 2006, Nature Reviews Neuroscience.

[33]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[34]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[35]  A comparison of the effects of electrical stimulation of the amygdala and hippocampus on subpallidal output neurons to the pedunculopontine nucleus , 1989, Brain Research.

[36]  Eric A. Zilli,et al.  Hippocampal CA1 spiking during encoding and retrieval: Relation to theta phase , 2007, Neurobiology of Learning and Memory.

[37]  Sheri J. Y. Mizumori,et al.  Context Prediction Analysis and Episodic Memory , 2013, Front. Behav. Neurosci..

[38]  E. Kandel,et al.  Increased Attention to Spatial Context Increases Both Place Field Stability and Spatial Memory , 2004, Neuron.

[39]  E. J. Green,et al.  Cortical representation of motion during unrestrained spatial navigation in the rat. , 1994, Cerebral cortex.

[40]  Ethan S. Bromberg-Martin,et al.  Distinct Tonic and Phasic Anticipatory Activity in Lateral Habenula and Dopamine Neurons , 2010, Neuron.

[41]  D. Plenz,et al.  Up and Down States in Striatal Medium Spiny Neurons Simultaneously Recorded with Spontaneous Activity in Fast-Spiking Interneurons Studied in Cortex–Striatum–Substantia Nigra Organotypic Cultures , 1998, The Journal of Neuroscience.

[42]  M. Platt,et al.  Neuroethology of reward and decision making , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[43]  Bita Moghaddam,et al.  A Mechanistic Approach to Preventing Schizophrenia in At-Risk Individuals , 2013, Neuron.

[44]  B. McNaughton,et al.  Spatial information content and reliability of hippocampal CA1 neurons: Effects of visual input , 1994, Hippocampus.

[45]  R. Muller,et al.  The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[47]  P. O’Donnell,et al.  Closing the Gate in the Limbic Striatum: Prefrontal Suppression of Hippocampal and Thalamic Inputs , 2013, Neuron.

[48]  W. Schultz,et al.  Importance of unpredictability for reward responses in primate dopamine neurons. , 1994, Journal of neurophysiology.

[49]  A. Arnsten Prefrontal cortical network connections: key site of vulnerability in stress and schizophrenia , 2011, International Journal of Developmental Neuroscience.

[50]  David M. Smith,et al.  Hippocampal place cells, context, and episodic memory , 2006, Hippocampus.

[51]  R. Kesner Tapestry of memory. , 2009, Behavioral neuroscience.

[52]  A M Graybiel,et al.  The basal ganglia and adaptive motor control. , 1994, Science.

[53]  W. Schultz,et al.  Responses of monkey dopamine neurons during learning of behavioral reactions. , 1992, Journal of neurophysiology.

[54]  A. Graybiel Habits, rituals, and the evaluative brain. , 2008, Annual review of neuroscience.

[55]  S. Haber The primate basal ganglia: parallel and integrative networks , 2003, Journal of Chemical Neuroanatomy.

[56]  G. E. Alexander,et al.  Functional architecture of basal ganglia circuits: neural substrates of parallel processing , 1990, Trends in Neurosciences.

[57]  S. Floresco,et al.  Modulation of Hippocampal and Amygdalar-Evoked Activity of Nucleus Accumbens Neurons by Dopamine: Cellular Mechanisms of Input Selection , 2001, The Journal of Neuroscience.

[58]  S. Mizumori,et al.  Specific changes in hippocampal spatial codes predict spatial working memory performance , 2006, Behavioural Brain Research.

[59]  Jesse Jackson,et al.  Interactions between the Lateral Habenula and the Hippocampus: Implication for Spatial Memory Processes , 2013, Neuropsychopharmacology.

[60]  David M. Smith,et al.  Hippocampal episode fields develop with learning , 2011, Hippocampus.

[61]  D. Y. Lee,et al.  Sub-Regional Hippocampal Injury is Associated with Fornix Degeneration in Alzheimer’s Disease , 2012, Front. Ag. Neurosci..

[62]  W. Schultz Dopamine signals for reward value and risk: basic and recent data , 2010, Behavioral and Brain Functions.

[63]  Anthony A Grace,et al.  The Hippocampus Modulates Dopamine Neuron Responsivity by Regulating the Intensity of Phasic Neuron Activation , 2006, Neuropsychopharmacology.

[64]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[65]  D. Plenz,et al.  Neural dynamics in cortex-striatum co-cultures—I. Anatomy and electrophysiology of neuronal cell types , 1996, Neuroscience.

[66]  M. Fyhn,et al.  Hippocampal Neurons Responding to First-Time Dislocation of a Target Object , 2002, Neuron.

[67]  Jian Li,et al.  Parallel contributions of distinct human memory systems during probabilistic learning , 2011, NeuroImage.

[68]  Kyle S. Smith,et al.  Corticostriatal Interactions during Learning, Memory Processing, and Decision Making , 2009, The Journal of Neuroscience.

[69]  John R. Anderson,et al.  Learning from experience: Event-related potential correlates of reward processing, neural adaptation, and behavioral choice , 2012, Neuroscience & Biobehavioral Reviews.

[70]  O. Hikosaka,et al.  Dopamine Neurons Can Represent Context-Dependent Prediction Error , 2004, Neuron.

[71]  M. Roesch,et al.  Reward Prediction Error Signaling in Posterior Dorsomedial Striatum Is Action Specific , 2012, The Journal of Neuroscience.

[72]  L. Squire,et al.  Structure and function of declarative and nondeclarative memory systems. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[73]  D. Schacter,et al.  Remembering the past to imagine the future: the prospective brain , 2007, Nature Reviews Neuroscience.

[74]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[75]  Emrah Duzel,et al.  A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP , 2011, Trends in Neurosciences.

[76]  B. McNaughton,et al.  Independent Codes for Spatial and Episodic Memory in Hippocampal Neuronal Ensembles , 2005, Science.

[77]  M. Fanselow,et al.  Effects of amygdala, hippocampus, and periaqueductal gray lesions on short- and long-term contextual fear. , 1993, Behavioral neuroscience.

[78]  R. Nudo Neural bases of recovery after brain injury. , 2011, Journal of Communication Disorders.

[79]  David M. Smith,et al.  Complimentary roles of the hippocampus and retrosplenial cortex in behavioral context discrimination , 2012, Hippocampus.

[80]  H. Condé,et al.  The role of the pedunculopontine tegmental nucleus in relation to conditioned motor performance in the cat I. Context-dependent and reinforcement-related single unit activity , 1998, Experimental Brain Research.

[81]  Jason M. Scimeca,et al.  Striatal Contributions to Declarative Memory Retrieval , 2012, Neuron.

[82]  D. R. Euston,et al.  The Role of Medial Prefrontal Cortex in Memory and Decision Making , 2012, Neuron.

[83]  Dorothy Tse,et al.  References and Notes Supporting Online Material Materials and Methods Figs. S1 to S5 Tables S1 to S3 Electron Impact (ei) Mass Spectra Chemical Ionization (ci) Mass Spectra References Schemas and Memory Consolidation Research Articles Research Articles Research Articles Research Articles , 2022 .

[84]  Asohan Amarasingham,et al.  Internally Generated Cell Assembly Sequences in the Rat Hippocampus , 2008, Science.

[85]  James C. Houk,et al.  Information Processing in Modular Circuits Linking Basal Ganglia and Cerebral Cortex , 1994 .

[86]  E. Tulving Episodic memory: from mind to brain. , 2002, Annual review of psychology.

[87]  G. Turrigiano Homeostatic plasticity in neuronal networks: the more things change, the more they stay the same , 1999, Trends in Neurosciences.

[88]  B. McNaughton,et al.  The contributions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats , 1983, Experimental Brain Research.

[89]  Ethan S. Bromberg-Martin,et al.  Lateral habenula neurons signal errors in the prediction of reward information , 2011, Nature Neuroscience.

[90]  G. Buzsáki Rhythms of the brain , 2006 .

[91]  G. E. Alexander,et al.  Preparation for movement: neural representations of intended direction in three motor areas of the monkey. , 1990, Journal of neurophysiology.

[92]  R P Kesner,et al.  Involvement of rodent prefrontal cortex subregions in strategy switching. , 1999, Behavioral neuroscience.

[93]  R. Dolan,et al.  Encoding of emotional memories depends on amygdala and hippocampus and their interactions , 2004, Nature Neuroscience.

[94]  Karl J. Friston,et al.  Predictions not commands: active inference in the motor system , 2012, Brain Structure and Function.

[95]  Sheri J. Y. Mizumori,et al.  Self Regulation of Memory Processing Centers of the Brain , 2016 .

[96]  O. Vinogradova Expression, control, and probable functional significance of the neuronal theta-rhythm , 1995, Progress in Neurobiology.

[97]  Mattias P. Karlsson,et al.  Network Resets in Medial Prefrontal Cortex Mark the Onset of Behavioral Uncertainty , 2012, Science.

[98]  G. Buzsáki,et al.  Memory, navigation and theta rhythm in the hippocampal-entorhinal system , 2013, Nature Neuroscience.

[99]  Bruno Poucet,et al.  Searching for spatial unit firing in the prelimbic area of the rat medial prefrontal cortex , 1997, Behavioural Brain Research.

[100]  Brice A. Kuhl,et al.  Resistance to forgetting associated with hippocampus-mediated reactivation during new learning , 2010, Nature Neuroscience.

[101]  D. Kumaran,et al.  Match–Mismatch Processes Underlie Human Hippocampal Responses to Associative Novelty , 2007, The Journal of Neuroscience.

[102]  S. Mizumori,et al.  Homeostatic Regulation of Memory Systems and Adaptive Decisions , 2013, Hippocampus.

[103]  Daniel Tranel,et al.  Amygdala damage impairs emotional memory for gist but not details of complex stimuli , 2005, Nature Neuroscience.

[104]  R. Kesner,et al.  Involvement of the Prelimbic–Infralimbic Areas of the Rodent Prefrontal Cortex in Behavioral Flexibility for Place and Response Learning , 1999, The Journal of Neuroscience.

[105]  Sheri J. Y. Mizumori,et al.  Hippocampal place fields : relevance to learning and memory , 2008 .

[106]  Arjun Sahgal,et al.  The pedunculopontine tegmental nucleus: a role in cognitive processes? , 1994, Brain Research Reviews.

[107]  S. Mizumori,et al.  Effects of Prefrontal Cortical Inactivation on Neural Activity in the Ventral Tegmental Area , 2013, The Journal of Neuroscience.

[108]  David M. Smith,et al.  Fornix lesions impair context-related cingulothalamic neuronal patterns and concurrent discrimination learning in rabbits (Oryctolagus cuniculus). , 2004, Behavioral neuroscience.

[109]  H. Fibiger,et al.  Afferent connections of the laterodorsal and the pedunculopontine tegmental nuclei in the rat: A retro‐ and antero‐grade transport and immunohistochemical study , 1992, The Journal of comparative neurology.

[110]  R. Hirsh The hippocampus and contextual retrieval of information from memory: a theory. , 1974, Behavioral biology.

[111]  G. Glover,et al.  Associative retrieval processes in the human medial temporal lobe: hippocampal retrieval success and CA1 mismatch detection. , 2011, Learning & memory.

[112]  David Wood,et al.  Luddites must not block progress in genetics , 1999, Nature.

[113]  A. Graybiel,et al.  Prolonged Dopamine Signalling in Striatum Signals Proximity and Value of Distant Rewards , 2013, Nature.

[114]  H. Okamoto,et al.  Genetic dissection of the zebrafish habenula, a possible switching board for selection of behavioral strategy to cope with fear and anxiety , 2012, Developmental neurobiology.

[115]  David M. Smith,et al.  Learning-Related Development of Context-Specific Neuronal Responses to Places and Events: The Hippocampal Role in Context Processing , 2006, The Journal of Neuroscience.

[116]  P. Goldman-Rakic,et al.  Differential Activation of the Caudate Nucleus in Primates Performing Spatial and Nonspatial Working Memory Tasks , 1997, The Journal of Neuroscience.

[117]  G. Mogenson,et al.  Effects of electrical stimulation of the lateral habenular nucleus and lateral hypothalamus on unit activity in the upper brain stem. , 1974, Brain research.

[118]  J. Feldon,et al.  Dissociation of function between the dorsal and the ventral hippocampus in spatial learning abilities of the rat: a within‐subject, within‐task comparison of reference and working spatial memory , 2004, The European journal of neuroscience.

[119]  S. Corkin,et al.  Two routes to emotional memory: distinct neural processes for valence and arousal. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[120]  H. Groenewegen,et al.  Integration and segregation of limbic cortico-striatal loops at the thalamic level: an experimental tracing study in rats , 1999, Journal of Chemical Neuroanatomy.

[121]  Stefan Leutgeb,et al.  A neural systems analysis of adaptive navigation , 2000, Molecular Neurobiology.

[122]  Characteristics of basolateral amygdala neuronal firing on a spatial memory task involving differential reward. , 1998 .

[123]  S. Mizumori,et al.  Age-associated changes in the hippocampal-ventral striatum-ventral tegmental loop that impact learning, prediction, and context discrimination , 2012, Front. Ag. Neurosci..

[124]  S J Mizumori,et al.  Hippocampal Representational Organization and Spatial Context , 1999, Hippocampus.

[125]  S. Mizumori,et al.  Basal ganglia contributions to adaptive navigation , 2009, Behavioural Brain Research.

[126]  D. V. von Cramon,et al.  Error Monitoring Using External Feedback: Specific Roles of the Habenular Complex, the Reward System, and the Cingulate Motor Area Revealed by Functional Magnetic Resonance Imaging , 2003, The Journal of Neuroscience.

[127]  György Buzsáki,et al.  Cognitive neuroscience: Time, space and memory , 2013, Nature.

[128]  Apostolos P. Georgopoulos,et al.  Top-Down Spatial Categorization Signal from Prefrontal to Posterior Parietal Cortex in the Primate , 2011, Front. Syst. Neurosci..

[129]  V. Grutta,et al.  Lateral habenula and hippocampal units: electrophysiological and iontophoretic study , 1995, Brain Research Bulletin.

[130]  Clay B. Holroyd,et al.  Medial Prefrontal Cortex and Error Potentials , 2002, Science.

[131]  J. Hollerman,et al.  Influence of reward expectation on behavior-related neuronal activity in primate striatum. , 1998, Journal of neurophysiology.

[132]  Z. Khan,et al.  Molecular mechanisms of working memory , 2011, Behavioural Brain Research.

[133]  L. Nadel,et al.  The Hippocampus as a Cognitive Map , 1978 .

[134]  A. Dickinson,et al.  Neuronal coding of prediction errors. , 2000, Annual review of neuroscience.

[135]  C. H. Vanderwolf,et al.  Hippocampal electrical activity and voluntary movement in the rat. , 1969, Electroencephalography and clinical neurophysiology.

[136]  S. Mizumori,et al.  Neurons in rat medial prefrontal cortex show anticipatory rate changes to predictable differential rewards in a spatial memory task , 2001, Behavioural Brain Research.

[137]  Aaron J. Suminski,et al.  Remembering forward: Neural correlates of memory and prediction in human motor adaptation , 2012, NeuroImage.

[138]  A. Turken,et al.  The Neural Architecture of the Language Comprehension Network: Converging Evidence from Lesion and Connectivity Analyses , 2011, Front. Syst. Neurosci..

[139]  J R Duhamel,et al.  The updating of the representation of visual space in parietal cortex by intended eye movements. , 1992, Science.

[140]  Eric A. Zilli,et al.  Medial prefrontal cortex cells show dynamic modulation with the hippocampal theta rhythm dependent on behavior , 2005, Hippocampus.

[141]  Lila Davachi,et al.  Evidence for area CA1 as a match/mismatch detector: A high‐resolution fMRI study of the human hippocampus , 2012, Hippocampus.

[142]  K. Duncan,et al.  Memory’s Penumbra: Episodic Memory Decisions Induce Lingering Mnemonic Biases , 2012, Science.

[143]  A. Arnsten,et al.  Neuromodulation of Thought: Flexibilities and Vulnerabilities in Prefrontal Cortical Network Synapses , 2012, Neuron.

[144]  David M. Smith,et al.  Hippocampal and neocortical interactions during context discrimination: Electrophysiological evidence from the rat , 2007, Hippocampus.

[145]  G. Turrigiano The Self-Tuning Neuron: Synaptic Scaling of Excitatory Synapses , 2008, Cell.

[146]  J. Gray,et al.  Précis of The neuropsychology of anxiety: An enquiry into the functions of the septo-hippocampal system , 1982, Behavioral and Brain Sciences.

[147]  S. Mizumori,et al.  Independent neural coding of reward and movement by pedunculopontine tegmental nucleus neurons in freely navigating rats , 2011, The European journal of neuroscience.

[148]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[149]  K. Jeffery,et al.  A proposed architecture for the neural representation of spatial context , 2004, Neuroscience & Biobehavioral Reviews.

[150]  J. Landeira-Fernández,et al.  Effect of Dorsal and Ventral Hippocampal Lesions on Contextual Fear Conditioning and Unconditioned Defensive Behavior Induced by Electrical Stimulation of the Dorsal Periaqueductal Gray , 2014, PloS one.

[151]  L. Nadel The hippocampus and context revisited. , 2008 .

[152]  Bruce L. McNaughton,et al.  Progressive Transformation of Hippocampal Neuronal Representations in “Morphed” Environments , 2005, Neuron.

[153]  Nigel Foreman,et al.  Exploratory activity and response to a spatial change in rats with hippocampal or posterior parietal cortical lesions , 1992, Behavioural Brain Research.

[154]  G. Buzsáki,et al.  A 4 Hz Oscillation Adaptively Synchronizes Prefrontal, VTA, and Hippocampal Activities , 2011, Neuron.

[155]  G. Dragoi,et al.  Preplay of future place cell sequences by hippocampal cellular assemblies , 2011, Nature.

[156]  M. Hasselmo What is the function of hippocampal theta rhythm?—Linking behavioral data to phasic properties of field potential and unit recording data , 2005, Hippocampus.

[157]  M. W. Brown,et al.  Novel spatial arrangements of familiar visual stimuli promote activity in the rat hippocampal formation but not the parahippocampal cortices: a c-fos expression study , 2004, Neuroscience.

[158]  Kathryn J Jeffery,et al.  Heterogeneous Modulation of Place Cell Firing by Changes in Context , 2003, The Journal of Neuroscience.

[159]  O. Paulsen,et al.  A model of hippocampal memory encoding and retrieval: GABAergic control of synaptic plasticity , 1998, Trends in Neurosciences.

[160]  Marc W Howard,et al.  Gradual Changes in Hippocampal Activity Support Remembering the Order of Events , 2007, Neuron.

[161]  Sisir Roy,et al.  The ‘prediction imperative’ as the basis for self-awareness , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[162]  T. Prescott,et al.  The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward. , 2010, Progress in Neurobiology.

[163]  J. Kihlstrom,et al.  THE EFFECTS OF EPISODIC MEMORY LOSS ON AN AMNESIC PATIENT ’ S ABILITY TO REMEMBER THE PAST AND IMAGINE THE FUTURE , 2003 .

[164]  Richard S. Sutton,et al.  Stimulus Representation and the Timing of Reward-Prediction Errors in Models of the Dopamine System , 2008, Neural Computation.

[165]  T. Robbins,et al.  Putting a spin on the dorsal–ventral divide of the striatum , 2004, Trends in Neurosciences.

[166]  E Save,et al.  Object exploration and reactions to spatial and nonspatial changes in hooded rats following damage to parietal cortex or hippocampal formation. , 1992, Behavioral neuroscience.

[167]  J. Lisman,et al.  Storage, recall, and novelty detection of sequences by the hippocampus: Elaborating on the SOCRATIC model to account for normal and aberrant effects of dopamine , 2001, Hippocampus.

[168]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[169]  R. Morris,et al.  Dopamine and Memory: Modulation of the Persistence of Memory for Novel Hippocampal NMDA Receptor-Dependent Paired Associates , 2010, The Journal of Neuroscience.

[170]  S. Mizumori,et al.  Context-dependent reorganization of spatial and movement representations by simultaneously recorded hippocampal and striatal neurons during performance of allocentric and egocentric tasks. , 2004, Behavioral neuroscience.

[171]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[172]  S. Mizumori,et al.  A role for the lateral dorsal tegmentum in memory and decision neural circuitry , 2015, Neurobiology of Learning and Memory.

[173]  W. Pan,et al.  Pedunculopontine Tegmental Nucleus Controls Conditioned Responses of Midbrain Dopamine Neurons in Behaving Rats , 2005, The Journal of Neuroscience.

[174]  D. Schacter Adaptive constructive processes and the future of memory. , 2012, The American psychologist.

[175]  Michael E. Hasselmo,et al.  Neuromodulation, theta rhythm and rat spatial navigation , 2002, Neural Networks.

[176]  S. Mizumori A Context for Hippocampal Place Cells during Learning , 2008 .

[177]  J. Horvitz Dopamine gating of glutamatergic sensorimotor and incentive motivational input signals to the striatum , 2002, Behavioural Brain Research.

[178]  Eve Marder,et al.  Current Compensation in Neuronal Homeostasis , 2003, Neuron.

[179]  H. Eichenbaum,et al.  From Conditioning to Conscious Recollection , 2001 .

[180]  S. Mizumori,et al.  Parallel processing across neural systems: Implications for a multiple memory system hypothesis , 2004, Neurobiology of Learning and Memory.