Neural Ensembles in CA3 Transiently Encode Paths Forward of the Animal at a Decision Point

Neural ensembles were recorded from the CA3 region of rats running on T-based decision tasks. Examination of neural representations of space at fast time scales revealed a transient but repeatable phenomenon as rats made a decision: the location reconstructed from the neural ensemble swept forward, first down one path and then the other. Estimated representations were coherent and preferentially swept ahead of the animal rather than behind the animal, implying it represented future possibilities rather than recently traveled paths. Similar phenomena occurred at other important decisions (such as in recovery from an error). Local field potentials from these sites contained pronounced theta and gamma frequencies, but no sharp wave frequencies. Forward-shifted spatial representations were influenced by task demands and experience. These data suggest that the hippocampus does not represent space as a passive computation, but rather that hippocampal spatial processing is an active process likely regulated by cognitive mechanisms.

[1]  K. F. Muenzinger Vicarious Trial and Error at a Point of Choice: I. A General Survey of its Relation to Learning Efficiency , 1938 .

[2]  E. Tolman Prediction of vicarious trial and error by means of the schematic sowbug. , 1939 .

[3]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[4]  E. Fischer Conditioned Reflexes , 1942, American journal of physical medicine.

[5]  E. Loftus,et al.  Reconstruction of automobile destruction: An example of the interaction between language and memory , 1974 .

[6]  L. Nadel,et al.  The Hippocampus as a Cognitive Map , 1978 .

[7]  R. Passingham The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[8]  D. Dewsbury,et al.  The Principles of Learning and Behavior. , 1982 .

[9]  M. Domjan The principles of learning and behavior , 1982 .

[10]  E. Tulving Précis of Elements of episodic memory , 1984, Behavioral and Brain Sciences.

[11]  B. McNaughton,et al.  Hippocampal synaptic enhancement and information storage within a distributed memory system , 1987, Trends in Neurosciences.

[12]  A. Mcgeorge,et al.  The organization of the projection from the cerebral cortex to the striatum in the rat , 1989, Neuroscience.

[13]  M. F. Brown,et al.  Does a cognitive map guide choices in the radial-arm maze? , 1992, Journal of experimental psychology. Animal behavior processes.

[14]  L. Squire Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans. , 1992, Psychological review.

[15]  W. Schultz,et al.  Neuronal activity in monkey ventral striatum related to the expectation of reward , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  J. O’Keefe,et al.  Phase relationship between hippocampal place units and the EEG theta rhythm , 1993, Hippocampus.

[17]  A. Lavoie,et al.  Spatial, movement- and reward-sensitive discharge by medial ventral striatum neurons of rats , 1994, Brain Research.

[18]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[19]  J. Hodges Memory, Amnesia and the Hippocampal System , 1995 .

[20]  D. Hu,et al.  A simple test of the vicarious trial-and-error hypothesis of hippocampal function. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[21]  G. Buzsáki,et al.  Sharp wave-associated high-frequency oscillation (200 Hz) in the intact hippocampus: network and intracellular mechanisms , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  D. Finch,et al.  Neurophysiology of converging synaptic inputs from the rat prefrontal cortex, amygdala, midline thalamus, and hippocampal formation onto single neurons of the caudate/putamen and nucleus accumbens , 1996, Hippocampus.

[23]  J. D. McGaugh,et al.  Inactivation of Hippocampus or Caudate Nucleus with Lidocaine Differentially Affects Expression of Place and Response Learning , 1996, Neurobiology of Learning and Memory.

[24]  B. McNaughton,et al.  Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences , 1996, Hippocampus.

[25]  L. Nadel,et al.  Memory consolidation, retrograde amnesia and the hippocampal complex , 1997, Current Opinion in Neurobiology.

[26]  Richard S. J. Frackowiak,et al.  Recalling Routes around London: Activation of the Right Hippocampus in Taxi Drivers , 1997, The Journal of Neuroscience.

[27]  O Jensen,et al.  An Oscillatory Short-Term Memory Buffer Model Can Account for Data on the Sternberg Task , 1998, The Journal of Neuroscience.

[28]  K. Miyazaki,et al.  Reward‐quality dependent anticipation in rat nucleus accumbens , 1998, NeuroReport.

[29]  E N Brown,et al.  A Statistical Paradigm for Neural Spike Train Decoding Applied to Position Prediction from Ensemble Firing Patterns of Rat Hippocampal Place Cells , 1998, The Journal of Neuroscience.

[30]  B. McNaughton,et al.  Reactivation of Hippocampal Cell Assemblies: Effects of Behavioral State, Experience, and EEG Dynamics , 1999, The Journal of Neuroscience.

[31]  G. Buzsáki,et al.  tFast Network Oscillations in the Hippocampal CA1 Region of the Behaving Rat , 1999, The Journal of Neuroscience.

[32]  A. Redish Beyond the Cognitive Map: From Place Cells to Episodic Memory , 1999 .

[33]  J. Csicsvari,et al.  Replay and Time Compression of Recurring Spike Sequences in the Hippocampus , 1999, The Journal of Neuroscience.

[34]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[35]  T. Ono,et al.  Effects of reward anticipation, reward presentation, and spatial parameters on the firing of single neurons recorded in the subiculum and nucleus accumbens of freely moving rats , 2000, Behavioural Brain Research.

[36]  R. Carelli,et al.  Evidence That Separate Neural Circuits in the Nucleus Accumbens Encode Cocaine Versus “Natural” (Water and Food) Reward , 2000, The Journal of Neuroscience.

[37]  M. Wilson,et al.  Trajectory Encoding in the Hippocampus and Entorhinal Cortex , 2000, Neuron.

[38]  J. Lisman,et al.  Position reconstruction from an ensemble of hippocampal place cells: contribution of theta phase coding. , 2000, Journal of neurophysiology.

[39]  L. Swanson Cerebral hemisphere regulation of motivated behavior 1 1 Published on the World Wide Web on 2 November 2000. , 2000, Brain Research.

[40]  Vincent Hayward,et al.  Discrete-time adaptive windowing for velocity estimation , 2000, IEEE Trans. Control. Syst. Technol..

[41]  H. Eichenbaum,et al.  Hippocampal Neurons Encode Information about Different Types of Memory Episodes Occurring in the Same Location , 2000, Neuron.

[42]  Patrick D Martin Locomotion towards a goal alters the synchronous firing of neurons recorded simultaneously in the subiculum and nucleus accumbens of rats , 2001, Behavioural Brain Research.

[43]  M. Gluck,et al.  Interactive memory systems in the human brain , 2001, Nature.

[44]  C. Hudon,et al.  Spatial memory and choice behavior in the radial arm maze after fornix transection , 2002, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[45]  R. Carelli Nucleus accumbens cell firing during goal-directed behaviors for cocaine vs. ‘natural’ reinforcement , 2002, Physiology & Behavior.

[46]  Albert K. Lee,et al.  Memory of Sequential Experience in the Hippocampus during Slow Wave Sleep , 2002, Neuron.

[47]  A. Redish,et al.  Development of path stereotypy in a single day in rats on a multiple-T maze. , 2002, Archives italiennes de biologie.

[48]  Bruno Poucet,et al.  Relationships between Place Cell Firing Fields and Navigational Decisions by Rats , 2002, The Journal of Neuroscience.

[49]  Michael E. Hasselmo,et al.  Modeling goal-directed spatial navigation in the rat based on physiological data from the hippocampal formation , 2003, Neural Networks.

[50]  P. Somogyi,et al.  Brain-state- and cell-type-specific firing of hippocampal interneurons in vivo , 2003, Nature.

[51]  Yoko Yamaguchi,et al.  A theory of hippocampal memory based on theta phase precession , 2003, Biological Cybernetics.

[52]  John O'Keefe,et al.  Independent rate and temporal coding in hippocampal pyramidal cells , 2003, Nature.

[53]  B. McNaughton,et al.  Hippocampal map realignment and spatial learning , 2003, Nature Neuroscience.

[54]  R. Carelli,et al.  Behavioral/Systems/Cognitive Selective Encoding of Cocaine versus Natural Rewards by Nucleus Accumbens Neurons Is Not Related to Chronic Drug Exposure , 2022 .

[55]  N. Daw,et al.  Reinforcement learning models of the dopamine system and their behavioral implications , 2003 .

[56]  M. Shapiro,et al.  Prospective and Retrospective Memory Coding in the Hippocampus , 2003, Neuron.

[57]  A. Redish,et al.  Neuronal activity in the rodent dorsal striatum in sequential navigation: separation of spatial and reward responses on the multiple T task. , 2004, Journal of neurophysiology.

[58]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[59]  J. O’Keefe,et al.  Single unit activity in the rat hippocampus during a spatial memory task , 2004, Experimental Brain Research.

[60]  B. McNaughton,et al.  The Ventral Striatum in Off-Line Processing: Ensemble Reactivation during Sleep and Modulation by Hippocampal Ripples , 2004, The Journal of Neuroscience.

[61]  H. Eichenbaum Hippocampus Cognitive Processes and Neural Representations that Underlie Declarative Memory , 2004, Neuron.

[62]  A. Redish,et al.  Measuring fundamental frequencies in local field potentials , 2004, Journal of Neuroscience Methods.

[63]  A. Treves,et al.  Distinct Ensemble Codes in Hippocampal Areas CA3 and CA1 , 2004, Science.

[64]  H. Kuypers,et al.  Branching cortical neurons in cat which project to the colliculi and to the pons: a retrograde fluorescent double-labeling study , 2004, Experimental Brain Research.

[65]  S. Nicola,et al.  The Ventral Tegmental Area Is Required for the Behavioral and Nucleus Accumbens Neuronal Firing Responses to Incentive Cues , 2004, The Journal of Neuroscience.

[66]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[67]  M. Roesch,et al.  Orbitofrontal Cortex, Associative Learning, and Expectancies , 2005, Neuron.

[68]  Marc W Howard,et al.  The temporal context model in spatial navigation and relational learning: toward a common explanation of medial temporal lobe function across domains. , 2005, Psychological review.

[69]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[70]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[71]  Bruce L. McNaughton,et al.  Progressive Transformation of Hippocampal Neuronal Representations in “Morphed” Environments , 2005, Neuron.

[72]  J. Lisman,et al.  Hippocampal sequence-encoding driven by a cortical multi-item working memory buffer , 2005, Trends in Neurosciences.

[73]  P. Somogyi,et al.  Defined types of cortical interneurone structure space and spike timing in the hippocampus , 2005, The Journal of physiology.

[74]  Mark R. Bower,et al.  Sequential-Context-Dependent Hippocampal Activity Is Not Necessary to Learn Sequences with Repeated Elements , 2005, The Journal of Neuroscience.

[75]  G. Buzsáki,et al.  Temporal Encoding of Place Sequences by Hippocampal Cell Assemblies , 2006, Neuron.

[76]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[77]  F. Gonzalez-Lima,et al.  VICARIOUS TRIAL-AND-ERROR BEHAVIOR AND HIPPOCAMPAL CYTOCHROME OXIDASE ACTIVITY DURING Y-MAZE DISCRIMINATION LEARNING IN THE RAT , 2006, The International journal of neuroscience.

[78]  J. O’Neill,et al.  Place-Selective Firing of CA1 Pyramidal Cells during Sharp Wave/Ripple Network Patterns in Exploratory Behavior , 2006, Neuron.

[79]  Jadin C. Jackson,et al.  Hippocampal Sharp Waves and Reactivation during Awake States Depend on Repeated Sequential Experience , 2006, The Journal of Neuroscience.

[80]  M. Shapiro,et al.  Episodic memory—From brain to mind , 2006, Hippocampus.

[81]  M. Quirk,et al.  Representation of Spatial Goals in Rat Orbitofrontal Cortex , 2006, Neuron.

[82]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.

[83]  M. Roesch,et al.  Orbitofrontal cortex, decision-making and drug addiction , 2006, Trends in Neurosciences.

[84]  E. Wood,et al.  Dissociating the past from the present in the activity of place cells , 2006, Hippocampus.

[85]  Bruno Poucet,et al.  Goal-Related Activity in Hippocampal Place Cells , 2007, The Journal of Neuroscience.

[86]  M. Hasselmo,et al.  Spatial Representations of Hippocampal CA1 Neurons Are Modulated by Behavioral Context in a Hippocampus-Dependent Memory Task , 2007, The Journal of Neuroscience.

[87]  D. Hassabis,et al.  Patients with hippocampal amnesia cannot imagine new experiences , 2007, Proceedings of the National Academy of Sciences.

[88]  Matthijs A. A. van der Meer,et al.  Exploring the role of context‐dependent hippocampal activity in spatial alternation behavior , 2007, Hippocampus.

[89]  Adam Johnson,et al.  A Computational Model of Craving and Obsession , 2007, Annals of the New York Academy of Sciences.

[90]  M. Tamosiunaite,et al.  Hippocampal CA1 Place Cells Encode Intended Destination on a Maze with Multiple Choice Points , 2007, The Journal of Neuroscience.

[91]  A. David Redish,et al.  Measuring distributed properties of neural representations beyond the decoding of local variables: Implications for cognition , 2008 .