Cognitive Neural Ensembles in CA 3 Transiently Encode Paths Forward of the Animal at a Decision Point

Neural ensembles were recorded from the CA3 region of rats running on T-based decision tasks. Examination of neural representations of space at fast time scales revealed a transient but repeatable phenomenon as rats made a decision: the location reconstructed from the neural ensemble swept forward, first down one path and then the other. Estimated representations were coherent and preferentially swept ahead of the animal rather than behind the animal, implying it represented future possibilities rather than recently traveled paths. Similar phenomena occurred at other important decisions (such as in recovery from an error). Local field potentials from these sites contained pronounced theta and gamma frequencies, but no sharp wave frequencies. Forward-shifted spatial representations were influenced by task demands and experience. These data suggest that the hippocampus does not represent space as a passive computation, but rather that hippocampal spatial processing is an active process likely regulated by cognitive mechanisms.

[1]  G. Buzsáki,et al.  Temporal Encoding of Place Sequences by Hippocampal Cell Assemblies , 2006, Neuron.

[2]  C. Hudon,et al.  Spatial memory and choice behavior in the radial arm maze after fornix transection , 2002, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[3]  B. McNaughton,et al.  Reactivation of Hippocampal Cell Assemblies: Effects of Behavioral State, Experience, and EEG Dynamics , 1999, The Journal of Neuroscience.

[4]  R. Carelli.  Nucleus accumbens cell firing during goal-directed behaviors for cocaine vs. ‘natural’ reinforcement , 2002, Physiology & Behavior.

[5]  Bruno Poucet,et al.  Goal-Related Activity in Hippocampal Place Cells , 2007, The Journal of Neuroscience.

[6]  G. Buzsáki,et al.  tFast Network Oscillations in the Hippocampal CA1 Region of the Behaving Rat , 1999, The Journal of Neuroscience.

[7]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[8]  T. Ono,et al.  Effects of reward anticipation, reward presentation, and spatial parameters on the firing of single neurons recorded in the subiculum and nucleus accumbens of freely moving rats , 2000, Behavioural Brain Research.

[9]  O Jensen,et al.  An Oscillatory Short-Term Memory Buffer Model Can Account for Data on the Sternberg Task , 1998, The Journal of Neuroscience.

[10]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[11]  A. Redish,et al.  Neuronal activity in the rodent dorsal striatum in sequential navigation: separation of spatial and reward responses on the multiple T task. , 2004, Journal of neurophysiology.

[12]  Michael E. Hasselmo,et al.  Modeling goal-directed spatial navigation in the rat based on physiological data from the hippocampal formation , 2003, Neural Networks.

[13]  R. Carelli,et al.  Evidence That Separate Neural Circuits in the Nucleus Accumbens Encode Cocaine Versus “Natural” (Water and Food) Reward , 2000, The Journal of Neuroscience.

[14]  W. Scoville,et al.  LOSS OF RECENT MEMORY AFTER BILATERAL HIPPOCAMPAL LESIONS , 1957, Journal of neurology, neurosurgery, and psychiatry.

[15]  F. Gonzalez-Lima,et al.  VICARIOUS TRIAL-AND-ERROR BEHAVIOR AND HIPPOCAMPAL CYTOCHROME OXIDASE ACTIVITY DURING Y-MAZE DISCRIMINATION LEARNING IN THE RAT , 2006, The International journal of neuroscience.

[16]  A. Redish.  Beyond the Cognitive Map: From Place Cells to Episodic Memory , 1999 .

[17]  Patrick D Martin.  Locomotion towards a goal alters the synchronous firing of neurons recorded simultaneously in the subiculum and nucleus accumbens of rats , 2001, Behavioural Brain Research.

[18]  M. Wilson,et al.  Trajectory Encoding in the Hippocampus and Entorhinal Cortex , 2000, Neuron.

[19]  A. David Redish,et al.  Measuring distributed properties of neural representations beyond the decoding of local variables: Implications for cognition , 2008 .

[20]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[21]  M. Hasselmo,et al.  Spatial Representations of Hippocampal CA1 Neurons Are Modulated by Behavioral Context in a Hippocampus-Dependent Memory Task , 2007, The Journal of Neuroscience.

[22]  P. Somogyi,et al.  Brain-state- and cell-type-specific firing of hippocampal interneurons in vivo , 2003, Nature.

[23]  J. Lisman,et al.  Position reconstruction from an ensemble of hippocampal place cells: contribution of theta phase coding. , 2000, Journal of neurophysiology.

[24]  Yoko Yamaguchi,et al.  A theory of hippocampal memory based on theta phase precession , 2003, Biological Cybernetics.

[25]  L. Swanson.  Cerebral hemisphere regulation of motivated behavior 1 1 Published on the World Wide Web on 2 November 2000. , 2000, Brain Research.

[26]  J. O’Neill,et al.  Place-Selective Firing of CA1 Pyramidal Cells during Sharp Wave/Ripple Network Patterns in Exploratory Behavior , 2006, Neuron.

[27]  M. F. Brown,et al.  Does a cognitive map guide choices in the radial-arm maze? , 1992, Journal of experimental psychology. Animal behavior processes.

[28]  J. O’Keefe,et al.  Single unit activity in the rat hippocampus during a spatial memory task , 2004, Experimental Brain Research.

[29]  D. Finch,et al.  Neurophysiology of converging synaptic inputs from the rat prefrontal cortex, amygdala, midline thalamus, and hippocampal formation onto single neurons of the caudate/putamen and nucleus accumbens , 1996, Hippocampus.

[30]  E. Tulving.  Précis of Elements of episodic memory , 1984, Behavioral and Brain Sciences.

[31]  K. Miyazaki,et al.  Reward‐quality dependent anticipation in rat nucleus accumbens , 1998, Neuroreport.

[32]  Vincent Hayward,et al.  Discrete-time adaptive windowing for velocity estimation , 2000, IEEE Trans. Control. Syst. Technol..

[33]  M. Roesch,et al.  Orbitofrontal Cortex, Associative Learning, and Expectancies , 2005, Neuron.

[34]  D. Hassabis,et al.  Patients with hippocampal amnesia cannot imagine new experiences , 2007, Proceedings of the National Academy of Sciences.

[35]  Jadin C. Jackson,et al.  Hippocampal Sharp Waves and Reactivation during Awake States Depend on Repeated Sequential Experience , 2006, The Journal of Neuroscience.

[36]  Marc W Howard,et al.  The temporal context model in spatial navigation and relational learning: toward a common explanation of medial temporal lobe function across domains. , 2005, Psychological review.

[37]  M. Shapiro,et al.  Episodic memory—From brain to mind , 2006, Hippocampus.

[38]  L. Squire.  Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans. , 1992, Psychological review.

[39]  H. Eichenbaum,et al.  Hippocampal Neurons Encode Information about Different Types of Memory Episodes Occurring in the Same Location , 2000, Neuron.

[40]  J. D. McGaugh,et al.  Inactivation of Hippocampus or Caudate Nucleus with Lidocaine Differentially Affects Expression of Place and Response Learning , 1996, Neurobiology of Learning and Memory.

[41]  M. Gluck,et al.  Interactive memory systems in the human brain , 2001, Nature.

[42]  E. Loftus,et al.  Reconstruction of automobile destruction: An example of the interaction between language and memory , 1974 .

[43]  D. Hu,et al.  A simple test of the vicarious trial-and-error hypothesis of hippocampal function. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[44]  A. Lavoie,et al.  Spatial, movement- and reward-sensitive discharge by medial ventral striatum neurons of rats , 1994, Brain Research.

[45]  John O'Keefe,et al.  Independent rate and temporal coding in hippocampal pyramidal cells , 2003, Nature.

[46]  M. Quirk,et al.  Representation of Spatial Goals in Rat Orbitofrontal Cortex , 2006, Neuron.

[47]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[48]  J. Csicsvari,et al.  Replay and Time Compression of Recurring Spike Sequences in the Hippocampus , 1999, The Journal of Neuroscience.

[49]  B. McNaughton,et al.  Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences , 1996, Hippocampus.

[50]  Matthijs A. A. van der Meer,et al.  Exploring the role of context‐dependent hippocampal activity in spatial alternation behavior , 2007, Hippocampus.

[51]  L. Nadel,et al.  Memory consolidation, retrograde amnesia and the hippocampal complex , 1997, Current Opinion in Neurobiology.

[52]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.

[53]  Richard S. J. Frackowiak,et al.  Recalling Routes around London: Activation of the Right Hippocampus in Taxi Drivers , 1997, The Journal of Neuroscience.

[54]  G. Buzsáki,et al.  Sharp wave-associated high-frequency oscillation (200 Hz) in the intact hippocampus: network and intracellular mechanisms , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[55]  J. O’Keefe,et al.  Phase relationship between hippocampal place units and the EEG theta rhythm , 1993, Hippocampus.

[56]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[57]  B. McNaughton,et al.  The Ventral Striatum in Off-Line Processing: Ensemble Reactivation during Sleep and Modulation by Hippocampal Ripples , 2004, The Journal of Neuroscience.

[58]  M. Roesch,et al.  Orbitofrontal cortex, decision-making and drug addiction , 2006, Trends in Neurosciences.

[59]  B. McNaughton,et al.  Hippocampal synaptic enhancement and information storage within a distributed memory system , 1987, Trends in Neurosciences.

[60]  Albert K. Lee,et al.  Memory of Sequential Experience in the Hippocampus during Slow Wave Sleep , 2002, Neuron.

[61]  M. Domjan.  The principles of learning and behavior , 1982 .

[62]  H. Eichenbaum.  Hippocampus Cognitive Processes and Neural Representations that Underlie Declarative Memory , 2004, Neuron.

[63]  Adam Johnson,et al.  A Computational Model of Craving and Obsession , 2007, Annals of the New York Academy of Sciences.

[64]  A. Redish,et al.  Development of path stereotypy in a single day in rats on a multiple-T maze. , 2002, Archives italiennes de biologie.

[65]  K. F. Muenzinger.  Vicarious Trial and Error at a Point of Choice: I. A General Survey of its Relation to Learning Efficiency , 1938 .

[66]  Bruce L. McNaughton,et al.  Progressive Transformation of Hippocampal Neuronal Representations in “Morphed” Environments , 2005, Neuron.

[67]  A. Redish,et al.  Measuring fundamental frequencies in local field potentials , 2004, Journal of Neuroscience Methods.

[68]  R. Passingham.  The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[69]  E. Tolman.  Prediction of vicarious trial and error by means of the schematic sowbug. , 1939 .

[70]  E N Brown,et al.  A Statistical Paradigm for Neural Spike Train Decoding Applied to Position Prediction from Ensemble Firing Patterns of Rat Hippocampal Place Cells , 1998, The Journal of Neuroscience.

[71]  A. Treves,et al.  Distinct Ensemble Codes in Hippocampal Areas CA3 and CA1 , 2004, Science.

[72]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[73]  B. McNaughton,et al.  Hippocampal map realignment and spatial learning , 2003, Nature Neuroscience.

[74]  Bruno Poucet,et al.  Relationships between Place Cell Firing Fields and Navigational Decisions by Rats , 2002, The Journal of Neuroscience.

[75]  R. Carelli,et al.  Behavioral/Systems/Cognitive Selective Encoding of Cocaine versus Natural Rewards by Nucleus Accumbens Neurons Is Not Related to Chronic Drug Exposure , 2022 .

[76]  W. Schultz,et al.  Neuronal activity in monkey ventral striatum related to the expectation of reward , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[77]  J. Lisman,et al.  Hippocampal sequence-encoding driven by a cortical multi-item working memory buffer , 2005, Trends in Neurosciences.

[78]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[79]  N. Daw,et al.  Reinforcement learning models of the dopamine system and their behavioral implications , 2003 .

[80]  P. Somogyi,et al.  Defined types of cortical interneurone structure space and spike timing in the hippocampus , 2005, The Journal of physiology.

[81]  Mark R. Bower,et al.  Sequential-Context-Dependent Hippocampal Activity Is Not Necessary to Learn Sequences with Repeated Elements , 2005, The Journal of Neuroscience.

[82]  M. Tamosiunaite,et al.  Hippocampal CA1 Place Cells Encode Intended Destination on a Maze with Multiple Choice Points , 2007, The Journal of Neuroscience.

[83]  H. Eichenbaum,et al.  Memory, amnesia, and the hippocampal system , 1993 .

[84]  A. Mcgeorge,et al.  The organization of the projection from the cerebral cortex to the striatum in the rat , 1989, Neuroscience.

[85]  M. Shapiro,et al.  Prospective and Retrospective Memory Coding in the Hippocampus , 2003, Neuron.

[86]  S. Nicola,et al.  The Ventral Tegmental Area Is Required for the Behavioral and Nucleus Accumbens Neuronal Firing Responses to Incentive Cues , 2004, The Journal of Neuroscience.