Conjunctive reward–place coding properties of dorsal distal CA1 hippocampus cells

Autonomous motivated spatial navigation in animals or robots requires the association between spatial location and value. Hippocampal place cells are involved in goal-directed spatial navigation and the consolidation of spatial memories. Recently, Gauthier and Tank (Neuron 99(1):179–193, 2018. https://doi.org/10.1016/j.neuron.2018.06.008 ) have identified a subpopulation of hippocampal cells selectively activated in relation to rewarded goals. However, the relationship between these cells’ spiking activity and goal representation remains elusive. We analyzed data from experiments in which rats underwent five consecutive tasks in which reward locations and spatial context were manipulated. We found CA1 populations with properties continuously ranging from place cells to reward cells. Specifically, we found typical place cells insensitive to reward locations, reward cells that only fired at correct rewarded feeders in each task regardless of context, and “hybrid cells” that responded to spatial locations and change of reward locations. Reward cells responded mostly to the reward delivery rather than to its expectation. In addition, we found a small group of neurons that transitioned between place and reward cells properties within the 5-task session. We conclude that some pyramidal cells (if not all) integrate both spatial and reward inputs to various degrees. These results provide insights into the integrative coding properties of CA1 pyramidal cells, focusing on their abilities to carry both spatial and reward information in a mixed and plastic manner. This conjunctive coding property prompts a re-thinking of current computational models of spatial navigation in which hippocampal spatial and subcortical value representations are independent.

[1]  Morris Moscovitch,et al.  The hippocampus and related neocortical structures in memory transformation , 2018, Neuroscience Letters.

[2]  Ricardo Chavarriaga,et al.  Robust self-localisation and navigation based on hippocampal place cells , 2005, Neural Networks.

[3]  Susumu Tonegawa,et al.  Conjunctive input processing drives feature selectivity in hippocampal CA1 neurons , 2015, Nature Neuroscience.

[4]  B. McNaughton,et al.  Offline reactivation of experience-dependent neuronal firing patterns in the rat ventral tegmental area. , 2015, Journal of neurophysiology.

[5]  Jeffrey L. Gauthier,et al.  A Dedicated Population for Reward Coding in the Hippocampus , 2018, Neuron.

[6]  Neil Burgess,et al.  Using Grid Cells for Navigation , 2015, Neuron.

[7]  Charlotte N. Boccara,et al.  Grid cells in pre- and parasubiculum , 2010, Nature Neuroscience.

[8]  N. Burgess,et al.  The Cognitive Architecture of Spatial Navigation: Hippocampal and Striatal Contributions , 2015, Neuron.

[9]  J. Knierim The hippocampus , 2015, Current Biology.

[10]  David C Rowland,et al.  Place cells, grid cells, and memory. , 2015, Cold Spring Harbor perspectives in biology.

[11]  B. McNaughton,et al.  The Ventral Striatum in Off-Line Processing: Ensemble Reactivation during Sleep and Modulation by Hippocampal Ripples , 2004, The Journal of Neuroscience.

[12]  Peter Ford Dominey,et al.  Reservoir computing model of prefrontal cortex creates novel combinations of previous navigation sequences from hippocampal place-cell replay with spatial reward propagation , 2019, PLoS Comput. Biol..

[13]  David M. Smith,et al.  Hippocampal place cells, context, and episodic memory , 2006, Hippocampus.

[14]  H. Eichenbaum What Versus Where: Non-spatial Aspects of Memory Representation by the Hippocampus. , 2016, Current topics in behavioral neurosciences.

[15]  C. Barry,et al.  The Role of Hippocampal Replay in Memory and Planning , 2018, Current Biology.

[16]  W E Skaggs,et al.  Interactions between location and task affect the spatial and directional firing of hippocampal neurons , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[18]  Wei-jun Tang,et al.  NMDA receptor‐gated visual responses in hippocampal CA1 neurons , 2018, The Journal of physiology.

[19]  T. Ono,et al.  Contribution of hippocampal place cell activity to learning and formation of goal-directed navigation in rats , 2003, Neuroscience.

[20]  A. Fenton,et al.  Ensemble Place Codes in Hippocampus: CA1, CA3, and Dentate Gyrus Place Cells Have Multiple Place Fields in Large Environments , 2011, PloS one.

[21]  S. Mizumori,et al.  Hippocampal neural activity reflects the economy of choices during goal‐directed navigation , 2017, Hippocampus.

[22]  S. Mizumori,et al.  Directionally selective mnemonic properties of neurons in the lateral dorsal nucleus of the thalamus of rats , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  L. Nadel,et al.  Systems consolidation revisited, but not revised: The promise and limits of optogenetics in the study of memory , 2017, Neuroscience Letters.

[24]  G. Buzsáki,et al.  Forward and reverse hippocampal place-cell sequences during ripples , 2007, Nature Neuroscience.

[25]  L. Nadel,et al.  Multiple trace theory of human memory: Computational, neuroimaging, and neuropsychological results , 2000, Hippocampus.

[26]  B. Poucet,et al.  Remembering goal locations , 2017, Current Opinion in Behavioral Sciences.

[27]  J. O’Keefe,et al.  Hippocampal Complex Spike Cells do not Change Their Place Fields if the Goal is Moved Within a Cue Controlled Environment , 1990, The European journal of neuroscience.

[28]  Sachin S. Deshmukh,et al.  Influence of local objects on hippocampal representations: Landmark vectors and memory , 2013, Hippocampus.

[29]  Daeyeol Lee,et al.  Hippocampal Neural Correlates for Values of Experienced Events , 2012, The Journal of Neuroscience.

[30]  K. Deisseroth,et al.  Place field assembly distribution encodes preferred locations , 2017, PLoS biology.

[31]  Edvard I. Moser,et al.  Object-vector coding in the medial entorhinal cortex , 2018, bioRxiv.

[32]  J. O’Keefe,et al.  Boundary Vector Cells in the Subiculum of the Hippocampal Formation , 2009, The Journal of Neuroscience.

[33]  Martin Llofriu,et al.  Goal-oriented robot navigation learning using a multi-scale space representation , 2015, Neural Networks.

[34]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[35]  Denise Manahan-Vaughan,et al.  Spatial Olfactory Learning Contributes to Place Field Formation in the Hippocampus , 2013, Cerebral cortex.

[36]  K. Berridge,et al.  Pleasure Systems in the Brain , 2015, Neuron.

[37]  Bruce L. McNaughton,et al.  Experience-dependent firing rate remapping generates directional selectivity in hippocampal place cells , 2012, Front. Neural Circuits.

[38]  Bernhard Schölkopf,et al.  View-Based Cognitive Mapping and Path Planning , 1995, Adapt. Behav..

[39]  B. McNaughton,et al.  Hippocampus Leads Ventral Striatum in Replay of Place-Reward Information , 2009, PLoS biology.

[40]  L. Frank,et al.  Rewarded Outcomes Enhance Reactivation of Experience in the Hippocampus , 2009, Neuron.

[41]  Torkel Hafting,et al.  Conjunctive Representation of Position, Direction, and Velocity in Entorhinal Cortex , 2006, Science.

[42]  G. Buzsáki,et al.  Distinct Representations and Theta Dynamics in Dorsal and Ventral Hippocampus , 2010, The Journal of Neuroscience.

[43]  L. Frank,et al.  Awake Hippocampal Sharp-Wave Ripples Support Spatial Memory , 2012, Science.

[44]  B Poucet,et al.  Study of CA1 place cell activity and exploratory behavior following spatial and nonspatial changes in the environment , 2005, Hippocampus.

[45]  A Schnee,et al.  Rats are able to navigate in virtual environments , 2005, Journal of Experimental Biology.

[46]  Amiram Grinvald,et al.  Accurate spike estimation from noisy calcium signals for ultrafast three-dimensional imaging of large neuronal populations in vivo , 2016, Nature Communications.

[47]  K. Allen,et al.  Hippocampal Remapping and Its Entorhinal Origin , 2018, Front. Behav. Neurosci..

[48]  B. J. Clark,et al.  Interaction of Egocentric and World-Centered Reference Frames in the Rat Posterior Parietal Cortex , 2014, The Journal of Neuroscience.

[49]  Angelo Arleo,et al.  Insensitivity of Place Cells to the Value of Spatial Goals in a Two-Choice Flexible Navigation Task , 2019, The Journal of Neuroscience.

[50]  Attila Losonczy,et al.  Sublayer-Specific Coding Dynamics during Spatial Navigation and Learning in Hippocampal Area CA1 , 2016, Neuron.

[51]  M. Arbib,et al.  Multiple representations of space underlying behavior , 1982, Behavioral and Brain Sciences.

[52]  K. Jeffery,et al.  The Boundary Vector Cell Model of Place Cell Firing and Spatial Memory , 2006, Reviews in the neurosciences.

[53]  Eric A. Zilli,et al.  Gradual Translocation of Spatial Correlates of Neuronal Firing in the Hippocampus toward Prospective Reward Locations , 2006, Neuron.

[54]  J. Taube Head direction cells recorded in the anterior thalamic nuclei of freely moving rats , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[55]  E. Buffalo,et al.  Spatial responses, immediate experience, and memory in the monkey hippocampus , 2017, Current Opinion in Behavioral Sciences.

[56]  R. Wise,et al.  Linking Context with Reward: A Functional Circuit from Hippocampal CA3 to Ventral Tegmental Area , 2011, Science.

[57]  M. Moser,et al.  Representation of Geometric Borders in the Entorhinal Cortex , 2008, Science.

[58]  J. O’Neill,et al.  The reorganization and reactivation of hippocampal maps predict spatial memory performance , 2010, Nature Neuroscience.

[59]  E. Rolls,et al.  Reward-Spatial View Representations and Learning in the Primate Hippocampus , 2005, The Journal of Neuroscience.

[60]  F. Wörgötter,et al.  Hippocampal place cells encode intended destination, and not a discriminative stimulus, in a conditional T‐maze task , 2012, Hippocampus.

[61]  Jean-Marc Fellous,et al.  Remaking memories: reconsolidation updates positively motivated spatial memory in rats. , 2012, Learning & memory.

[62]  M. Moser,et al.  Understanding memory through hippocampal remapping , 2008, Trends in Neurosciences.

[63]  M. Wilson,et al.  Temporal coding and rate remapping: Representation of nonspatial information in the hippocampus , 2018, Hippocampus.

[64]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[65]  Michael E Hasselmo,et al.  Neural mechanisms of navigation involving interactions of cortical and subcortical structures. , 2018, Journal of neurophysiology.

[66]  Jean-Marc Fellous,et al.  Contextual reminders fail to trigger memory reconsolidation in aged rats and aged humans , 2015, Neurobiology of Learning and Memory.

[67]  T. Bliss,et al.  Synaptic plasticity, memory and the hippocampus: a neural network approach to causality , 2012, Nature Reviews Neuroscience.

[68]  S. Molden,et al.  Accumulation of Hippocampal Place Fields at the Goal Location in an Annular Watermaze Task , 2001, The Journal of Neuroscience.

[69]  Michael A. Arbib,et al.  NeWG: In Search of the Rat's World Graph , 1997, J. Braz. Comput. Soc..

[70]  Rosa Cossart,et al.  Awake hippocampal reactivations project onto orthogonal neuronal assemblies , 2016, Science.

[71]  Stefan Leutgeb,et al.  Hippocampal Global Remapping Can Occur without Input from the Medial Entorhinal Cortex , 2018, Cell reports.