Emergence of dynamically reconfigurable hippocampal responses by learning to perform probabilistic spatial reasoning

Navigation in natural environments is computationally difficult: Location errors from motion estimation noise accumulate over time, while landmarks can be spatially extended and often look alike, thus providing ambiguous data. The brain contains a number of spatially tuned neurons coding for various navigational variables, but current models do not explain how these circuits could implement navigational computations that involve non-trivial spatial reasoning. We show, using a function-first approach, that neural circuits trained to efficiently solve spatial reasoning problems with performance on par with sequential probabilistic strategies reproduce some key properties of hippocampal coding, including heterogeneous tuning, conjunctive tuning, and low-dimensional dynamics. In addition, the models predict the emergence of tuning to key latent variables that are neither present in the input data nor trained as the end result of the task, and exhibit a spontaneous dynamical reconfiguration of tuning across time during a task as the computational demands evolve, reminiscent of some of the more complex dynamics observed in the hippocampus including a switch between location and displacement coding modes. These results provide a new functional framework for understanding the rich phenomenology and potential capabilities of navigation codes in the hippocampus and associated brain areas.

[1]  Ila R. Fiete,et al.  Making our way through the world: Towards a functional understanding of the brain's spatial circuits , 2017 .

[2]  Surya Ganguli,et al.  A Multiplexed, Heterogeneous, and Adaptive Code for Navigation in Medial Entorhinal Cortex , 2017, Neuron.

[3]  William Bialek,et al.  Collective Behavior of Place and Non-place Neurons in the Hippocampal Network , 2016, Neuron.

[4]  Ingmar Kanitscheider,et al.  Training recurrent networks to generate hypotheses about how the brain solves hard navigation problems , 2016, NIPS.

[5]  Edvard I. Moser,et al.  Speed cells in the medial entorhinal cortex , 2015, Nature.

[6]  Surya Ganguli,et al.  Environmental Boundaries as an Error Correction Mechanism for Grid Cells , 2015, Neuron.

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  I. Fiete,et al.  A Model of Grid Cell Development through Spatial Exploration and Spike Time-Dependent Plasticity , 2014, Neuron.

[9]  Ha Hong,et al.  Performance-optimized hierarchical models predict neural responses in higher visual cortex , 2014, Proceedings of the National Academy of Sciences.

[10]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[11]  G. Buzsáki,et al.  Preconfigured, skewed distribution of firing rates in the hippocampus and entorhinal cortex. , 2013, Cell reports.

[12]  C. Barry,et al.  Specific evidence of low-dimensional continuous attractor dynamics in grid cells , 2013, Nature Neuroscience.

[13]  James J Knierim,et al.  Conflicts between Local and Global Spatial Frameworks Dissociate Neural Representations of the Lateral and Medial Entorhinal Cortex , 2013, The Journal of Neuroscience.

[14]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[15]  Lacey J. Kitch,et al.  Long-term dynamics of CA1 hippocampal place codes , 2013, Nature Neuroscience.

[16]  David Ball,et al.  Maintaining a Cognitive Map in Darkness: The Need to Fuse Boundary Knowledge with Path Integration , 2012, PLoS Comput. Biol..

[17]  C. T. Vorhies Life History of the Kangaroo Rat: Dipodomys Spectabilis Spectabilis Merriam... , 2012 .

[18]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[19]  J. O’Keefe,et al.  Boundary Vector Cells in the Subiculum of the Hippocampal Formation , 2009, The Journal of Neuroscience.

[20]  Yoram Burakyy,et al.  Accurate Path Integration in Continuous Attractor Network Models of Grid Cells , 2009 .

[21]  Michael S. Lewicki,et al.  Emergence of complex cell properties by learning to generalize in natural scenes , 2009, Nature.

[22]  M. Moser,et al.  Representation of Geometric Borders in the Entorhinal Cortex , 2008, Science.

[23]  J. O’Keefe,et al.  Grid cells and theta as oscillatory interference: Electrophysiological data from freely moving rats , 2008, Hippocampus.

[24]  Ila R Fiete,et al.  Grid cells: The position code, neural network models of activity, and the problem of learning , 2008, Hippocampus.

[25]  Kenneth H. Britten,et al.  Mechanisms of self-motion perception. , 2008, Annual review of neuroscience.

[26]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[27]  Eric A. Zilli,et al.  Gradual Translocation of Spatial Correlates of Neuronal Firing in the Hippocampus toward Prospective Reward Locations , 2006, Neuron.

[28]  Mark C. Fuhs,et al.  A Spin Glass Model of Path Integration in Rat Medial Entorhinal Cortex , 2006, The Journal of Neuroscience.

[29]  David J. Foster,et al.  Reverse replay of behavioural sequences in hippocampal place cells during the awake state , 2006, Nature.

[30]  K. Jeffery,et al.  The Boundary Vector Cell Model of Place Cell Firing and Spatial Memory , 2006, Reviews in the neurosciences.

[31]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[32]  B. McNaughton,et al.  Independent Codes for Spatial and Episodic Memory in Hippocampal Neuronal Ensembles , 2005, Science.

[33]  B. McNaughton,et al.  The contributions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats , 1983, Experimental Brain Research.

[34]  H. Mittelstaedt,et al.  Homing by path integration in a mammal , 1980, Naturwissenschaften.

[35]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[36]  K M Gothard,et al.  Dentate Gyrus and CA1 Ensemble Activity during Spatial Reference Frame Shifts in the Presence and Absence of Visual Input , 2001, The Journal of Neuroscience.

[37]  S. Molden,et al.  Accumulation of Hippocampal Place Fields at the Goal Location in an Annular Watermaze Task , 2001, The Journal of Neuroscience.

[38]  E. Save,et al.  Contribution of multiple sensory information to place field stability in hippocampal place cells , 2000, Hippocampus.

[39]  Aneta Stefanovska,et al.  On the overestimation of the correlation dimension , 1997 .

[40]  B L McNaughton,et al.  Path Integration and Cognitive Mapping in a Continuous Attractor Neural Network Model , 1997, The Journal of Neuroscience.

[41]  K M Gothard,et al.  Dynamics of Mismatch Correction in the Hippocampal Ensemble Code for Space: Interaction between Path Integration and Environmental Cues , 1996, The Journal of Neuroscience.

[42]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[43]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[44]  Terrence J. Sejnowski,et al.  ASSOCIATIVE MEMORY AND HIPPOCAMPAL PLACE CELLS , 1995 .

[45]  B. McNaughton,et al.  Comparison of spatial firing characteristics of units in dorsal and ventral hippocampus of the rat , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  R. Muller,et al.  On the directional firing properties of hippocampal place cells , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[47]  R. Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. II. Effects of environmental manipulations , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  R U Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[49]  R. Hampson,et al.  Hippocampal place cells: stereotypy and plasticity , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[50]  R Wehner,et al.  Path integration in desert ants, Cataglyphis fortis. , 1988, Proceedings of the National Academy of Sciences of the United States of America.

[51]  R. Muller,et al.  The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[52]  R. Passingham The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[53]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.