Are place cells just memory cells? Memory compression leads to spatial tuning and history dependence

The observation of place cells has suggested that the hippocampus plays a special role in encoding spatial information. However, place cell responses are modulated by several non-spatial variables, and reported to be rather unstable. Here we propose a memory model of the hippocampus that provides a novel interpretation of place cells consistent with these observations. We hypothesize that the hippocampus is a memory device that takes advantage of the correlations between sensory experiences to generate compressed representations of the episodes that are stored in memory. A simple neural network model that can efficiently compress information naturally produces place cells that are similar to those observed in experiments. It predicts that the activity of these cells is variable and that the fluctuations of the place fields encode information about the recent history of sensory experiences. Place cells may simply be a consequence of a memory compression process implemented in the hippocampus. Significance Statement Numerous studies on humans revealed the importance of the hippocampus in memory formation. The rodent literature instead focused on the spatial representations that are observed in navigation experiments. Here we propose a simple model of the hippocampus that reconciles the main findings of the human and rodent studies. The model assumes that the hippocampus is a memory system that generates compressed representations of sensory experiences using previously acquired knowledge about the statistics of the world. These experiences can then be memorized more efficiently. The sensory experiences during the exploration of an environment, when compressed by the hippocampus, lead naturally to spatial representations similar to those observed in rodent studies and to the emergence of place cells.

[1]  Bruno A. Olshausen,et al.  The Sparse Manifold Transform , 2018, NeurIPS.

[2]  Blake S. Porter,et al.  Hippocampal Representation of Related and Opposing Memories Develop within Distinct, Hierarchically Organized Neural Schemas , 2014, Neuron.

[3]  Nicholas B. Turk-Browne,et al.  Complementary learning systems within the hippocampus: A neural network modeling approach to reconciling episodic memory with statistical learning , 2016, bioRxiv.

[4]  M. Moser,et al.  Understanding memory through hippocampal remapping , 2008, Trends in Neurosciences.

[5]  Stefano Fusi,et al.  Why neurons mix: high dimensionality for higher cognition , 2016, Current Opinion in Neurobiology.

[6]  Edmund T. Rolls,et al.  What determines the capacity of autoassociative memories in the brain? Network , 1991 .

[7]  Richard G. Baraniuk,et al.  Sparse Coding via Thresholding and Local Competition in Neural Circuits , 2008, Neural Computation.

[8]  Haim Sompolinsky,et al.  Optimal Degrees of Synaptic Connectivity , 2017, Neuron.

[9]  M. Moser,et al.  Representation of Geometric Borders in the Entorhinal Cortex , 2008, Science.

[10]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[11]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[12]  R. Muller,et al.  Place cell discharge is extremely variable during individual passes of the rat through the firing field. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[13]  G. Winocur,et al.  Memory for familiar environments learned in the remote past: fMRI studies of healthy people and an amnesic person with extensive bilateral hippocampal lesions , 2007, Hippocampus.

[14]  R. O’Reilly,et al.  Opinion TRENDS in Cognitive Sciences Vol.6 No.12 December 2002 , 2022 .

[15]  Andrew M. Wikenheiser,et al.  Changes in reward contingency modulate the trial-to-trial variability of hippocampal place cells. , 2011, Journal of neurophysiology.

[16]  Zhisen J Urgolites,et al.  Map reading, navigating from maps, and the medial temporal lobe , 2016, Proceedings of the National Academy of Sciences.

[17]  J. O’Keefe,et al.  Boundary Vector Cells in the Subiculum of the Hippocampal Formation , 2009, The Journal of Neuroscience.

[18]  Per B. Sederberg,et al.  The Successor Representation and Temporal Context , 2012, Neural Computation.

[19]  G. Buzsáki,et al.  Single granule cells reliably discharge targets in the hippocampal CA3 network in vivo , 2002, Nature Neuroscience.

[20]  M. Tsodyks,et al.  The Enhanced Storage Capacity in Neural Networks with Low Activity Level , 1988 .

[21]  A. Redish Beyond the Cognitive Map: From Place Cells to Episodic Memory , 1999 .

[22]  Attila Losonczy,et al.  Sublayer-Specific Coding Dynamics during Spatial Navigation and Learning in Hippocampal Area CA1 , 2016, Neuron.

[23]  J. Nadal,et al.  Information capacity of a perceptron , 1992 .

[24]  Stefano Fusi,et al.  A distributed neural code in ensembles of dentate gyrus granule cells , 2018, bioRxiv.

[25]  Surya Ganguli,et al.  Environmental Boundaries as an Error Correction Mechanism for Grid Cells , 2015, Neuron.

[26]  Stefano Fusi Computational models of long term plasticity and memory , 2017, 1706.04946.

[27]  Moser Edvard,et al.  Pattern Separation in the Dentate Gyrus , 2009 .

[28]  Torkel Hafting,et al.  Conjunctive Representation of Position, Direction, and Velocity in Entorhinal Cortex , 2006, Science.

[29]  Simona Cocco,et al.  ‘Place-cell’ emergence and learning of invariant data with restricted Boltzmann machines: breaking and dynamical restoration of continuous symmetries in the weight space , 2019, Journal of Physics A: Mathematical and Theoretical.

[30]  Sandro Romani,et al.  The Statistical Structure of the Hippocampal Code for Space as a Function of Time, Context, and Value , 2019, Cell.

[31]  C. Stark,et al.  Pattern Separation in the Human Hippocampal CA3 and Dentate Gyrus , 2008, Science.

[32]  Gutfreund Neural networks with hierarchically correlated patterns. , 1988, Physical review. A, General physics.

[33]  Samuel Gershman,et al.  Design Principles of the Hippocampal Cognitive Map , 2014, NIPS.

[34]  H. Eichenbaum Barlow versus Hebb: When is it time to abandon the notion of feature detectors and adopt the cell assembly as the unit of cognition? , 2017, Neuroscience Letters.

[35]  Kristin M. Scaplen,et al.  Objects and landmarks: Hippocampal place cells respond differently to manipulations of visual cues depending on size, perspective, and experience , 2014, Hippocampus.

[36]  Surya Ganguli,et al.  Principles governing the integration of landmark and self-motion cues in entorhinal cortical codes for navigation , 2018, Nature Neuroscience.

[37]  Marc W. Howard,et al.  Predicting the Future with Multi-scale Successor Representations , 2018, bioRxiv.

[38]  C. Stark,et al.  Pattern separation in the hippocampus , 2011, Trends in Neurosciences.

[39]  R. Clark Current Topics Regarding the Function of the Medial Temporal Lobe Memory System. , 2018, Current topics in behavioral neurosciences.

[40]  Daniel J. Amit,et al.  Learning in Neural Networks with Material Synapses , 1994, Neural Computation.

[41]  Surya Ganguli,et al.  Cell types for our sense of location: where we are and where we are going , 2017, Nature Neuroscience.

[42]  H. Eichenbaum The role of the hippocampus in navigation is memory. , 2017, Journal of neurophysiology.

[43]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[44]  James L. McClelland,et al.  What Learning Systems do Intelligent Agents Need? Complementary Learning Systems Theory Updated , 2016, Trends in Cognitive Sciences.

[45]  L F Abbott,et al.  Modular Realignment of Entorhinal Grid Cell Activity as a Basis for Hippocampal Remapping , 2011, The Journal of Neuroscience.

[46]  Stefano Fusi,et al.  Prototype extraction in material attractor neural networks with stochastic dynamic learning , 1995, SPIE Defense + Commercial Sensing.

[47]  I. Khalatnikov,et al.  30 Years of the Landau Institute — Selected Papers , 1996 .

[48]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[49]  L. Nadel,et al.  Viewpoints: how the hippocampus contributes to memory, navigation and cognition , 2017, Nature Neuroscience.

[50]  Anirvan M. Sengupta,et al.  Manifold-tiling Localized Receptive Fields are Optimal in Similarity-preserving Neural Networks , 2018, bioRxiv.

[51]  M. Moser,et al.  Pattern Separation in the Dentate Gyrus and CA3 of the Hippocampus , 2007, Science.

[52]  Lev B. Ioffe,et al.  The Augmented Models of Associative Memory Asymmetric Interaction and Hierarchy of Patterns - Int. J. Mod. Phys. B1, 51 (1987) , 1987 .

[53]  Dmitriy Aronov,et al.  Mapping of a non-spatial dimension by the hippocampal/entorhinal circuit , 2017, Nature.

[54]  S. Molden,et al.  Accumulation of Hippocampal Place Fields at the Goal Location in an Annular Watermaze Task , 2001, The Journal of Neuroscience.

[55]  R. Muller,et al.  The effects of changes in the environment on the spatial firing of hippocampal complex-spike cells , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[56]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[57]  Anirvan M. Sengupta,et al.  Why Do Similarity Matching Objectives Lead to Hebbian/Anti-Hebbian Networks? , 2017, Neural Computation.

[58]  Lacey J. Kitch,et al.  Long-term dynamics of CA1 hippocampal place codes , 2013, Nature Neuroscience.

[59]  M. Gluck,et al.  Hippocampal mediation of stimulus representation: A computational theory , 1993, Hippocampus.

[60]  David J. Foster,et al.  Memory and Space: Towards an Understanding of the Cognitive Map , 2015, The Journal of Neuroscience.

[61]  Peter Dayan,et al.  Improving Generalization for Temporal Difference Learning: The Successor Representation , 1993, Neural Computation.

[62]  N. Alex Cayco-Gajic,et al.  Re-evaluating Circuit Mechanisms Underlying Pattern Separation , 2019, Neuron.

[63]  L. Abbott,et al.  Cascade Models of Synaptically Stored Memories , 2005, Neuron.

[64]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[65]  G. Toulouse,et al.  Ultrametricity for physicists , 1986 .

[66]  Stefano Fusi,et al.  Computational principles of synaptic memory consolidation , 2016, Nature Neuroscience.

[67]  Surya Ganguli,et al.  Emergent elasticity in the neural code for space , 2018, Proceedings of the National Academy of Sciences.

[68]  Pablo E. Jercog,et al.  Heading direction with respect to a reference point modulates place-cell activity , 2018, Nature Communications.

[69]  Stefano Fusi,et al.  A Distributed Neural Code in the Dentate Gyrus and in CA1 , 2020, Neuron.

[70]  Surya Ganguli,et al.  A Multiplexed, Heterogeneous, and Adaptive Code for Navigation in Medial Entorhinal Cortex , 2017, Neuron.

[71]  Jill K. Leutgeb,et al.  Grid and Nongrid Cells in Medial Entorhinal Cortex Represent Spatial Location and Environmental Features with Complementary Coding Schemes , 2017, Neuron.

[72]  Stefano Fusi,et al.  The Sparseness of Mixed Selectivity Neurons Controls the Generalization–Discrimination Trade-Off , 2013, The Journal of Neuroscience.

[73]  W. Maass,et al.  State-dependent computations: spatiotemporal processing in cortical networks , 2009, Nature Reviews Neuroscience.

[74]  H. Sompolinsky,et al.  Sparseness and Expansion in Sensory Representations , 2014, Neuron.

[75]  Caswell Barry,et al.  The Tolman-Eichenbaum Machine: Unifying Space and Relational Memory through Generalization in the Hippocampal Formation , 2019, Cell.

[76]  Eric Shea-Brown,et al.  Signatures and mechanisms of low-dimensional neural predictive manifolds , 2018, bioRxiv.

[77]  Edmund T. Rolls,et al.  The relative advantages of sparse versus distributed encoding for associative neuronal networks in the brain , 1990 .

[78]  James L. McClelland,et al.  Considerations arising from a complementary learning systems perspective on hippocampus and neocortex , 1996, Hippocampus.