Probing variability in a cognitive map using manifold inference from neural dynamics

Hippocampal neurons fire selectively in local behavioral contexts such as the position in an environment or phase of a task,1-3 and are thought to form a cognitive map of task-relevant variables.1,4,5 However, their activity varies over repeated behavioral conditions,6 such as different runs through the same position or repeated trials. Although widely observed across the brain,7-10 such variability is not well understood, and could reflect noise or structure, such as the encoding of additional cognitive information.6,11-13 Here, we introduce a conceptual model to explain variability in terms of underlying, population-level structure in single-trial neural activity. To test this model, we developed a novel unsupervised learning algorithm incorporating temporal dynamics, in order to characterize population activity as a trajectory on a nonlinear manifold—a space of possible network states. The manifold’s structure captures correlations between neurons and temporal relationships between states, constraints arising from underlying network architecture and inputs. Using measurements of activity over time but no information about exogenous behavioral variables, we recovered hippocampal activity manifolds during spatial and non-spatial cognitive tasks in rats. Manifolds were low-dimensional and smoothly encoded task-related variables, but contained an extra dimension reflecting information beyond the measured behavioral variables. Consistent with our model, neurons fired as a function of overall network state, and fluctuations in their activity across trials corresponded to variation in the underlying trajectory on the manifold. In particular, the extra dimension allowed the system to take different trajectories despite repeated behavioral conditions. Furthermore, the trajectory could temporarily decouple from current behavioral conditions and traverse neighboring manifold points corresponding to past, future, or nearby behavioral states. Our results suggest that trial-to-trial variability in the hippocampus is structured, and may reflect the operation of internal cognitive processes. The manifold structure of population activity is well-suited for organizing information to support memory,1,5,14 planning,12,15,16 and reinforcement learning.17,18 In general, our approach could find broader use in probing the organization and computational role of circuit dynamics in other brain regions.

[1]  Lacey J. Kitch,et al.  Long-term dynamics of CA1 hippocampal place codes , 2013, Nature Neuroscience.

[2]  Karel Svoboda,et al.  An orderly single-trial organization of population dynamics in premotor cortex predicts behavioral variability , 2018, bioRxiv.

[3]  David C Rowland,et al.  Place cells, grid cells, and memory. , 2015, Cold Spring Harbor perspectives in biology.

[4]  Lawrence K. Saul,et al.  Think Globally, Fit Locally: Unsupervised Learning of Low Dimensional Manifold , 2003, J. Mach. Learn. Res..

[5]  May-Britt Moser,et al.  The entorhinal grid map is discretized , 2012, Nature.

[6]  Joshua B. Tenenbaum,et al.  Sparse multidimensional scaling using land-mark points , 2004 .

[7]  C. Giovanni Galizia,et al.  Odor-Driven Attractor Dynamics in the Antennal Lobe Allow for Simple and Rapid Olfactory Pattern Classification , 2004, Neural Computation.

[8]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[9]  Donald B. Johnson,et al.  Efficient Algorithms for Shortest Paths in Sparse Networks , 1977, J. ACM.

[10]  Margaret F. Carr,et al.  Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval , 2011, Nature Neuroscience.

[11]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[12]  Brent Doiron,et al.  The mechanics of state-dependent neural correlations , 2016, Nature Neuroscience.

[13]  Peter Dayan,et al.  Improving Generalization for Temporal Difference Learning: The Successor Representation , 1993, Neural Computation.

[14]  Adam Johnson,et al.  Looking for cognition in the structure within the noise , 2009, Trends in Cognitive Sciences.

[15]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[16]  Sanjoy Dasgupta,et al.  A tree-based regressor that adapts to intrinsic dimension , 2012, J. Comput. Syst. Sci..

[17]  Lee E. Miller,et al.  Neural Manifolds for the Control of Movement , 2017, Neuron.

[18]  John D. Storey A direct approach to false discovery rates , 2002 .

[19]  Surya Ganguli,et al.  Unsupervised Discovery of Demixed, Low-Dimensional Neural Dynamics across Multiple Timescales through Tensor Component Analysis , 2017, Neuron.

[20]  Alan David Hutson,et al.  Resampling Methods for Dependent Data , 2004, Technometrics.

[21]  John P. Cunningham,et al.  Linear dynamical neural population models through nonlinear embeddings , 2016, NIPS.

[22]  Karl H. Wolf,et al.  Comparative review , 2011, J. Documentation.

[23]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[24]  Michael E. Tipping,et al.  Probabilistic Principal Component Analysis , 1999 .

[25]  Christian K. Machens,et al.  Variability in neural activity and behavior , 2014, Current Opinion in Neurobiology.

[26]  Yuri Dabaghian,et al.  Reconceiving the hippocampal map as a topological template , 2014, eLife.

[27]  Patrick J. F. Groenen,et al.  Modern Multidimensional Scaling: Theory and Applications , 2003 .

[28]  G. Laurent,et al.  Transient Dynamics versus Fixed Points in Odor Representations by Locust Antennal Lobe Projection Neurons , 2005, Neuron.

[29]  J. Munkres ALGORITHMS FOR THE ASSIGNMENT AND TRANSIORTATION tROBLEMS* , 1957 .

[30]  Wittawat Jitkrittum,et al.  Bayesian Manifold Learning: The Locally Linear Latent Variable Model (LL-LVM) , 2015, NIPS.

[31]  John J Hopfield,et al.  Neurodynamics of mental exploration , 2009, Proceedings of the National Academy of Sciences.

[32]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[33]  Timothy D. Hanks,et al.  Neural underpinnings of the evidence accumulator , 2016, Current Opinion in Neurobiology.

[34]  P. Groenen,et al.  Modern multidimensional scaling , 1996 .

[35]  A. Redish,et al.  Vicarious trial and error , 2016, Nature Reviews Neuroscience.

[36]  Tom Minka,et al.  Automatic Choice of Dimensionality for PCA , 2000, NIPS.

[37]  Sanjoy Dasgupta,et al.  Random projection trees and low dimensional manifolds , 2008, STOC.

[38]  M. Gromov Metric Structures for Riemannian and Non-Riemannian Spaces , 1999 .

[39]  H S Seung,et al.  How the brain keeps the eyes still. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[40]  W E Skaggs,et al.  Deciphering the hippocampal polyglot: the hippocampus as a path integration system. , 1996, The Journal of experimental biology.

[41]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[42]  Dmitriy Aronov,et al.  Mapping of a non-spatial dimension by the hippocampal/entorhinal circuit , 2017, Nature.

[43]  Byron M. Yu,et al.  Dimensionality reduction for large-scale neural recordings , 2014, Nature Neuroscience.

[44]  Chethan Pandarinath,et al.  LFADS - Latent Factor Analysis via Dynamical Systems , 2016, ArXiv.

[45]  A. Compte,et al.  Bump attractor dynamics in prefrontal cortex explains behavioral precision in spatial working memory , 2014, Nature Neuroscience.

[46]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[47]  John P. Cunningham,et al.  Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity , 2008, NIPS.

[48]  Matthew A. Wilson,et al.  A Bayesian nonparametric approach for uncovering rat hippocampal population codes during spatial navigation , 2016, Journal of Neuroscience Methods.

[49]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[50]  J. Csicsvari,et al.  Organization of cell assemblies in the hippocampus , 2003, Nature.

[51]  David J. Foster,et al.  Memory and Space: Towards an Understanding of the Cognitive Map , 2015, The Journal of Neuroscience.

[52]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[53]  R. Muller,et al.  The firing of hippocampal place cells predicts the future position of freely moving rats , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[54]  Matthew A. Wilson,et al.  Neural Representation of Spatial Topology in the Rodent Hippocampus , 2013, Neural Computation.

[55]  Anqi Wu,et al.  Gaussian process based nonlinear latent structure discovery in multivariate spike train data , 2017, NIPS.

[56]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[57]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[58]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[59]  Kimberly L. Stachenfeld,et al.  The hippocampus as a predictive map , 2017, Nature Neuroscience.

[60]  G. Buzsáki,et al.  Internally-organized mechanisms of the head direction sense , 2015, Nature Neuroscience.

[61]  L. Torgo,et al.  Inductive learning of tree-based regression models , 1999 .

[62]  Anthony C. Davison,et al.  Bootstrap Methods and Their Application , 1998 .

[63]  R. Muller,et al.  Place cell discharge is extremely variable during individual passes of the rat through the firing field. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[64]  Asohan Amarasingham,et al.  Internally Generated Cell Assembly Sequences in the Rat Hippocampus , 2008, Science.