Manifold GPLVMs for discovering non-Euclidean latent structure in neural data

A common problem in neuroscience is to elucidate the collective neural representations of behaviorally important variables such as head direction, spatial location, upcoming movements, or mental spatial transformations. Often, these latent variables are internal constructs not directly accessible to the experimenter. Here, we propose a new probabilistic latent variable model to simultaneously identify the latent state and the way each neuron contributes to its representation in an unsupervised way. In contrast to previous models which assume Euclidean latent spaces, we embrace the fact that latent states often belong to symmetric manifolds such as spheres, tori, or rotation groups of various dimensions. We therefore propose the manifold Gaussian process latent variable model (mGPLVM), where neural responses arise from (i) a shared latent variable living on a specific manifold, and (ii) a set of non-parametric tuning curves determining how each neuron contributes to the representation. Cross-validated comparisons of models with different topologies can be used to distinguish between candidate manifolds, and variational inference enables quantification of uncertainty. We demonstrate the validity of the approach on several synthetic datasets and on calcium recordings from the ellipsoid body of Drosophila melanogaster. This circuit is known to encode head direction, and mGPLVM correctly recovers the ring topology expected from a neural population representing a single angular variable.

[1]  Rishidev Chaudhuri,et al.  The intrinsic attractor manifold and population dynamics of a canonical cognitive circuit across waking and sleep , 2019, Nature Neuroscience.

[2]  Razvan Pascanu,et al.  Vector-based navigation using grid-like representations in artificial agents , 2018, Nature.

[3]  Neil D. Lawrence,et al.  Bayesian Gaussian Process Latent Variable Model , 2010, AISTATS.

[4]  David Sussillo,et al.  Opening the Black Box: Low-Dimensional Dynamics in High-Dimensional Recurrent Neural Networks , 2013, Neural Computation.

[5]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[6]  Zoubin Ghahramani,et al.  Probabilistic machine learning and artificial intelligence , 2015, Nature.

[7]  Anqi Wu,et al.  Gaussian process based nonlinear latent structure discovery in multivariate spike train data , 2017, NIPS.

[8]  Gary Ulrich,et al.  Computer Generation of Distributions on the M‐Sphere , 1984 .

[9]  David J. Fleet,et al.  Topologically-constrained latent variable models , 2008, ICML '08.

[10]  Anqi Wu,et al.  Learning a latent manifold of odor representations from neural responses in piriform cortex , 2018, NeurIPS.

[11]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[12]  Julian Straub Bayesian Inference with the von-Mises-Fisher Distribution in 3 D , 2017 .

[13]  Kate Jeffery,et al.  An independent, landmark-dominated head direction signal in dysgranular retrosplenial cortex , 2016, Nature Neuroscience.

[14]  Surya Ganguli,et al.  A Multiplexed, Heterogeneous, and Adaptive Code for Navigation in Medial Entorhinal Cortex , 2017, Neuron.

[15]  Timothy E. J. Behrens,et al.  Organizing conceptual knowledge in humans with a gridlike code , 2016, Science.

[16]  Alon Rubin,et al.  Revealing neural correlates of behavior without behavioral measurements , 2019, Nature Communications.

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  L. Masullo,et al.  Genetically Defined Functional Modules for Spatial Orienting in the Mouse Superior Colliculus , 2019, Current Biology.

[19]  Ahmed M. Elgammal,et al.  Tracking People on a Torus , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Jens Clausen,et al.  Man, machine and in between , 2009, Nature.

[21]  Nicola De Cao,et al.  Hyperspherical Variational Auto-Encoders , 2018, UAI 2018.

[22]  Davi Bock,et al.  The Neuroanatomical Ultrastructure and Function of a Biological Ring Attractor , 2019, Neuron.

[23]  Zoubin Ghahramani,et al.  Unifying linear dimensionality reduction , 2014, 1406.0873.

[24]  Geoffrey E. Hinton,et al.  Bayesian Learning for Neural Networks , 1995 .

[25]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[26]  Søren Hauberg,et al.  Geodesic exponential kernels: When curvature and linearity conflict , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  John P. Cunningham,et al.  Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity , 2008, NIPS.

[28]  Neil D. Lawrence,et al.  Probabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models , 2005, J. Mach. Learn. Res..

[29]  G. Buzsáki,et al.  Internally-organized mechanisms of the head direction sense , 2015, Nature Neuroscience.

[30]  Jakob N. Foerster,et al.  Three-dimensional head-direction coding in the bat brain , 2014, Nature.

[31]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[32]  Scott W. Linderman,et al.  Reparameterization Gradients through Acceptance-Rejection Sampling Algorithms , 2016, AISTATS.

[33]  Søren Hauberg,et al.  Probabilistic Riemannian submanifold learning with wrapped Gaussian process latent variable models , 2019, AISTATS.

[34]  Byron M. Yu,et al.  Dimensionality reduction for large-scale neural recordings , 2014, Nature Neuroscience.

[35]  Caterina Trentin,et al.  Three-Dimensional Representation of Motor Space in the Mouse Superior Colliculus , 2018, Current Biology.

[36]  Patrick Forré,et al.  Reparameterizing Distributions on Lie Groups , 2019, AISTATS.

[37]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[38]  Richard E. Turner,et al.  The Multivariate Generalised von Mises Distribution: Inference and Applications , 2016, AAAI.

[39]  Johannes D. Seelig,et al.  Neural dynamics for landmark orientation and angular path integration , 2015, Nature.

[40]  K. Shenoy,et al.  Temporal complexity and heterogeneity of single-neuron activity in premotor and motor cortex. , 2007, Journal of neurophysiology.

[41]  Michalis K. Titsias,et al.  Variational Learning of Inducing Variables in Sparse Gaussian Processes , 2009, AISTATS.

[42]  Gurtej Kanwar,et al.  Normalizing Flows on Tori and Spheres , 2020, ICML.

[43]  Daan Wierstra,et al.  Stochastic Backpropagation and Approximate Inference in Deep Generative Models , 2014, ICML.

[44]  Kenneth D. Harris,et al.  High-dimensional geometry of population responses in visual cortex , 2019, Nat..

[45]  Iain Murray Introduction To Gaussian Processes , 2008 .

[46]  Chethan Pandarinath,et al.  Inferring single-trial neural population dynamics using sequential auto-encoders , 2017, Nature Methods.

[47]  Aasa Feragen,et al.  Wrapped Gaussian Process Regression on Riemannian Manifolds , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[48]  Dinesh Atchuthan,et al.  A micro Lie theory for state estimation in robotics , 2018, ArXiv.