Temporal alignment and latent Gaussian process factor inference in population spike trains

We introduce a novel scalable approach to identifying common latent structure in neural population spike-trains, which allows for variability both in the trajectory and in the rate of progression of the underlying computation. Our approach is based on shared latent Gaussian processes (GPs) which are combined linearly, as in the Gaussian Process Factor Analysis (GPFA) algorithm. We extend GPFA to handle unbinned spike-train data by incorporating a continuous time point-process likelihood model, achieving scalability with a sparse variational approximation. Shared variability is separated into terms that express condition dependence, as well as trial-to-trial variation in trajectories. Finally, we introduce a nested GP formulation to capture variability in the rate of evolution along the trajectory. We show that the new method learns to recover latent trajectories in synthetic data, and can accurately identify the trial-to-trial timing of movement-related parameters from motor cortical data without any supervision.

[1]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[2]  Stephen J. Roberts,et al.  Variational Inference for Gaussian Process Modulated Poisson Processes , 2014, ICML.

[3]  Jovan Popovic,et al.  Style translation for human motion , 2005, ACM Trans. Graph..

[4]  Sepp Kollmorgen,et al.  Dynamic Alignment Models for Neural Coding , 2014, PLoS Comput. Biol..

[5]  Eamonn J. Keogh,et al.  Derivative Dynamic Time Warping , 2001, SDM.

[6]  Anqi Wu,et al.  Gaussian process based nonlinear latent structure discovery in multivariate spike train data , 2017, NIPS.

[7]  John P. Cunningham,et al.  Linear dynamical neural population models through nonlinear embeddings , 2016, NIPS.

[8]  Thomas A. Runkler,et al.  Bayesian Alignments of Warped Multi-Output Gaussian Processes , 2018, NeurIPS.

[9]  Liam Paninski,et al.  On Quadrature Methods for Refractory Point Process Likelihoods , 2014, Neural Computation.

[10]  John P. Cunningham,et al.  Dynamical segmentation of single trials from population neural data , 2011, NIPS.

[11]  Byron M. Yu,et al.  Single-Trial Neural Correlates of Arm Movement Preparation , 2011, Neuron.

[12]  Neil D. Lawrence,et al.  Bayesian Gaussian Process Latent Variable Model , 2010, AISTATS.

[13]  Jasper Snoek,et al.  Input Warping for Bayesian Optimization of Non-Stationary Functions , 2014, ICML.

[14]  Yuan Zhao,et al.  Variational Latent Gaussian Process for Recovering Single-Trial Dynamics from Population Spike Trains , 2016, Neural Computation.

[15]  James Hensman,et al.  Scalable transformed additive signal decomposition by non-conjugate Gaussian process inference , 2016, 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).

[16]  Marc Peter Deisenroth,et al.  Doubly Stochastic Variational Inference for Deep Gaussian Processes , 2017, NIPS.

[17]  Miguel Lázaro-Gredilla,et al.  Bayesian Warped Gaussian Processes , 2012, NIPS.

[18]  Victor M. Panaretos,et al.  Amplitude and phase variation of point processes , 2016, 1603.08691.

[19]  Manfred Opper,et al.  The Variational Gaussian Approximation Revisited , 2009, Neural Computation.

[20]  Chethan Pandarinath,et al.  Inferring single-trial neural population dynamics using sequential auto-encoders , 2017, Nature Methods.

[21]  Konrad P. Körding,et al.  Linear-nonlinear-time-warp-poisson models of neural activity , 2018, Journal of Computational Neuroscience.

[22]  Fernando De la Torre,et al.  Generalized Canonical Time Warping , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Marco Cuturi,et al.  Soft-DTW: a Differentiable Loss Function for Time-Series , 2017, ICML.

[24]  Byron M. Yu,et al.  Techniques for extracting single-trial activity patterns from large-scale neural recordings , 2007, Current Opinion in Neurobiology.

[25]  John P. Cunningham,et al.  Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity , 2008, NIPS.

[26]  Byron M. Yu,et al.  Dimensionality reduction for large-scale neural recordings , 2014, Nature Neuroscience.

[27]  Neil D. Lawrence,et al.  Gaussian Processes for Big Data , 2013, UAI.

[28]  Michalis K. Titsias,et al.  Variational Learning of Inducing Variables in Sparse Gaussian Processes , 2009, AISTATS.

[29]  Neil D. Lawrence,et al.  Deep Gaussian Processes , 2012, AISTATS.

[30]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[31]  Surya Ganguli,et al.  Time-warped PCA : simultaneous alignment and dimensionality reduction of neural data , 2016 .

[32]  Wei Wu,et al.  Estimating summary statistics in the spike-train space , 2013, Journal of Computational Neuroscience.

[33]  Victor M. Panaretos,et al.  Fréchet means and Procrustes analysis in Wasserstein space , 2017, Bernoulli.

[34]  Lars Buesing,et al.  Estimating state and Parameters in state space Models of Spike trains , 2015 .

[35]  Ieva Kazlauskaite,et al.  Gaussian Process Latent Variable Alignment Learning , 2018, AISTATS.

[36]  James Hensman,et al.  Scalable Variational Gaussian Process Classification , 2014, AISTATS.

[37]  Aki Vehtari,et al.  Chained Gaussian Processes , 2016, AISTATS.

[38]  Ana Arribas-Gil,et al.  Pairwise dynamic time warping for event data , 2012, Comput. Stat. Data Anal..