Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity

We consider the problem of extracting smooth, low-dimensional neural trajectories that summarize the activity recorded simultaneously from many neurons on individual experimental trials. Beyond the benefit of visualizing the high-dimensional, noisy spiking activity in a compact form, such trajectories can offer insight into the dynamics of the neural circuitry underlying the recorded activity. Current methods for extracting neural trajectories involve a two-stage process: the spike trains are first smoothed over time, then a static dimensionality-reduction technique is applied. We first describe extensions of the two-stage methods that allow the degree of smoothing to be chosen in a principled way and that account for spiking variability, which may vary both across neurons and across time. We then present a novel method for extracting neural trajectories-Gaussian-process factor analysis (GPFA)-which unifies the smoothing and dimensionality-reduction operations in a common probabilistic framework. We applied these methods to the activity of 61 neurons recorded simultaneously in macaque premotor and motor cortices during reach planning and execution. By adopting a goodness-of-fit metric that measures how well the activity of each neuron can be predicted by all other recorded neurons, we found that the proposed extensions improved the predictive ability of the two-stage methods. The predictive ability was further improved by going to GPFA. From the extracted trajectories, we directly observed a convergence in neural state during motor planning, an effect that was shown indirectly by previous studies. We then show how such methods can be a powerful tool for relating the spiking activity across a neural population to the subject's behavior on a single-trial basis. Finally, to assess how well the proposed methods characterize neural population activity when the underlying time course is known, we performed simulations that revealed that GPFA performed tens of percent better than the best two-stage method.

[1]  David W Tank,et al.  History dependence of rate covariation between neurons during persistent activity in an oculomotor integrator. , 2003, Cerebral cortex.

[2]  Naftali Tishby,et al.  Hidden Markov modelling of simultaneously recorded cells in the associative cortex of behaving monkeys , 1997 .

[3]  Byron M. Yu,et al.  Neural Variability in Premotor Cortex Provides a Signature of Motor Preparation , 2006, The Journal of Neuroscience.

[4]  Zoubin Ghahramani,et al.  A Unifying Review of Linear Gaussian Models , 1999, Neural Computation.

[5]  John P. Cunningham,et al.  Fast Gaussian process methods for point process intensity estimation , 2008, ICML '08.

[6]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[7]  Norio Matsuki,et al.  Metastability of Active CA 3 Networks , 2007 .

[8]  Paul Miller,et al.  Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles , 2007, Proceedings of the National Academy of Sciences.

[9]  Stephen I. Ryu,et al.  HermesC: RF wireless low-power neural recording system for freely behaving primates , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[10]  Yee Whye Teh,et al.  Semiparametric latent factor models , 2005, AISTATS.

[11]  Kevin L. Briggman,et al.  From crawling to cognition: analyzing the dynamical interactions among populations of neurons , 2006, Current Opinion in Neurobiology.

[12]  Richard H. R. Hahnloser,et al.  Spike Correlations in a Songbird Agree with a Simple Markov Population Model , 2007, PLoS Comput. Biol..

[13]  Byron M. Yu,et al.  Techniques for extracting single-trial activity patterns from large-scale neural recordings , 2007, Current Opinion in Neurobiology.

[14]  Richard E. Turner,et al.  A Maximum-Likelihood Interpretation for Slow Feature Analysis , 2007, Neural Computation.

[15]  R.R. Harrison,et al.  HermesC: Low-Power Wireless Neural Recording System for Freely Moving Primates , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[16]  Luis Carrillo-Reid,et al.  Encoding network states by striatal cell assemblies. , 2008, Journal of neurophysiology.

[17]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[18]  John P. Cunningham,et al.  Inferring Neural Firing Rates from Spike Trains Using Gaussian Processes , 2007, NIPS.

[19]  Byron M. Yu,et al.  Extracting Dynamical Structure Embedded in Neural Activity , 2005, NIPS.

[20]  Robert E Kass,et al.  Trial-to-trial variability and its effect on time-varying dependency between two neurons. , 2005, Journal of neurophysiology.

[21]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[22]  E. Seidemann,et al.  Simultaneously recorded single units in the frontal cortex go through sequences of discrete and stable states in monkeys performing a delayed localization task , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  Dinh Van Huynh,et al.  Algebra and Its Applications , 2006 .

[24]  V. Jayaraman,et al.  Encoding and Decoding of Overlapping Odor Sequences , 2006, Neuron.

[25]  Neil D. Lawrence,et al.  Probabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models , 2005, J. Mach. Learn. Res..

[26]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[27]  Brian Everitt,et al.  An Introduction to Latent Variable Models , 1984 .

[28]  Steven J. Eliades,et al.  Journal of Neuroscience Methods Chronic Multi-electrode Neural Recording in Free-roaming Monkeys , 2022 .

[29]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[30]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[31]  N. Matsuki,et al.  Metastability of Active CA3 Networks , 2007, The Journal of Neuroscience.

[32]  David J. Fleet,et al.  Gaussian Process Dynamical Models , 2005, NIPS.

[33]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[34]  Yee Whye Teh,et al.  Automatic Alignment of Local Representations , 2002, NIPS.

[35]  G. Laurent,et al.  Transient Dynamics versus Fixed Points in Odor Representations by Locust Antennal Lobe Projection Neurons , 2005, Neuron.

[36]  R. Romo,et al.  Neuronal correlates of subjective sensory experience , 2005, Nature Neuroscience.

[37]  R. Andersen,et al.  Encoding of three-dimensional structure-from-motion by primate area MT neurons , 1998, Nature.

[38]  V. Jayaraman,et al.  Intensity versus Identity Coding in an Olfactory System , 2003, Neuron.

[39]  Byron M. Yu,et al.  Reference frames for reach planning in macaque dorsal premotor cortex. , 2007, Journal of neurophysiology.

[40]  Amos Storkey,et al.  Advances in Neural Information Processing Systems 20 , 2007 .

[41]  A. Parker,et al.  Perceptually Bistable Three-Dimensional Figures Evoke High Choice Probabilities in Cortical Area MT , 2001, The Journal of Neuroscience.

[42]  Carl E. Rasmussen,et al.  Factorial Hidden Markov Models , 1997 .

[43]  E. Fetz,et al.  Correlations between the same motor cortex cells and arm muscles during a trained task, free behavior, and natural sleep in the macaque monkey. , 2007, Journal of neurophysiology.

[44]  J. Herson,et al.  Square Root Transformation Revisited , 1972 .

[45]  John H. R. Maunsell,et al.  Dynamics of neuronal responses in macaque MT and VIP during motion detection , 2002, Nature Neuroscience.

[46]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[47]  W T Newsome,et al.  Target selection for saccadic eye movements: prelude activity in the superior colliculus during a direction-discrimination task. , 2001, Journal of neurophysiology.

[48]  D. Wilkin,et al.  Neuron , 2001, Brain Research.

[49]  M. Stopfer,et al.  Encoding a temporally structured stimulus with a temporally structured neural representation , 2005, Nature Neuroscience.

[50]  K. Miller,et al.  One-Dimensional Dynamics of Attention and Decision Making in LIP , 2008, Neuron.

[51]  Kevin L. Briggman,et al.  Optical Imaging of Neuronal Populations During Decision-Making , 2005, Science.

[52]  J. Kalaska,et al.  Prior information in motor and premotor cortex: activity during the delay period and effect on pre-movement activity. , 2000, Journal of neurophysiology.

[53]  Uri T Eden,et al.  Analysis of between-trial and within-trial neural spiking dynamics. , 2008, Journal of neurophysiology.

[54]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[55]  Daryl R Kipke,et al.  Advanced Neurotechnologies for Chronic Neural Interfaces: New Horizons and Clinical Opportunities , 2008, The Journal of Neuroscience.

[56]  J. Kalaska,et al.  Neural Correlates of Reaching Decisions in Dorsal Premotor Cortex: Specification of Multiple Direction Choices and Final Selection of Action , 2005, Neuron.

[57]  R. Kass,et al.  Bayesian curve-fitting with free-knot splines , 2001 .

[58]  Naftali Tishby,et al.  Cortical activity flips among quasi-stationary states. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[59]  Emery N. Brown,et al.  Estimating a State-space Model from Point Process Observations Emery N. Brown , 2022 .

[60]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[61]  N. Logothetis,et al.  Activity changes in early visual cortex reflect monkeys' percepts during binocular rivalry , 1996, Nature.

[62]  L. Paninski,et al.  Common-input models for multiple neural spike-train data , 2007, Network.

[63]  W. Denk,et al.  Imaging in vivo: watching the brain in action , 2008, Nature Reviews Neuroscience.

[64]  N. Thacker,et al.  The Effects of a Square Root Transform on a Poisson Distributed Quantity , 2009 .

[65]  Bruno A. Olshausen,et al.  Book Review , 2003, Journal of Cognitive Neuroscience.

[66]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[67]  Michael E. Tipping,et al.  Probabilistic Principal Component Analysis , 1999 .

[68]  R. Kass,et al.  Multiple neural spike train data analysis: state-of-the-art and future challenges , 2004, Nature Neuroscience.

[69]  Alan Carleton,et al.  Dynamic Ensemble Odor Coding in the Mammalian Olfactory Bulb: Sensory Information at Different Timescales , 2008, Neuron.

[70]  Y. Arshavsky,et al.  The Role of Sensory Network Dynamics in Generating a Motor Program , 2005, The Journal of Neuroscience.

[71]  Márton Danóczy,et al.  Efficient estimation of hidden state dynamics from spike trains , 2005, NIPS.

[72]  Christopher K. I. Williams,et al.  Using the Equivalent Kernel to Understand Gaussian Process Regression , 2004, NIPS.

[73]  Stefan Rotter,et al.  Single-trial estimation of neuronal firing rates: From single-neuron spike trains to population activity , 1999, Journal of Neuroscience Methods.

[74]  Byron M. Yu,et al.  Detecting neural-state transitions using hidden Markov models for motor cortical prostheses. , 2008, Journal of neurophysiology.

[75]  M. Nicolelis,et al.  Sensorimotor encoding by synchronous neural ensemble activity at multiple levels of the somatosensory system. , 1995, Science.

[76]  K. Pearson Biometrika , 1902, The American Naturalist.

[77]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[78]  Teresa H. Y. Meng,et al.  HermesB: A Continuous Neural Recording System for Freely Behaving Primates , 2007, IEEE Transactions on Biomedical Engineering.

[79]  Manfred Jaeger,et al.  Proceedings of the 24th Annual International Conference on Machine Learning (ICML 2007) , 2007, ICML 2007.

[80]  Neil D. Lawrence,et al.  Hierarchical Gaussian process latent variable models , 2007, ICML '07.

[81]  A. Riehle,et al.  Monkey primary motor and premotor cortex: single-cell activity related to prior information about direction and extent of an intended movement. , 1989, Journal of neurophysiology.

[82]  M. Goldberg,et al.  Neuronal Activity in the Lateral Intraparietal Area and Spatial Attention , 2003, Science.

[83]  J. Movshon,et al.  The statistical reliability of signals in single neurons in cat and monkey visual cortex , 1983, Vision Research.