Model-Based Decoding, Information Estimation, and Change-Point Detection Techniques for Multineuron Spike Trains

One of the central problems in systems neuroscience is to understand how neural spike trains convey sensory information. Decoding methods, which provide an explicit means for reading out the information contained in neural spike responses, offer a powerful set of tools for studying the neural coding problem. Here we develop several decoding methods based on point-process neural encoding models, or forward models that predict spike responses to stimuli. These models have concave log-likelihood functions, which allow efficient maximum-likelihood model fitting and stimulus decoding. We present several applications of the encoding model framework to the problem of decoding stimulus information from population spike responses: (1) a tractable algorithm for computing the maximum a posteriori (MAP) estimate of the stimulus, the most probable stimulus to have generated an observed single- or multiple-neuron spike train response, given some prior distribution over the stimulus; (2) a gaussian approximation to the posterior stimulus distribution that can be used to quantify the fidelity with which various stimulus features are encoded; (3) an efficient method for estimating the mutual information between the stimulus and the spike trains emitted by a neural population; and (4) a framework for the detection of change-point times (the time at which the stimulus undergoes a change in mean or variance) by marginalizing over the posterior stimulus distribution. We provide several examples illustrating the performance of these estimators with simulated and real neural data.

[1]  D. Brillinger.  Maximum likelihood analysis of spike trains of interacting nerve cells , 2004, Biological Cybernetics.

[2]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[3]  L. Wasserman,et al.  Computing Bayes Factors by Combining Simulation and Asymptotic Approximations , 1997 .

[4]  Andrew R. Barron,et al.  Information-theoretic asymptotics of Bayes methods , 1990, IEEE Trans. Inf. Theory.

[5]  Eero P. Simoncelli.  4.7 – Statistical Modeling of Photographic Images , 2005 .

[6]  F. Y. Edgeworth,et al.  The theory of statistics , 1996 .

[7]  William Bialek,et al.  Entropy and information in neural spike trains: progress on the sampling problem. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  Eero P. Simoncelli,et al.  Maximum Likelihood Estimation of a Stochastic Integrate-and-Fire Neural Encoding Model , 2004, Neural Computation.

[9]  L. Williams,et al.  Contents , 2020, Ophthalmology (Rochester, Minn.).

[10]  P. Latham,et al.  Synergy, Redundancy, and Independence in Population Codes, Revisited , 2005, The Journal of Neuroscience.

[11]  Javier Cervera,et al.  Bio-inspired signal transduction with heterogeneous networks of nanoscillators , 2012 .

[12]  David R. Brillinger,et al.  Nerve Cell Spike Train Data Analysis: A Progression of Technique , 1992 .

[13]  Eero P. Simoncelli,et al.  Dimensionality reduction in neural models: an information-theoretic generalization of spike-triggered average and covariance analysis. , 2006, Journal of vision.

[14]  L. Paninski,et al.  Superlinear Population Encoding of Dynamic Hand Trajectory in Primary Motor Cortex , 2004, The Journal of Neuroscience.

[15]  Matthew Fellows,et al.  Statistical encoding model for a primary motor cortical brain-machine interface , 2005, IEEE Transactions on Biomedical Engineering.

[16]  Anthony M. Zador,et al.  Asymmetric Dynamics in Optimal Variance Adaptation , 1998, Neural Computation.

[17]  J. Donoghue,et al.  Collective dynamics in human and monkey sensorimotor cortex: predicting single neuron spikes , 2009, Nature Neuroscience.

[18]  Liam Paninski,et al.  Efficient Markov Chain Monte Carlo Methods for Decoding Neural Spike Trains , 2011, Neural Computation.

[19]  Wei Wu,et al.  A new look at state-space models for neural data , 2010, Journal of Computational Neuroscience.

[20]  H. Krapp,et al.  Population coding of self-motion: applying bayesian analysis to a population of visual interneurons in the fly. , 2005, Journal of neurophysiology.

[21]  Ian H. Stevenson,et al.  Bayesian Inference of Functional Connectivity and Network Structure From Spikes , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  L F Abbott,et al.  Coordinate transformations in the visual system: how to generate gain fields and what to compute with them. , 2001, Progress in brain research.

[23]  Tai Sing Lee,et al.  Decoding V1 Neuronal Activity using Particle Filtering with Volterra Kernels , 2003, NIPS.

[24]  Jonathon Shlens,et al.  Estimating Entropy Rates with Bayesian Confidence Intervals , 2005, Neural Computation.

[25]  Nicolas Brunel,et al.  Mutual Information, Fisher Information, and Population Coding , 1998, Neural Computation.

[26]  Eero P. Simoncelli,et al.  To appear in: The New Cognitive Neurosciences, 3rd edition Editor: M. Gazzaniga. MIT Press, 2004. Characterization of Neural Responses with Stochastic Stimuli , 2022 .

[27]  Liam Paninski,et al.  Statistical models for neural encoding, decoding, and optimal stimulus design. , 2007, Progress in brain research.

[28]  Jonathan W. Pillow,et al.  Time-rescaling methods for the estimation and assessment of non-Poisson neural encoding models , 2009, NIPS.

[29]  Eero P. Simoncelli,et al.  Nonlinear Extraction of Independent Components of Natural Images Using Radial Gaussianization , 2009, Neural Computation.

[30]  Emery N. Brown,et al.  A State-Space Analysis for Reconstruction of Goal-Directed Movements Using Neural Signals , 2006, Neural Computation.

[31]  E J Chichilnisky,et al.  Prediction and Decoding of Retinal Ganglion Cell Responses with a Probabilistic Spiking Model , 2005, The Journal of Neuroscience.

[32]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[33]  Jerald D. Kralik,et al.  Chronic, multisite, multielectrode recordings in macaque monkeys , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Liam Paninski,et al.  Efficient estimation of detailed single-neuron models. , 2006, Journal of neurophysiology.

[35]  P. Z. Marmarelis,et al.  Analysis of Physiological Systems: The White-Noise Approach , 2011 .

[36]  B L McNaughton,et al.  Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. , 1998, Journal of neurophysiology.

[37]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[38]  William H. Press,et al.  Numerical recipes in C , 2002 .

[39]  Wei Wu,et al.  Neural Decoding of Hand Motion Using a Linear State-Space Model With Hidden States , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[40]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[41]  Liam Paninski,et al.  Estimation of Entropy and Mutual Information , 2003, Neural Computation.

[42]  E J Chichilnisky,et al.  A simple white noise analysis of neuronal light responses , 2001, Network.

[43]  Nando de Freitas,et al.  Sequential Monte Carlo in Practice , 2001 .

[44]  Christopher L Passaglia,et al.  Information transmission rates of cat retinal ganglion cells. , 2004, Journal of neurophysiology.

[45]  B. Cessac,et al.  Spike train statistics and Gibbs distributions , 2013, Journal of Physiology-Paris.

[46]  Eero P. Simoncelli,et al.  Comparing integrate-and-fire models estimated using intracellular and extracellular data , 2005, Neurocomputing.

[47]  Liam Paninski,et al.  Efficient computation of the maximum a posteriori path and parameter estimation in integrate-and-fire and more general state-space models , 2010, Journal of Computational Neuroscience.

[48]  William Bialek,et al.  Coding and computation with neural spike trains , 1990 .

[49]  A. Borst,et al.  Encoding of Visual Motion Information and Reliability in Spiking and Graded Potential Neurons , 1997, The Journal of Neuroscience.

[50]  William Bialek,et al.  Real-time performance of a movement-sensitive neuron in the blowfly visual system: coding and information transfer in short spike sequences , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[51]  Yichuan Zhang,et al.  Advances in Neural Information Processing Systems 25 , 2012 .

[52]  E N Brown,et al.  A Statistical Paradigm for Neural Spike Train Decoding Applied to Position Prediction from Ensemble Firing Patterns of Rat Hippocampal Place Cells , 1998, The Journal of Neuroscience.

[53]  Michael J. Berry,et al.  Synergy, Redundancy, and Independence in Population Codes , 2003, The Journal of Neuroscience.

[54]  L. Paninski,et al.  Neural decoding of goal-directed movements using a linear state-space model with hidden states , 2007 .

[55]  E. Bullmore,et al.  Society for Neuroscience Abstracts , 1997 .

[56]  M. Gazzaniga.  The cognitive neurosciences, 3rd edition , 2004 .

[57]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[58]  W. Bialek,et al.  RELIABILITY AND STATISTICAL EFFICIENCY OF A BLOWFLY MOVEMENT-SENSITIVE NEURON , 1995 .

[59]  Eero P. Simoncelli,et al.  Modeling the Impact of Common Noise Inputs on the Network Activity of Retinal Ganglion Cells Action Editor: Brent Doiron , 2022 .

[60]  Fabio Rigat,et al.  Bayesian modelling and analysis of spatio-temporal neuronal networks , 2006 .

[61]  Pamela Reinagel,et al.  Decoding visual information from a population of retinal ganglion cells. , 1997, Journal of neurophysiology.

[62]  Terence D. Sanger,et al.  Theoretical Considerations for the Analysis of Population Coding in Motor Cortex , 1994, Neural Computation.

[63]  Roland Siegwart,et al.  DP-Fusion A generic framework for online multi sensor recognition , 2012 .

[64]  R E Kass,et al.  Recursive bayesian decoding of motor cortical signals by particle filtering. , 2004, Journal of neurophysiology.

[65]  Tom Minka,et al.  A family of algorithms for approximate Bayesian inference , 2001 .

[66]  Garrett B. Stanley,et al.  Decoding in neural systems: stimulus reconstruction from nonlinear encoding , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[67]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[68]  Emery N. Brown,et al.  Information and Statistical Structure in Spike Trains , 2003 .

[69]  P. McCullagh,et al.  Generalized Linear Models , 1992 .

[70]  Matthias Bethge,et al.  Bayesian Population Decoding of Spiking Neurons , 2009, Frontiers Comput. Neurosci..

[71]  J. Csicsvari,et al.  Organization of cell assemblies in the hippocampus , 2003, Nature.

[72]  Matthew A. Wilson,et al.  Construction of Point Process Adaptive Filter Algorithms for Neural Systems Using Sequential Monte Carlo Methods , 2007, IEEE Transactions on Biomedical Engineering.

[73]  Aurel A. Lazar,et al.  Faithful Representation of Stimuli with a Population of Integrate-and-Fire Neurons , 2008, Neural Computation.

[74]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[75]  Bruno Cessac,et al.  Spatio-temporal spike train analysis for large scale networks using the maximum entropy principle and Monte Carlo method , 2012, 1209.3886.

[76]  L. Paninski.  Maximum likelihood estimation of cascade point-process neural encoding models , 2004, Network.

[77]  L. Paninski,et al.  Common-input models for multiple neural spike-train data , 2007, Network.

[78]  Wulfram Gerstner,et al.  Noise in Integrate-and-Fire Neurons: From Stochastic Input to Escape Rates , 2000, Neural Computation.

[79]  Matthias Bethge,et al.  Bayesian Inference for Spiking Neuron Models with a Sparsity Prior , 2007, NIPS.

[80]  Mriganka Sur,et al.  Hierarchical Bayesian modeling and Markov chain Monte Carlo sampling for tuning-curve analysis. , 2010, Journal of neurophysiology.

[81]  John P. Cunningham,et al.  Neural Decoding of Movements: From Linear to Nonlinear Trajectory Models , 2007, ICONIP.

[82]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[83]  William Bialek,et al.  Entropy and Information in Neural Spike Trains , 1996, cond-mat/9603127.

[84]  Carl E. Rasmussen,et al.  Prediction on Spike Data Using Kernel Algorithms , 2003, NIPS.

[85]  William Bialek,et al.  Analyzing Neural Responses to Natural Signals: Maximally Informative Dimensions , 2002, Neural Computation.

[86]  L. Fahrmeir.  Posterior Mode Estimation by Extended Kalman Filtering for Multivariate Dynamic Generalized Linear Models , 1992 .

[87]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[88]  Michael J. Berry,et al.  Refractoriness and Neural Precision , 1997, The Journal of Neuroscience.

[89]  Eero P. Simoncelli,et al.  Biases in white noise analysis due to non-Poisson spike generation , 2003, Neurocomputing.

[90]  S. David,et al.  Influence of context and behavior on stimulus reconstruction from neural activity in primary auditory cortex. , 2009, Journal of neurophysiology.

[91]  Eero P. Simoncelli,et al.  Maximum Likelihood Estimation of a Stochastic Integrate-and-Fire Neural Model , 2003, NIPS.

[92]  William Bialek,et al.  Reading a Neural Code , 1991, NIPS.

[93]  Matthew A. Wilson,et al.  Transductive neural decoding for unsorted neuronal spikes of rat hippocampus , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[94]  J. Donoghue,et al.  Neuronal Interactions Improve Cortical Population Coding of Movement Direction , 1999, The Journal of Neuroscience.

[95]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[96]  Michael J. Black,et al.  Modeling and decoding motor cortical activity using a switching Kalman filter , 2004, IEEE Transactions on Biomedical Engineering.

[97]  Robert E. Kass,et al.  Statistical Signal Processing and the Motor Cortex , 2007, Proceedings of the IEEE.

[98]  S. Meagher.  Instant neural control of a movement signal , 2002 .

[99]  Maurice J Chacron,et al.  Nonlinear information processing in a model sensory system. , 2006, Journal of neurophysiology.

[100]  M. Schervish.  Theory of Statistics , 1995 .

[101]  Liam Paninski,et al.  Asymptotic Theory of Information-Theoretic Experimental Design , 2005, Neural Computation.

[102]  D R Humphrey,et al.  Predicting Measures of Motor Performance from Multiple Cortical Spike Trains , 1970, Science.

[103]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[104]  John P. Donoghue,et al.  Connecting cortex to machines: recent advances in brain interfaces , 2002, Nature Neuroscience.

[105]  Liam Paninski,et al.  The most likely voltage path and large deviations approximations for integrate-and-fire neurons , 2006, Journal of Computational Neuroscience.

[106]  S. Santaniello,et al.  Optimal Control-Based Bayesian Detection of Clinical and Behavioral State Transitions , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[107]  Emery N. Brown,et al.  The Time-Rescaling Theorem and Its Application to Neural Spike Train Data Analysis , 2002, Neural Computation.

[108]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[109]  M. Magnasco,et al.  A phase transition in the first passage of a Brownian process through a fluctuating boundary with implications for neural coding , 2012, Proceedings of the National Academy of Sciences.

[110]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[111]  Matthew A. Wilson,et al.  Dynamic Analyses of Information Encoding in Neural Ensembles , 2004, Neural Computation.

[112]  J. Miller,et al.  Information theoretic analysis of dynamical encoding by four identified primary sensory interneurons in the cricket cercal system. , 1996, Journal of neurophysiology.