An L1-regularized logistic model for detecting short-term neuronal interactions

Interactions among neurons are a key component of neural signal processing. Rich neural data sets potentially containing evidence of interactions can now be collected readily in the laboratory, but existing analysis methods are often not sufficiently sensitive and specific to reveal these interactions. Generalized linear models offer a platform for analyzing multi-electrode recordings of neuronal spike train data. Here we suggest an L1-regularized logistic regression model (L1L method) to detect short-term (order of 3 ms) neuronal interactions. We estimate the parameters in this model using a coordinate descent algorithm, and determine the optimal tuning parameter using a Bayesian Information Criterion. Simulation studies show that in general the L1L method has better sensitivities and specificities than those of the traditional shuffle-corrected cross-correlogram (covariogram) method. The L1L method is able to detect excitatory interactions with both high sensitivity and specificity with reasonably large recordings, even when the magnitude of the interactions is small; similar results hold for inhibition given sufficiently high baseline firing rates. Our study also suggests that the false positives can be further removed by thresholding, because their magnitudes are typically smaller than true interactions. Simulations also show that the L1L method is somewhat robust to partially observed networks. We apply the method to multi-electrode recordings collected in the monkey dorsal premotor cortex (PMd) while the animal prepares to make reaching arm movements. The results show that some neurons interact differently depending on task conditions. The stronger interactions detected with our L1L method were also visible using the covariogram method.

[1]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[2]  L. Paninski,et al.  Common-input models for multiple neural spike-train data , 2007, Network.

[3]  Satish Iyengar,et al.  Nonconvergence in Logistic and Poisson Models for Neural Spiking , 2010, Neural Computation.

[4]  R. Tibshirani The lasso method for variable selection in the Cox model. , 1997, Statistics in medicine.

[5]  Christophe Ambroise,et al.  Regularization Methods for Additive Models , 2003, IDA.

[6]  Yuehua Wu,et al.  STRONG LIMIT THEOREMS ON MODEL SELECTION IN GENERALIZED LINEAR REGRESSION WITH BINOMIAL RESPONSES , 2006 .

[7]  Pei Wang,et al.  Partial Correlation Estimation by Joint Sparse Regression Models , 2008, Journal of the American Statistical Association.

[8]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[9]  G. P. Moore,et al.  Neuronal spike trains and stochastic point processes. I. The single spike train. , 1967, Biophysical journal.

[10]  Rong Jin,et al.  Identifying Functional Connectivity in Large-Scale Neural Ensemble Recordings: A Multiscale Data Mining Approach , 2009, Neural Computation.

[11]  Beryl Rawson,et al.  Degrees of Freedom , 2010 .

[12]  Joshua T. Vogelstein,et al.  A Bayesian approach for inferring neuronal connectivity from calcium fluorescent imaging data , 2011, 1107.4228.

[13]  John P. Cunningham,et al.  Single-Neuron Stability during Repeated Reaching in Macaque Premotor Cortex , 2007, The Journal of Neuroscience.

[14]  J. Donoghue,et al.  Collective dynamics in human and monkey sensorimotor cortex: predicting single neuron spikes , 2009, Nature Neuroscience.

[15]  John A. Nelder,et al.  Generalized linear models. 2nd ed. , 1993 .

[16]  Chenlei Leng,et al.  Shrinkage tuning parameter selection with a diverging number of parameters , 2008 .

[17]  R. Tibshirani,et al.  PATHWISE COORDINATE OPTIMIZATION , 2007, 0708.1485.

[18]  M K Habib,et al.  Dynamics of neuronal firing correlation: modulation of "effective connectivity". , 1989, Journal of neurophysiology.

[19]  D. Brillinger Maximum likelihood analysis of spike trains of interacting nerve cells , 2004, Biological Cybernetics.

[20]  N. Meinshausen,et al.  LASSO-TYPE RECOVERY OF SPARSE REPRESENTATIONS FOR HIGH-DIMENSIONAL DATA , 2008, 0806.0145.

[21]  S.I. Ryu,et al.  An extensible infrastructure for fully automated spike sorting during online experiments , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  R. Reid,et al.  Specificity of monosynaptic connections from thalamus to visual cortex , 1995, Nature.

[23]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[24]  M. A. Smith,et al.  Stimulus Dependence of Neuronal Correlation in Primary Visual Cortex of the Macaque , 2005, The Journal of Neuroscience.

[25]  P. McCullagh,et al.  Generalized Linear Models, 2nd Edn. , 1990 .

[26]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[27]  R. Kass,et al.  Multiple neural spike train data analysis: state-of-the-art and future challenges , 2004, Nature Neuroscience.

[28]  Ian H. Stevenson,et al.  Bayesian Inference of Functional Connectivity and Network Structure From Spikes , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[30]  D. Perkel,et al.  Nerve-impulse patterns: A quantitative display technique for three neurons , 1975, Brain Research.

[31]  Stuart Geman,et al.  A Rate and History-Preserving Resampling Algorithm for Neural Spike Trains , 2009, Neural Computation.

[32]  E. Fetz,et al.  Synaptic Interactions between Primate Precentral Cortex Neurons Revealed by Spike-Triggered Averaging of Intracellular Membrane Potentials In Vivo , 1996, The Journal of Neuroscience.

[33]  Christian Borgelt,et al.  Advances in Intelligent Data Analysis V , 2003, Lecture Notes in Computer Science.

[34]  G L Gerstein,et al.  Mutual temporal relationships among neuronal spike trains. Statistical techniques for display and analysis. , 1972, Biophysical journal.

[35]  Riccardo Barbieri,et al.  Statistical Inference for Assessing Functional Connectivity of Neuronal Ensembles With Sparse Spiking Data , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  G. P. Moore,et al.  Neuronal spike trains and stochastic point processes. II. Simultaneous spike trains. , 1967, Biophysical journal.

[37]  G. Buzsáki,et al.  Behavior-dependent short-term assembly dynamics in the medial prefrontal cortex , 2008, Nature Neuroscience.

[38]  Robert E Kass,et al.  ASSESSMENT OF SYNCHRONY IN MULTIPLE NEURAL SPIKE TRAINS USING LOGLINEAR POINT PROCESS MODELS. , 2011, The annals of applied statistics.

[39]  Sonja Grün,et al.  Theory of the Snowflake Plot and Its Relations to Higher-Order Analysis Methods , 2005, Neural Computation.

[40]  Byron M. Yu,et al.  Reference frames for reach planning in macaque dorsal premotor cortex. , 2007, Journal of neurophysiology.

[41]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[42]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[43]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[44]  Carlos D. Brody,et al.  Correlations Without Synchrony , 1999, Neural Computation.

[45]  L. Wasserman,et al.  HIGH DIMENSIONAL VARIABLE SELECTION. , 2007, Annals of statistics.

[46]  R. Tibshirani,et al.  On the “degrees of freedom” of the lasso , 2007, 0712.0881.

[47]  K. Lange,et al.  Coordinate descent algorithms for lasso penalized regression , 2008, 0803.3876.

[48]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[49]  L. Paninski Maximum likelihood estimation of cascade point-process neural encoding models , 2004, Network.

[50]  Jianqing Fan,et al.  Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties , 2001 .

[51]  Saharon Rosset,et al.  Following Curved Regularized Optimization Solution Paths , 2004, NIPS.

[52]  Yang Jing L1 Regularization Path Algorithm for Generalized Linear Models , 2008 .

[53]  Tai Sing Lee,et al.  Accounting for network effects in neuronal responses using L1 regularized point process models , 2010, NIPS.

[54]  Mee Young Park,et al.  L 1-regularization path algorithm for generalized linear models , 2006 .

[55]  Michael J. Black,et al.  A quantitative comparison of linear and non-linear models of motor cortical activity for the encoding and decoding of arm motions , 2003, First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings..