Time series analysis of hybrid neurophysiological data and application of mutual information

Multivariate time series data of which some components are continuous time series and the rest are point processes are called hybrid data. Such data sets routinely arise while working with neuroscience data, EEG and spike trains would perhaps be the most obvious example. In this paper, we discuss the modeling of a hybrid time series, with the continuous component being the physiological tremors in the distal phalanx of the middle finger, and motor unit firings in the middle finger portion of the extensor digitorum communis (EDC) muscle. We employ a model for the two components based on Auto-regressive Moving Average (ARMA) type models. Another major issue to arise in the modeling of such data is to assess the goodness of fit. We suggest a visual procedure based on mutual information towards assessing the dependence pattern of hybrid data. The goodness of fit is also verified by standard model fitting diagnostic techniques for univariate data.

[1]  Benjamin Kedem,et al.  Regression Models for Time Series Analysis: Kedem/Time Series Analysis , 2005 .

[2]  G. G. S. Pegram,et al.  An autoregressive model for multilag Markov chains , 1980, Journal of Applied Probability.

[3]  J. R. Rosenberg,et al.  Load-independent contributions from motor-unit synchronization to human physiological tremor. , 1999, Journal of neurophysiology.

[4]  S. Bressler,et al.  Stochastic modeling of neurobiological time series: power, coherence, Granger causality, and separation of evoked responses from ongoing activity. , 2006, Chaos.

[5]  Robert E Kass,et al.  Statistical issues in the analysis of neuronal data. , 2005, Journal of neurophysiology.

[6]  Atanu Biswas,et al.  Bayesian Adaptive Biased‐Coin Designs for Clinical Trials with Normal Responses , 2005, Biometrics.

[7]  Harry Joe.  TIME SERIES MODELS WITH UNIVARIATE MARGINS IN THE CONVOLUTION-CLOSED INFINITELY DIVISIBLE CLASS , 1996 .

[8]  T P Speed,et al.  A score test for the linkage analysis of qualitative and quantitative traits based on identity by descent data from sib-pairs. , 2000, Biostatistics.

[9]  G. Basharin.  On a Statistical Estimate for the Entropy of a Sequence of Independent Random Variables , 1959 .

[10]  Moon,et al.  Estimation of mutual information using kernel density estimators. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[11]  Wentian Li.  Mutual information functions versus correlation functions , 1990 .

[12]  Marek Kanter.  Autoregression for discrete processes mod 2 , 1975 .

[13]  Peter X.-K. Song,et al.  Stationary time series models with exponential dispersion model margins , 1998 .

[14]  C. Granger,et al.  USING THE MUTUAL INFORMATION COEFFICIENT TO IDENTIFY LAGS IN NONLINEAR MODELS , 1994 .

[15]  Alexander Joseph.  Book reviewDischarge patterns of single fibers in the cat's auditory nerve: Nelson Yuan-Sheng Kiang, with the assistance of Takeshi Watanabe, Eleanor C. Thomas and Louise F. Clark: Research Monograph no. 35. Cambridge, Mass., The M.I.T. Press, 1965 , 1967 .

[16]  Peter A. W. Lewis,et al.  STATIONARY DISCRETE AUTOREGRESSIVE‐MOVING AVERAGE TIME SERIES GENERATED BY MIXTURES , 1983 .

[17]  Peter A. W. Lewis,et al.  Discrete Time Series Generated by Mixtures. I: Correlational and Runs Properties , 1978 .

[18]  R. N. Stiles.  Mechanical and neural feedback factors in postural hand tremor of normal subjects. , 1980, Journal of neurophysiology.

[19]  Atanu Biswas,et al.  AN OVERVIEW OF MODELING TECHNIQUES FOR HYBRID BRAIN DATA , 2008 .

[20]  Katherine B. Ensor,et al.  Multivariate Time‐Series Analysis With Categorical and Continuous Variables in an Lstr Model , 2007 .

[21]  A. Antos,et al.  Convergence properties of functional estimates for discrete distributions , 2001 .

[22]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[23]  Robert C. Jung,et al.  Coherent forecasting in integer time series models , 2006 .

[24]  Benjamin Kedem,et al.  Regression models for time series analysis , 2002 .

[25]  Fw Fred Steutel,et al.  Discrete analogues of self-decomposability and stability , 1979 .

[26]  N. Mars,et al.  Time delay estimation in non-linear systems using average amount of mutual information analysis , 1982 .

[27]  Andrew Harvey,et al.  An Algorithm for Exact Maximum Likelihood Estimation of Autoregressive–Moving Average Models by Means of Kaiman Filtering , 1980 .

[28]  Rasmus Waagepetersen.  A Simulation-based Goodness-of-fit Test for Random Effects in Generalized Linear Mixed Models , 2006 .

[29]  Emery N. Brown,et al.  The Time-Rescaling Theorem and Its Application to Neural Spike Train Data Analysis , 2002, Neural Computation.

[30]  D H Johnson,et al.  The transmission of signals by auditory-nerve fiber discharge patterns. , 1983, The Journal of the Acoustical Society of America.

[31]  Atanu Biswas,et al.  Time series analysis of categorical data using auto-mutual information , 2009 .

[32]  Christophe Andrieu,et al.  Efficient particle filtering for jump Markov systems. Application to time-varying autoregressions , 2003, IEEE Trans. Signal Process..

[33]  R. Moddemeijer.  On estimation of entropy and mutual information of continuous distributions , 1989 .

[34]  W. Li,et al.  Time series models based on generalized linear models: some further results. , 1994, Biometrics.

[35]  R. Kass,et al.  Statistical analysis of temporal evolution in single-neuron firing rates. , 2002, Biostatistics.

[36]  B. Jørgensen,et al.  State‐space models for multivariate longitudinal data of mixed types , 1996 .

[37]  E N Brown,et al.  A Statistical Paradigm for Neural Spike Train Decoding Applied to Position Prediction from Ensemble Firing Patterns of Rat Hippocampal Place Cells , 1998, The Journal of Neuroscience.

[38]  Rudy Moddemeijer,et al.  Delay-estimation with application to electroencephalograms in epilepsy , 1990 .

[39]  David R. Brillinger,et al.  Mutual information in the frequency domain , 2007 .

[40]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[41]  Michael J. Berry,et al.  The structure and precision of retinal spike trains. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[42]  M. Quirk,et al.  Construction and analysis of non-Poisson stimulus-response models of neural spiking activity , 2001, Journal of Neuroscience Methods.

[43]  William Bialek,et al.  Entropy and Information in Neural Spike Trains , 1996, cond-mat/9603127.

[44]  R. Elble.  Physiologic and essential tremor , 1986, Neurology.