Simulation Study of Direct Causality Measures in Multivariate Time Series

Measures of the direction and strength of the interdependence among time series from multivariate systems are evaluated based on their statistical significance and discrimination ability. The best-known measures estimating direct causal effects, both linear and nonlinear, are considered, i.e., conditional Granger causality index (CGCI), partial Granger causality index (PGCI), partial directed coherence (PDC), partial transfer entropy (PTE), partial symbolic transfer entropy (PSTE) and partial mutual information on mixed embedding (PMIME). The performance of the multivariate coupling measures is assessed on stochastic and chaotic simulated uncoupled and coupled dynamical systems for different settings of embedding dimension and time series length. The CGCI, PGCI and PDC seem to outperform the other causality measures in the case of the linearly coupled systems, while the PGCI is the most effective one when latent and exogenous variables are present. The PMIME outweighs all others in the case of nonlinear simulation systems.

[1]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[2]  M. Kaminski,et al.  Determination of information flow direction among brain structures by a modified directed transfer function (dDTF) method , 2003, Journal of Neuroscience Methods.

[3]  Dimitris Kugiumtzis,et al.  Direct coupling information measure from non-uniform embedding , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  J. Martinerie,et al.  Statistical assessment of nonlinear causality: application to epileptic EEG signals , 2003, Journal of Neuroscience Methods.

[5]  Dimitris Kugiumtzis,et al.  Transfer Entropy on Rank Vectors , 2010, ArXiv.

[6]  M. Rosenblum,et al.  Detecting direction of coupling in interacting oscillators. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  A. Escribano,et al.  Information-Theoretic Analysis of Serial Dependence and Cointegration , 1997 .

[8]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[9]  R. Andrzejak,et al.  Detection of weak directional coupling: phase-dynamics approach versus state-space approach. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  S. Bressler,et al.  Granger Causality: Basic Theory and Application to Neuroscience , 2006, q-bio/0608035.

[11]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[12]  Y. Matsuda.  Graphical modelling for multivariate time series , 2004 .

[13]  H. Kleinert,et al.  Rényi’s information transfer between financial time series , 2011, 1106.5913.

[14]  W. Singer,et al.  Testing non-linearity and directedness of interactions between neural groups in the macaque inferotemporal cortex , 1999, Journal of Neuroscience Methods.

[15]  Dimitris Kugiumtzis,et al.  Non-uniform state space reconstruction and coupling detection , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[17]  K. Kendrick,et al.  Partial Granger causality—Eliminating exogenous inputs and latent variables , 2008, Journal of Neuroscience Methods.

[18]  Luca Faes,et al.  Testing Frequency-Domain Causality in Multivariate Time Series , 2010, IEEE Transactions on Biomedical Engineering.

[19]  Régine Le Bouquin-Jeannès,et al.  Linear and nonlinear causality between signals: methods, examples and neurophysiological applications , 2006, Biological Cybernetics.

[20]  Joachim Gross,et al.  Reliability of multivariate causality measures for neural data , 2011, Journal of Neuroscience Methods.

[21]  C. Granger.  Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[22]  Jean-Marie Dufour,et al.  Short and long run causality measures: Theory and inference , 2008 .

[23]  Vasily A. Vakorin,et al.  Confounding effects of indirect connections on causality estimation , 2009, Journal of Neuroscience Methods.

[24]  Daniele Marinazzo,et al.  Kernel method for nonlinear granger causality. , 2007, Physical review letters.

[25]  R Quian Quiroga,et al.  Performance of different synchronization measures in real data: a case study on electroencephalographic signals. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  M. Kaminski,et al.  Granger causality and information flow in multivariate processes. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  A. Stefanski.  Determining thresholds of complete synchronization, and application , 2009 .

[28]  Anil K. Seth,et al.  A MATLAB toolbox for Granger causal connectivity analysis , 2010, Journal of Neuroscience Methods.

[29]  H. Marko,et al.  The Bidirectional Communication Theory - A Generalization of Information Theory , 1973, IEEE Transactions on Communications.

[30]  George Zouridakis,et al.  A comparison of multivariate causality based measures of effective connectivity , 2011, Comput. Biol. Medicine.

[31]  Katarzyna J. Blinowska,et al.  Determination of EEG activity propagation: pair-wise versus multichannel estimate , 2004, IEEE Transactions on Biomedical Engineering.

[32]  Karin Schwab,et al.  Comparison of linear signal processing techniques to infer directed interactions in multivariate neural systems , 2005, Signal Process..

[33]  H. Akaike.  A new look at the statistical model identification , 1974 .

[34]  Luiz A. Baccalá,et al.  Partial directed coherence: a new concept in neural structure determination , 2001, Biological Cybernetics.

[35]  Luca Faes,et al.  Mutual nonlinear prediction as a tool to evaluate coupling strength and directionality in bivariate time series: comparison among different strategies based on k nearest neighbors. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  Jürgen Kurths,et al.  Estimation of the direction of the coupling by conditional probabilities of recurrence. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[37]  Matthäus Staniek,et al.  Symbolic transfer entropy. , 2008, Physical review letters.

[38]  P. Grassberger,et al.  A robust method for detecting interdependences: application to intracranially recorded EEG , 1999, chao-dyn/9907013.

[39]  Katarzyna J. Blinowska,et al.  A new method of the description of the information flow in the brain structures , 1991, Biological Cybernetics.

[40]  Jukka Kortelainen,et al.  Experimental comparison of connectivity measures with simulated EEG signals , 2012, Medical & Biological Engineering & Computing.

[41]  Milan Palus,et al.  Coarse-grained entropy rates for characterization of complex time series , 1996 .

[42]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[43]  Patrick T. Brandt,et al.  Multiple Time Series Models , 2006 .

[44]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[45]  G. H. Yu,et al.  A distribution free plotting position , 2001 .

[46]  Michael Eichler,et al.  Abstract Journal of Neuroscience Methods xxx (2005) xxx–xxx Testing for directed influences among neural signals using partial directed coherence , 2005 .

[47]  K. Sameshima,et al.  Connectivity Inference between Neural Structures via Partial Directed Coherence , 2007 .

[48]  K. Müller,et al.  Robustly estimating the flow direction of information in complex physical systems. , 2007, Physical review letters.

[49]  J. Geweke,et al.  Measurement of Linear Dependence and Feedback between Multiple Time Series , 1982 .

[50]  Dimitris Kugiumtzis,et al.  Detection of Direct Causal Effects and Application to epileptic Electroencephalogram Analysis , 2012, Int. J. Bifurc. Chaos.

[51]  W. Drongelen,et al.  Identification of epileptogenic foci from causal analysis of ECoG interictal spike activity , 2009, Clinical Neurophysiology.

[52]  Dimitris Kugiumtzis,et al.  Partial transfer entropy on rank vectors , 2013, ArXiv.

[53]  P. G. Larsson,et al.  Reducing the bias of causality measures. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[54]  Katarzyna J. Blinowska,et al.  Review of the methods of determination of directed connectivity from multichannel data , 2011, Medical & Biological Engineering & Computing.

[55]  Craig Hiemstra,et al.  Testing for Linear and Nonlinear Granger Causality in the Stock Price-Volume Relation , 1994 .

[56]  L. Faes,et al.  Information-based detection of nonlinear Granger causality in multivariate processes via a nonuniform embedding technique. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[57]  P. F. Verdes.  Assessing causality from multivariate time series. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.