Robust Statistics for Describing Causality in Multivariate Time Series

A widely agreed upon definition of time series causality inference, established in the seminal 1969 article of Clive Granger (1969), is based on the relative ability of the history of one time series to predict the current state of another, conditional on all other past information. While the Granger Causality (GC) principle remains uncontested, its literal application is challenged by practical and physical limitations of the process of discretely sampling continuous dynamic systems. Advances in methodology for time-series causality subsequently evolved mainly in econometrics and brain imaging: while each domain has specific data and noise characteristics the basic aims and challenges are similar. Dynamic interactions may occur at higher temporal or spatial resolution than our ability to measure them, which leads to the potentially false inference of causation where only correlation is present. Causality assignment can be seen as the principled partition of spectral coherence among interacting signals using both auto-regressive (AR) modeling and spectral decomposition. While both approaches are theoretically equivalent, interchangeably describing linear dynamic processes, the purely spectral approach currently differs in its somewhat higher ability to accurately deal with mixed additive noise. Two new methods are introduced 1) a purely auto-regressive method named Causal Structural Information is introduced which unlike current AR-based methods is robust to mixed additive noise and 2) a novel means of calculating multivariate spectra for unevenly sampled data based on cardinal trigonometric functions is incorporated into the recently introduced phase slope index (PSI) spectral causal inference method (Nolte et al., 2008). In addition to these, PSI, partial coherence-based PSI and existing AR-based causality measures were tested on a specially constructed data-set simulating possible confounding effects of mixed noise and another additionally testing the influence of common, background driving signals. Tabulated statistics are provided in which true causality influence is subjected to an acceptable level of false inference probability.

[1]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[2]  Patrik O. Hoyer,et al.  Discovering Cyclic Causal Models by Independent Components Analysis , 2008, UAI.

[3]  Luiz A. Baccalá,et al.  Partial directed coherence: a new concept in neural structure determination , 2001, Biological Cybernetics.

[4]  Kaustubh Supekar,et al.  Multivariate dynamical systems models for estimating causal interactions in fMRI , 2011, NeuroImage.

[5]  Bernhard Schölkopf,et al.  Nonlinear causal discovery with additive noise models , 2008, NIPS.

[6]  K. Müller,et al.  Robustly estimating the flow direction of information in complex physical systems. , 2007, Physical review letters.

[7]  Lester Melie-García,et al.  Estimating brain functional connectivity with sparse multivariate autoregression , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[8]  H. White,et al.  Granger Causality and Dynamic Structural Systems , 2010 .

[9]  H. Akaike On the use of a linear model for the identification of feedback systems , 1968 .

[10]  J. Geweke,et al.  Measurement of Linear Dependence and Feedback between Multiple Time Series , 1982 .

[11]  John Beatty,et al.  The Empire of Chance: How Probability Changed Science and Everyday Life , 1989 .

[12]  M. Kendall Statistical Methods for Research Workers , 1937, Nature.

[13]  W. Gersch,et al.  Epileptic Focus Location: Spectral Analysis Method , 1970, Science.

[14]  A. Seth,et al.  Multivariate Granger causality and generalized variance. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  M A Nicolelis,et al.  Structural analysis of neural circuits using the theory of directed graphs. , 1991, Computers and biomedical research, an international journal.

[16]  Halbert White,et al.  Approximate Nonlinear Forecasting Methods , 2006 .

[17]  Alessio Moneta,et al.  Can Graphical Causal Inference Be Extended to Nonlinear Settings , 2009 .

[18]  William I. Gasarch,et al.  Book Review: An introduction to Kolmogorov Complexity and its Applications Second Edition, 1997 by Ming Li and Paul Vitanyi (Springer (Graduate Text Series)) , 1997, SIGACT News.

[19]  H. White,et al.  A NONPARAMETRIC HELLINGER METRIC TEST FOR CONDITIONAL INDEPENDENCE , 2008, Econometric Theory.

[20]  R. A. FISHER Tables for Statisticians and Biometricians , 1933, Nature.

[21]  Clark Glymour,et al.  Search for Additive Nonlinear Time Series Causal Models , 2008, J. Mach. Learn. Res..

[22]  Andreas Ziehe,et al.  Comparison of Granger Causality and Phase Slope Index , 2008, NIPS Causality: Objectives and Assessment.

[23]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[24]  Florin Popescu Identification of sparse multivariate autoregressive models , 2008, 2008 16th European Signal Processing Conference.

[25]  Katarzyna J. Blinowska,et al.  A new method of the description of the information flow in the brain structures , 1991, Biological Cybernetics.

[26]  Victor Solo,et al.  On causality I: Sampling and noise , 2007, 2007 46th IEEE Conference on Decision and Control.

[27]  Andreas Ziehe,et al.  TDSEP { an e(cid:14)cient algorithm for blind separation using time structure , 1998 .

[28]  Thomas S. Richardson,et al.  Automated discovery of linear feedback models , 1996 .

[29]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[30]  Mingzhou Ding,et al.  Evaluating causal relations in neural systems: Granger causality, directed transfer function and statistical assessment of significance , 2001, Biological Cybernetics.

[31]  D. Mccloskey,et al.  The Cult of Statistical Significance: How the Standard Error Costs Us Jobs, Justice, and Lives , 2008 .

[32]  Koichi Sameshima,et al.  Using partial directed coherence to describe neuronal ensemble interactions , 1999, Journal of Neuroscience Methods.

[33]  Alard Roebroeck,et al.  Causal Time Series Analysis of Functional Magnetic Resonance Imaging Data , 2009, NIPS Mini-Symposium on Causality in Time Series.

[34]  G. Yule Why do we Sometimes get Nonsense-Correlations between Time-Series?--A Study in Sampling and the Nature of Time-Series , 1926 .

[35]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[36]  T. Koopmans Statistical inference in dynamic economic models , 1951 .

[37]  Patrik O. Hoyer,et al.  Causal Inference by Independent Component Analysis with Applications to Micro- and Macroeconomic Data , 2010 .

[38]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[39]  G. Székely,et al.  TESTING FOR EQUAL DISTRIBUTIONS IN HIGH DIMENSION , 2004 .

[40]  P. Phillips THE PROBLEM OF IDENTIFICATION IN FINITE PARAMETER CONTINUOUS TIME MODELS , 1973 .

[41]  Isabelle Guyon,et al.  Time Series Analysis with the Causality Workbench , 2009, NIPS Mini-Symposium on Causality in Time Series.

[42]  Isabelle Guyon,et al.  Design and Analysis of the Causation and Prediction Challenge , 2008, WCCI Causation and Prediction Challenge.

[43]  Isabelle Guyon,et al.  Causality : Objectives and Assessment , 2010 .

[44]  M. G. Kendall,et al.  A Study in the Analysis of Stationary Time-Series. , 1955 .

[45]  A. Lanterman Schwarz, Wallace, and Rissanen: Intertwining Themes in Theories of Model Selection , 2001 .

[46]  Jean Boivin,et al.  Measuring the Effects of Monetary Policy: A Factor-Augmented Vector Autoregressive (FAVAR) Approach , 2003 .

[47]  Peter E. Caines,et al.  Weak and strong feedback free processes , 1976 .

[48]  Tom Burr,et al.  Causation, Prediction, and Search , 2003, Technometrics.

[49]  A. N. Shiryayev,et al.  Selected Works of A. N. Kolmogorov , 1992 .

[50]  Patrik O. Hoyer,et al.  Causal Search in Structural Vector Autoregressive Models , 2009, NIPS Mini-Symposium on Causality in Time Series.

[51]  Tjalling C. Koopmans,et al.  Statistical Inference in Dynamic Economic Models , 1951 .

[52]  M. Kaminski,et al.  Granger causality and information flow in multivariate processes. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[53]  A. Yatchew,et al.  Nonparametric Regression Techniques in Economics , 1998 .

[54]  A. Turing On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[55]  R Scheines,et al.  The TETRAD Project: Constraint Based Aids to Causal Model Specification. , 1998, Multivariate behavioral research.