Causal inference in nonlinear systems: Granger causality versus time-delayed mutual information.

The Granger causality (GC) analysis has been extensively applied to infer causal interactions in dynamical systems arising from economy and finance, physics, bioinformatics, neuroscience, social science, and many other fields. In the presence of potential nonlinearity in these systems, the validity of the GC analysis in general is questionable. To illustrate this, here we first construct minimal nonlinear systems and show that the GC analysis fails to infer causal relations in these systems-it gives rise to all types of incorrect causal directions. In contrast, we show that the time-delayed mutual information (TDMI) analysis is able to successfully identify the direction of interactions underlying these nonlinear systems. We then apply both methods to neuroscience data collected from experiments and demonstrate that the TDMI analysis but not the GC analysis can identify the direction of interactions among neuronal signals. Our work exemplifies inference hazards in the GC analysis in nonlinear systems and suggests that the TDMI analysis can be an appropriate tool in such a case.

[1]  C. Granger Investigating Causal Relations by Econometric Models and Cross-Spectral Methods , 1969 .

[2]  J. Geweke,et al.  Measurement of Linear Dependence and Feedback between Multiple Time Series , 1982 .

[3]  G. Buzsáki,et al.  Theta Oscillations Provide Temporal Windows for Local Circuit Computation in the Entorhinal-Hippocampal Loop , 2009, Neuron.

[4]  A. Seth,et al.  Granger causality and transfer entropy are equivalent for Gaussian variables. , 2009, Physical review letters.

[5]  Marc Timme,et al.  Dynamic information routing in complex networks , 2015, Nature Communications.

[6]  Patrick L Purdon,et al.  A study of problems encountered in Granger causality analysis from a neuroscience perspective , 2017, Proceedings of the National Academy of Sciences.

[7]  Raul Vicente,et al.  Transfer Entropy in Neuroscience , 2014 .

[8]  Radhakrishnan Nagarajan,et al.  Granger Causality Analysis of Human Cell-Cycle Gene Expression Profiles , 2010, Statistical applications in genetics and molecular biology.

[9]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[10]  Albert D. Shieh,et al.  Statistical Applications in Genetics and Molecular Biology , 2010 .

[11]  A. Destexhe,et al.  Oscillations, complex spatiotemporal behavior, and information transport in networks of excitatory and inhibitory neurons. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[12]  M. Rasch,et al.  Distinct Inhibitory Circuits Orchestrate Cortical beta and gamma Band Oscillations , 2017, Neuron.

[13]  STAT , 2019, Springer Reference Medizin.

[14]  Steven L. Bressler,et al.  Wiener–Granger Causality: A well established methodology , 2011, NeuroImage.

[15]  J. Herskowitz,et al.  Proceedings of the National Academy of Sciences, USA , 1996, Current Biology.

[16]  Jonathan M. Nichols,et al.  A method for detecting damage-induced nonlinearities in structures using information theory , 2006 .

[17]  Leonidas Sandoval Junior Structure and causality relations in a global network of financial companies , 2013, 1310.5388.

[18]  Luca Faes,et al.  On the interpretability and computational reliability of frequency-domain Granger causality , 2017, F1000Research.

[19]  Swinney,et al.  Information transport in spatiotemporal systems. , 1988, Physical review letters.

[20]  Zhi-Qin John Xu,et al.  Granger Causality Network Reconstruction of Conductance-Based Integrate-and-Fire Neuronal Systems , 2014, PloS one.

[21]  Snigdhansu Chatterjee,et al.  Causality and pathway search in microarray time series experiment , 2007, Bioinform..

[22]  Judea Pearl COMMENTS ON NEUBERG'S REVIEW OF CAUSALITY , 2003, Econometric Theory.

[23]  Guifen Chen,et al.  The characterization of hippocampal theta-driving neurons — a time-delayed mutual information approach , 2017, Scientific Reports.

[24]  Pierre Rochus,et al.  Hu, Luojia , Estimation of a censored dynamic panel data model,Econometrica. Journal of the Econometric Society , 2002 .

[25]  Laurent Weill,et al.  Bank Capital and Liquidity Creation: Granger-Causality Evidence , 2012, SSRN Electronic Journal.

[26]  Zhenyan Zhu,et al.  Economic growth and energy consumption revisited — Evidence from linear and nonlinear Granger causality , 2008 .

[27]  O. William Journal Of The American Statistical Association V-28 , 1932 .

[28]  S. Bressler,et al.  Beta oscillations in a large-scale sensorimotor cortical network: directional influences revealed by Granger causality. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[29]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  T. Dimpfl,et al.  Using Transfer Entropy to Measure Information Flows Between Financial Markets , 2013 .

[31]  Guifen Chen,et al.  Hippocampal theta‐driving cells revealed by Granger causality , 2012, Hippocampus.

[32]  Jan W. Gooch Stud , 2020, The Fairchild Books Dictionary of Fashion.

[33]  David Cai,et al.  Causal and structural connectivity of pulse-coupled nonlinear networks. , 2013, Physical review letters.

[34]  Igor Vajda,et al.  Estimation of the Information by an Adaptive Partitioning of the Observation Space , 1999, IEEE Trans. Inf. Theory.

[35]  Mounir Ben Mbarek,et al.  Nuclear energy, renewable energy, CO2 emissions, and economic growth for nine developed countries: Evidence from panel Granger causality tests , 2016 .

[36]  E. B. Wilson PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES. , 1919, Science.

[37]  L. Keele Social Capital and the Dynamics of Trust in Government , 2007 .

[38]  Jens Timmer,et al.  Handbook of time series analysis : recent theoretical developments and applications , 2006 .

[39]  John R. Freeman Granger Causality and the Time Series Analysis of Political Relationships , 1983 .

[40]  Antonio-José Almeida,et al.  NAT , 2019, Springer Reference Medizin.

[41]  A. Seth,et al.  Granger causality for state-space models. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[42]  Gordon Pipa,et al.  Transfer entropy—a model-free measure of effective connectivity for the neurosciences , 2010, Journal of Computational Neuroscience.

[43]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[44]  A. Seth,et al.  Granger Causality Analysis in Neuroscience and Neuroimaging , 2015, The Journal of Neuroscience.

[45]  Klaus Lehnertz,et al.  Identifying delayed directional couplings with symbolic transfer entropy. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[46]  Dimitris Kugiumtzis,et al.  Detecting Causality in Non-stationary Time Series Using Partial Symbolic Transfer Entropy: Evidence in Financial Data , 2015, Computational Economics.

[47]  runden Tisch,et al.  AM , 2020, Catalysis from A to Z.

[48]  G. Rangarajan,et al.  Multiple Nonlinear Time Series with Extended Granger Causality , 2004 .

[49]  W. Hager,et al.  and s , 2019, Shallow Water Hydraulics.

[50]  Anil K. Seth,et al.  The MVGC multivariate Granger causality toolbox: A new approach to Granger-causal inference , 2014, Journal of Neuroscience Methods.

[51]  D. Stephenson,et al.  Granger Causality of Coupled Climate Processes: Ocean Feedback on the North Atlantic Oscillation , 2006 .

[52]  Ming-Chung Ho,et al.  Information flow and nontrivial collective behavior in chaotic-coupled-map lattices. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[53]  Carlos Dias Maciel,et al.  Delayed mutual information infers patterns of synaptic connectivity in a proprioceptive neural network , 2015, Journal of Computational Neuroscience.

[54]  J M Nichols,et al.  Inferences about information flow and dispersal for spatially extended population systems using time-series data , 2005, Proceedings of the Royal Society B: Biological Sciences.

[55]  문정진 § 19 , 2000 .

[56]  Matthäus Staniek,et al.  Symbolic transfer entropy. , 2008, Physical review letters.

[57]  김창호,et al.  35. , 1991, Maxime Planoudes, Lettres.

[58]  R. Sarpong,et al.  Bio-inspired synthesis of xishacorenes A, B, and C, and a new congener from fuscol† †Electronic supplementary information (ESI) available. See DOI: 10.1039/c9sc02572c , 2019, Chemical science.