Partial cross mapping eliminates indirect causal influences

Causality detection likely misidentifies indirect causations as direct ones, due to the effect of causation transitivity. Although several methods in traditional frameworks have been proposed to avoid such misinterpretations, there still is a lack of feasible methods for identifying direct causations from indirect ones in the challenging situation where the variables of the underlying dynamical system are non-separable and weakly or moderately interacting. Here, we solve this problem by developing a data-based, model-independent method of partial cross mapping based on an articulated integration of three tools from nonlinear dynamics and statistics: phase-space reconstruction, mutual cross mapping, and partial correlation. We demonstrate our method by using data from different representative models and real-world systems. As direct causations are keys to the fundamental underpinnings of a variety of complex dynamics, we anticipate our method to be indispensable in unlocking and deciphering the inner mechanisms of real systems in diverse disciplines from data. It is crucial yet challenging to identify cause-consequence relation in complex dynamical systems where direct causal links can mix with indirect ones. Leng et al. propose a data-driven model-independent method to distinguish direct from indirect causality and test its applicability to real-world data.

[1]  D. Rand,et al.  Dynamical Systems and Turbulence, Warwick 1980 , 1981 .

[2]  Gordon Pipa,et al.  Transfer entropy—a model-free measure of effective connectivity for the neurosciences , 2010, Journal of Computational Neuroscience.

[3]  Dario Floreano,et al.  GeneNetWeaver: in silico benchmark generation and performance profiling of network inference methods , 2011, Bioinform..

[4]  Ying-Cheng Lai,et al.  Detection of time delays and directional interactions based on time series from complex dynamical systems. , 2017, Physical review. E.

[5]  Marten Scheffer,et al.  Chaos in a long-term experiment with a plankton community , 2008, Nature.

[6]  Jianqing Fan,et al.  Statistical Estimation in Varying-Coefficient Models , 1999 .

[7]  Jens Timmer,et al.  Direct or indirect? Graphical models for neural oscillators , 2004, Journal of Physiology-Paris.

[8]  Luonan Chen,et al.  Part mutual information for quantifying direct associations in networks , 2016, Proceedings of the National Academy of Sciences.

[9]  Karl J. Friston,et al.  Structural and Functional Brain Networks: From Connections to Cognition , 2013, Science.

[10]  Jürgen Kurths,et al.  Distinguishing direct from indirect interactions in oscillatory networks with multiple time scales. , 2010, Physical review letters.

[11]  T. Wong,et al.  Air pollution and hospital admissions for respiratory and cardiovascular diseases in Hong Kong. , 1999, Occupational and environmental medicine.

[12]  Jie Sun,et al.  Causation entropy from symbolic representations of dynamical systems. , 2015, Chaos.

[13]  Kazuyuki Aihara,et al.  Randomly distributed embedding making short-term high-dimensional data predictable , 2018, Proceedings of the National Academy of Sciences.

[14]  R. Burke,et al.  Detecting dynamical interdependence and generalized synchrony through mutual prediction in a neural ensemble. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[15]  J. Geweke,et al.  Measurement of Linear Dependence and Feedback between Multiple Time Series , 1982 .

[16]  David S. Broomhead,et al.  Delay Embeddings for Forced Systems. II. Stochastic Forcing , 2003, J. Nonlinear Sci..

[17]  S. Shen-Orr,et al.  Network motifs: simple building blocks of complex networks. , 2002, Science.

[18]  Zi-Gang Huang,et al.  Directed dynamical influence is more detectable with noise , 2016, Scientific Reports.

[19]  Aneta Stefanovska,et al.  Coupling functions in networks of oscillators , 2015 .

[20]  Kazuyuki Aihara,et al.  Detecting Causality from Nonlinear Dynamics with Short-term Time Series , 2014, Scientific Reports.

[21]  Krishnan Bhaskaran,et al.  Short-term effects of air pollution on a range of cardiovascular events in England and Wales: case-crossover analysis of the MINAP database, hospital admissions and mortality , 2014, Heart.

[22]  Erik Laminski,et al.  Topological Causality in Dynamical Systems. , 2016, Physical review letters.

[23]  Kyuhong Lee,et al.  Air Pollution Exposure and Cardiovascular Disease , 2014, Toxicological research.

[24]  Paul L. Joskow,et al.  The effects of economic regulation , 1989 .

[25]  William Stafford Noble,et al.  How does multiple testing correction work? , 2009, Nature Biotechnology.

[26]  Aneta Stefanovska,et al.  Coupling functions:universal insights into dynamical interaction mechanisms , 2017, 1706.01810.

[27]  M. Scheffer,et al.  Causal feedbacks in climate change , 2015 .

[28]  R. Mañé,et al.  On the dimension of the compact invariant sets of certain non-linear maps , 1981 .

[29]  S. Sadjadi,et al.  Optimization methods applied to renewable and sustainable energy: A review , 2017 .

[30]  George Sugihara,et al.  Detecting Causality in Complex Ecosystems , 2012, Science.

[31]  U. Alon Network motifs: theory and experimental approaches , 2007, Nature Reviews Genetics.

[32]  George Sugihara,et al.  Dynamical evidence for causality between galactic cosmic rays and interannual variation in global temperature , 2015, Proceedings of the National Academy of Sciences.

[33]  Peter V. E. McClintock,et al.  A tutorial on time-evolving dynamical Bayesian inference , 2014 .

[34]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[35]  Mingzhou Ding,et al.  Evaluating causal relations in neural systems: Granger causality, directed transfer function and statistical assessment of significance , 2001, Biological Cybernetics.

[36]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[37]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[38]  Dane Taylor,et al.  Causal Network Inference by Optimal Causation Entropy , 2014, SIAM J. Appl. Dyn. Syst..

[39]  Gemma Lancaster,et al.  Surrogate data for hypothesis testing of physical systems , 2018, Physics Reports.

[40]  Anje-Margriet Neutel,et al.  Stability in Real Food Webs: Weak Links in Long Loops , 2002, Science.

[41]  Kazuyuki Aihara,et al.  Detecting Causality by Combined Use of Multiple Methods: Climate and Brain Examples , 2016, PloS one.

[42]  F. Takens Detecting strange attractors in turbulence , 1981 .

[43]  D. Floreano,et al.  Revealing strengths and weaknesses of methods for gene network inference , 2010, Proceedings of the National Academy of Sciences.

[44]  J. Shaffer Multiple Hypothesis Testing , 1995 .

[45]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[46]  K. Kendrick,et al.  Partial Granger causality—Eliminating exogenous inputs and latent variables , 2008, Journal of Neuroscience Methods.

[47]  Jie Sun,et al.  Identifying the Coupling Structure in Complex Systems through the Optimal Causation Entropy Principle , 2014, Entropy.

[48]  Jakob Runge,et al.  Quantifying the Strength and Delay of Climatic Interactions: The Ambiguities of Cross Correlation and a Novel Measure Based on Graphical Models , 2014 .

[49]  George Sugihara,et al.  Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series , 1990, Nature.

[50]  James D. Lawrey,et al.  Statistical Methods in Biology , 1996 .

[51]  J. Stark,et al.  Delay Embeddings for Forced Systems. I. Deterministic Forcing , 1999 .

[52]  J. Geweke,et al.  Measures of Conditional Linear Dependence and Feedback between Time Series , 1984 .

[53]  S. Frenzel,et al.  Partial mutual information for coupling analysis of multivariate time series. , 2007, Physical review letters.

[54]  Dario Floreano,et al.  Generating Realistic In Silico Gene Networks for Performance Assessment of Reverse Engineering Methods , 2009, J. Comput. Biol..

[55]  J Runge,et al.  Causal network reconstruction from time series: From theoretical assumptions to practical estimation. , 2018, Chaos.

[56]  N. D. Clarke,et al.  Towards a Rigorous Assessment of Systems Biology Models: The DREAM3 Challenges , 2010, PloS one.

[57]  Jianfeng Feng,et al.  Granger Causality: Theory and Applications , 2010 .

[58]  A. Duggento,et al.  Dynamical Bayesian inference of time-evolving interactions: from a pair of coupled oscillators to networks of oscillators. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[59]  D. Helbing,et al.  The Hidden Geometry of Complex, Network-Driven Contagion Phenomena , 2013, Science.

[60]  Jef Huisman,et al.  Coupled predator-prey oscillations in a chaotic food web. , 2009, Ecology letters.

[61]  Siyang Leng,et al.  Reconstructing directional causal networks with random forest: Causality meeting machine learning. , 2019, Chaos.

[62]  Philip T. Clemson,et al.  Discerning non-autonomous dynamics , 2014 .

[63]  R. Shibata,et al.  PARTIAL CORRELATION AND CONDITIONAL CORRELATION AS MEASURES OF CONDITIONAL INDEPENDENCE , 2004 .

[64]  Jürgen Kurths,et al.  Escaping the curse of dimensionality in estimating multivariate transfer entropy. , 2012, Physical review letters.

[65]  George Sugihara,et al.  Predicting climate effects on Pacific sardine , 2013, Proceedings of the National Academy of Sciences.

[66]  Lingsong Zhang,et al.  STATISTICAL METHODS IN BIOLOGY , 1902, Nature.