Causal inference from noisy time-series data - Testing the Convergent Cross-Mapping algorithm in the presence of noise and external influence

Abstract Convergent Cross-Mapping (CCM) has shown high potential to perform causal inference in the absence of detailed models. This has implications for the understanding of complex information systems, as well as complex systems more generally. This article assesses the strengths and weaknesses of the CCM algorithm by varying coupling strength and noise levels in a model system consisting of two coupled logistic maps. As expected, it is found that CCM fails to accurately infer coupling strength and even causality direction in strongly coupled synchronized time-series, but surprisingly also in the presence of intermediate coupling. It is further found that the presence of noise reduces the level of cross-mapping fidelity, where the converged value of the CCM correlation decreases roughly linearly as a function of the noise, while the convergence rate of the CCM correlation shows little sensitivity to noise. The article proposes controlled noise injections in intermediate-to-strongly coupled systems could enable more accurate causal inferences. Initial investigation of an external driving signal indicates robustness of CCM toward this potentially confounding influence. Given the inherent noisy nature of real-world systems, the findings enable a more accurate evaluation of CCM applicability and the article advances suggestions on how to overcome the method’s weaknesses.

[1]  Richard J. Kryscio,et al.  Sugihara causality analysis of scalp EEG for detection of early Alzheimer's disease , 2014, NeuroImage: Clinical.

[2]  Fraser,et al.  Independent coordinates for strange attractors from mutual information. , 1986, Physical review. A, General physics.

[3]  Drona Kandhai,et al.  Information dissipation as an early-warning signal for the Lehman Brothers collapse in financial time series , 2013, Scientific Reports.

[4]  Harry Eugene Stanley,et al.  Catastrophic cascade of failures in interdependent networks , 2009, Nature.

[5]  Danny Summers,et al.  Chaos in periodically forced discrete-time ecosystem models , 2000 .

[6]  Jürgen Kurths,et al.  Recurrence plots for the analysis of complex systems , 2009 .

[7]  E. Ott Chaos in Dynamical Systems: Contents , 1993 .

[8]  Lin Tang,et al.  Future Generation Computer Systems ( ) – Future Generation Computer Systems towards Adaptive Synchronization Measurement of Large-scale Non-stationary Non-linear Data , 2022 .

[9]  Yan Liu,et al.  Temporal causal modeling with graphical granger methods , 2007, KDD '07.

[10]  A. Lloyd THE COUPLED LOGISTIC MAP : A SIMPLE MODEL FOR THE EFFECTS OF SPATIAL HETEROGENEITY ON POPULATION DYNAMICS , 1995 .

[11]  T. Royama,et al.  MORAN EFFECT ON NONLINEAR POPULATION PROCESSES , 2005 .

[12]  Michel Verleysen,et al.  Vector quantization: a weighted version for time-series forecasting , 2005, Future Gener. Comput. Syst..

[13]  A. Ferretti,et al.  A study of coupled logistic map and its applications in chemical physics , 1988 .

[14]  Zi-Gang Huang,et al.  Directed dynamical influence is more detectable with noise , 2016, Scientific Reports.

[15]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[16]  Tomás Gedeon,et al.  On the Efficacy of State Space Reconstruction Methods in Determining Causality , 2015, SIAM J. Appl. Dyn. Syst..

[17]  James M. McCracken,et al.  Convergent cross-mapping and pairwise asymmetric inference. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[19]  H. Kantz,et al.  Nonlinear time series analysis , 1997 .

[20]  P. McClintock Synchronization:a universal concept in nonlinear science , 2003 .

[21]  Henry D. I. Abarbanel,et al.  Analysis of Observed Chaotic Data , 1995 .

[22]  Carroll,et al.  Statistics for mathematical properties of maps between time series embeddings. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[23]  Jan Lindström,et al.  The Moran effect and synchrony in population dynamics , 1997 .

[24]  George Sugihara,et al.  Detecting Causality in Complex Ecosystems , 2012, Science.

[25]  Kazuyuki Aihara,et al.  Detecting Causality from Nonlinear Dynamics with Short-term Time Series , 2014, Scientific Reports.

[26]  G. Lakoff Why it Matters How We Frame the Environment , 2010 .

[27]  C.W. Taylor,et al.  The anatomy of a power grid blackout - Root causes and dynamics of recent major blackouts , 2006, IEEE Power and Energy Magazine.

[28]  D. Sornette,et al.  Epileptic seizures: Quakes of the brain? , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  S. Boccaletti,et al.  Synchronization of chaotic systems , 2001 .

[30]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[31]  Amir E. BozorgMagham,et al.  Causality Analysis: Identifying the Leading Element in a Coupled Dynamical System , 2015, PloS one.

[32]  George Sugihara,et al.  Spatial convergent cross mapping to detect causal relationships from short time series. , 2015, Ecology.

[33]  George Sugihara,et al.  Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series , 1990, Nature.

[34]  L. Cao Practical method for determining the minimum embedding dimension of a scalar time series , 1997 .

[35]  J. Pearl Causal inference in statistics: An overview , 2009 .

[36]  Robert M. May,et al.  Simple mathematical models with very complicated dynamics , 1976, Nature.

[37]  P. A. P. Moran,et al.  The statistical analysis of the Canadian Lynx cycle. , 1953 .

[38]  D. Richard Kuhn,et al.  Sources of Failure in the Public Switched Telephone Network , 1997, Computer.

[39]  F. Takens Detecting strange attractors in turbulence , 1981 .

[40]  H. Abarbanel,et al.  Determining embedding dimension for phase-space reconstruction using a geometrical construction. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[41]  C L Webber,et al.  Dynamical assessment of physiological systems and states using recurrence plot strategies. , 1994, Journal of applied physiology.