On the Efficacy of State Space Reconstruction Methods in Determining Causality

We present a theoretical framework for inferring dynamical interactions between weakly or mod- erately coupled variables in systems where deterministic dynamics plays a dominating role. The variables in such a system can be arranged into an interaction graph, which is a set of nodes con- nected by directed edges wherever one variable directly drives another. In a system of ordinary differential equations, a variable x directly drives y if it appears nontrivially on the right-hand side of the equation for the derivative of y. Ideally, given time series measurements of the variables in a system, we would like to recover the interaction graph. We introduce a comprehensive theory show- ing that the transitive closure of the interaction graph is the best outcome that can be obtained from state space reconstructions in a purely deterministic system. Our work depends on extensions of Takens' theorem and the results of Sauer et al. (J. Stat. Phys., 65 (1991), pp. 579-616) that charac- terize the properties of time-delay reconstructions of invariant manifolds and attractors. Along with the theory, we discuss practical implementations of our results. One method for empirical recovery of the interaction graph is presented by Sugihara et al. (Science, 338 (2012), pp. 496-500), called convergent cross-mapping. We show that the continuity detection algorithm of Pecora et al. (Phys. Rev. E, 52 (1995), pp. 3420-3439) is a viable alternative to convergent cross-mapping that is more consistent with the underlying theory. We examine two examples of dynamical systems for which we can recover the transitive closure of the interaction graph using the continuity detection technique. The strongly connected components of the recovered graph represent distinct dynamical subsystems coupled through one-way driving relationships that may correspond to causal relationships in the underlying physical scenario.

[1]  P. Bahr,et al.  Sampling: Theory and Applications , 2020, Applied and Numerical Harmonic Analysis.

[2]  J. Huke Embedding Nonlinear Dynamical Systems: A Guide to Takens' Theorem , 2006 .

[3]  L. Cao Practical method for determining the minimum embedding dimension of a scalar time series , 1997 .

[4]  B. Dundas,et al.  DIFFERENTIAL TOPOLOGY , 2002 .

[5]  D. Broomhead,et al.  Embedding theorems for non-uniformly sampled dynamical systems , 2007 .

[6]  Stefan Friedrich,et al.  Topology , 2019, Arch. Formal Proofs.

[7]  George Sugihara,et al.  Detecting Causality in Complex Ecosystems , 2012, Science.

[8]  Carroll,et al.  Statistics for mathematical properties of maps between time series embeddings. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[9]  Vladimir Igorevich Arnold,et al.  Geometrical Methods in the Theory of Ordinary Differential Equations , 1983 .

[10]  Pfister,et al.  Optimal delay time and embedding dimension for delay-time coordinates by analysis of the global static and local dynamical behavior of strange attractors. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[11]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[12]  J. D. Farmer,et al.  State space reconstruction in the presence of noise" Physica D , 1991 .

[13]  Steven H. Strogatz,et al.  Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry, and Engineering , 1994 .

[14]  Manfred Stern,et al.  Semimodular Lattices: Theory and Applications , 1999 .

[15]  D. Kugiumtzis State space reconstruction parameters in the analysis of chaotic time series—the role of the time window length , 1996, comp-gas/9602002.

[16]  F. Takens Detecting strange attractors in turbulence , 1981 .

[17]  J. Palis,et al.  Geometric theory of dynamical systems , 1982 .

[18]  Steven H. Strogatz,et al.  Nonlinear Dynamics and Chaos , 2024 .

[19]  Fraser,et al.  Independent coordinates for strange attractors from mutual information. , 1986, Physical review. A, General physics.

[20]  Martin Casdagli,et al.  An analytic approach to practical state space reconstruction , 1992 .

[21]  K. Pawelzik,et al.  Optimal Embeddings of Chaotic Attractors from Topological Considerations , 1991 .