Recent progress and new methods for detecting causal relations in large nonlinear time series datasets

Detecting causal relationships from observational time series datasets is a key problem in better understanding the complex dynamical system Earth. Recent methodological advances have addressed major challenges such as high-dimensionality and nonlinearity, e.g., PCMCI (Runge et al. Sci. Adv. 2019), but many more remain. In this talk I will give an overview of challenges and methods and present a novel algorithm to identify causal directions among contemporaneous (or instantaneous) relationships. Such contemporaneous relations frequently appear when time series are aggregated (e.g., at a monthly resolution). Then approaches such as Granger Causality and PCMCI fail because they currently only address time-lagged causal relations. We present extensive numerical examples and results on the causal relations among major climate modes of variability. The work overcomes a major drawback of current causal discovery methods and opens up entirely new possibilities to discover causal relations from time series in climate research and other fields in geosciences.

[1]  R. Karger,et al.  Kretschmer , 2004 .

[2]  D. Sejdinovic,et al.  Detecting causal associations in large nonlinear time series datasets , 2018 .

[3]  Jakob Runge,et al.  Conditional independence testing based on a nearest-neighbor estimator of conditional mutual information , 2017, AISTATS.

[4]  J Runge,et al.  Causal network reconstruction from time series: From theoretical assumptions to practical estimation. , 2018, Chaos.

[5]  Jakob Runge,et al.  Quantifying the Strength and Delay of Climatic Interactions: The Ambiguities of Cross Correlation and a Novel Measure Based on Graphical Models , 2014 .

[6]  Tom Burr,et al.  Causation, Prediction, and Search , 2003, Technometrics.

[7]  Tarek S. El-Madany,et al.  Causal networks of biosphere–atmosphere interactions , 2019 .

[8]  Jürgen Kurths,et al.  Identifying causal gateways and mediators in complex spatio-temporal systems , 2015, Nature Communications.

[9]  Georgios Balasis,et al.  Common solar wind drivers behind magnetic storm–magnetospheric substorm dependency , 2017, Scientific Reports.

[10]  Joachim Denzler,et al.  Using Causal Inference to Globally Understand Black Box Predictors Beyond Saliency Maps , 2020 .

[11]  Jürgen Kurths,et al.  Quantifying Causal Coupling Strength: A Lag-specific Measure For Multivariate Time Series Related To Transfer Entropy , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  Jakob Runge,et al.  The role of the North Atlantic overturning and deep ocean for multi-decadal global-mean-temperature variability , 2014 .

[13]  A. Alessandri,et al.  Long-Lead Statistical Forecasts of the Indian Summer Monsoon Rainfall Based on Causal Precursors , 2019, Weather and Forecasting.

[14]  Jakob Runge,et al.  Introduction to Focus Issue: Causation inference and information flow in dynamical systems: Theory and applications. , 2018, Chaos.

[15]  Markus Reichstein,et al.  A perspective on Gaussian processes for Earth observation , 2019, National science review.

[16]  Mélanie Frappier,et al.  The Book of Why: The New Science of Cause and Effect , 2018, Science.

[17]  Joachim Denzler,et al.  SupernoVAE : VAE based kernel PCA for analysis of spatio-temporal Earth data , 2018 .

[18]  Joachim Denzler,et al.  Nonlinear Causal Link Estimation Under Hidden Confounding with an Application to Time Series Anomaly Detection , 2019, GCPR.

[19]  Jakob Runge,et al.  The different stratospheric influence on cold-extremes in Eurasia and North America , 2018, npj Climate and Atmospheric Science.

[20]  B. Pompe,et al.  Momentary information transfer as a coupling measure of time series. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  Jürgen Kurths,et al.  Escaping the curse of dimensionality in estimating multivariate transfer entropy. , 2012, Physical review letters.

[22]  Jürgen Kurths,et al.  Optimal model-free prediction from multivariate time series. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  Jakob Runge,et al.  Quantifying information transfer and mediation along causal pathways in complex systems. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  Bernhard Schölkopf,et al.  Inferring causation from time series in Earth system sciences , 2019, Nature Communications.