Causal Discovery for Climate Research Using Graphical Models

Causal discovery seeks to recover cause‐effect relationships from statistical data using graphical models. One goal of this paper is to provide an accessible introduction to causal discovery methods for climate scientists, with a focus on constraint-based structure learning. Second, in a detailed case study constraintbased structure learning is applied to derive hypotheses of causal relationships between four prominent modes of atmospheric low-frequency variability in boreal winter including the Western Pacific Oscillation (WPO), Eastern Pacific Oscillation (EPO), Pacific‐North America (PNA) pattern, and North Atlantic Oscillation (NAO). The results are shown in the form of static and temporal independence graphs also known as Bayesian Networks. It is found that WPO and EPO are nearly indistinguishable from the cause‐ effect perspective as strong simultaneous coupling is identified between the two. In addition, changes in the state of EPO (NAO) may cause changes in the state of NAO (PNA) approximately 18 (3‐6) days later. These results are not only consistent with previous findings on dynamical processes connecting different low-frequency modes (e.g., interaction between synoptic and low-frequency eddies) but also provide the basis for formulating new hypotheses regarding the time scale and temporal sequencing of dynamical processes responsible for these connections. Last, the authors propose to use structure learning for climate networks, which are currently based primarily on correlation analysis. While correlation-based climate networks focus on similarity between nodes, independence graphs would provide an alternative viewpoint by focusing on information flow in the network.

[1]  Tim Palmer,et al.  A Nonlinear Dynamical Perspective on Climate Prediction , 1999 .

[2]  Christian Borgelt,et al.  A conditional independence algorithm for learning undirected graphical models , 2010, J. Comput. Syst. Sci..

[3]  S. Havlin,et al.  Climate Networks Based on Phase Synchronization Analysis Track El-Nino(Complex Networks,Econophysics-Physical Approach to Social and Economic Phenomena-) , 2009 .

[4]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[5]  Thomas S. Richardson,et al.  Learning high-dimensional directed acyclic graphs with latent and selection variables , 2011, 1104.5617.

[6]  A. H. Murphy,et al.  Hailfinder: A Bayesian system for forecasting severe weather , 1996 .

[7]  Kevin B. Korb,et al.  Seabreeze Prediction Using Bayesian Networks , 2001, PAKDD.

[8]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[9]  Sergey Kravtsov,et al.  A new dynamical mechanism for major climate shifts , 2007 .

[10]  J. Gutiérrez,et al.  Applications of Bayesian Networks in Meteorology , 2004 .

[11]  Christian L. E. Franzke,et al.  Synoptic analysis of the Pacific–North American teleconnection pattern , 2007 .

[12]  Nanny Wermuth,et al.  Multivariate Statistical Analysis , 2011, International Encyclopedia of Statistical Science.

[13]  Norbert Marwan,et al.  The backbone of the climate network , 2009, 1002.2100.

[14]  Norman R. Swanson,et al.  Impulse Response Functions Based on a Causal Approach to Residual Orthogonalization in Vector Autoregressions , 1997 .

[15]  Ying Li,et al.  Impact of ENSO on the Atmospheric Variability over the North Atlantic in Late Winter—Role of Transient Eddies , 2012 .

[16]  W. Collins,et al.  The NCEP–NCAR 50-Year Reanalysis: Monthly Means CD-ROM and Documentation , 2001 .

[17]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[18]  S. Wright The Method of Path Coefficients , 1934 .

[19]  D. A. Kenny,et al.  Correlation and Causation , 1937, Wilmott.

[20]  Massimo Cossentino,et al.  Bayesian Models Of The PM10 Atmospheric Urban Pollution , 2001 .

[21]  Anet Potgieter,et al.  Applying Bayesian modelling to assess climate change effects on biofuel production , 2009 .

[22]  Randall M. Dole,et al.  Linking Weather and Climate , 2006 .

[23]  Kevin Murphy,et al.  Active Learning of Causal Bayes Net Structure , 2006 .

[24]  A. Barnston,et al.  Classification, seasonality and persistence of low-frequency atmospheric circulation patterns , 1987 .

[25]  Judea Pearl,et al.  Bayesian Networks , 1998, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[26]  Huw C. Davies,et al.  Breaking Waves at the Tropopause in the Wintertime Northern Hemisphere: Climatological Analyses of the Orientation and the Theoretical LC1/2 Classification , 2007 .

[27]  S. Havlin,et al.  Climate networks around the globe are significantly affected by El Niño. , 2008, Physical review letters.

[28]  Judea Pearl,et al.  The recovery of causal poly-trees from statistical data , 1987, Int. J. Approx. Reason..

[29]  J. Wallace,et al.  Teleconnections in the Geopotential Height Field during the Northern Hemisphere Winter , 1981 .

[30]  R. Reynolds,et al.  The NCEP/NCAR 40-Year Reanalysis Project , 1996, Renewable Energy.

[31]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[32]  Paul Berrisford,et al.  A New Rossby Wave–Breaking Interpretation of the North Atlantic Oscillation , 2008 .

[33]  Eugene Charniak,et al.  Bayesian Networks without Tears , 1991, AI Mag..

[34]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[35]  Michal Linial,et al.  Using Bayesian Networks to Analyze Expression Data , 2000, J. Comput. Biol..

[36]  Nitesh V. Chawla,et al.  Complex Networks In Climate Science: Progress, Opportunities And Challenges , 2010, CIDU.

[37]  Carlo Giupponi,et al.  Potentials of Bayesian Networks to Deal with Uncertainty in Climate Change Adaptation Policies , 2009 .

[38]  Xun Lu,et al.  Linking Granger Causality and the Pearl Causal Model with Settable Systems , 2009, NIPS Mini-Symposium on Causality in Time Series.

[39]  D. A. Kenny,et al.  Correlation and Causation. , 1982 .

[40]  Christian Franzke,et al.  Is the North Atlantic Oscillation a Breaking Wave , 2004 .

[41]  C. Glymour,et al.  Data Driven Methods for Nonlinear Granger Causality: Climate Teleconnection Mechanisms , 2005 .

[42]  Yan Liu,et al.  Temporal causal modeling with graphical granger methods , 2007, KDD '07.

[43]  N. Giri Multivariate Statistical Analysis : Revised And Expanded , 2003 .

[44]  Yi Deng,et al.  A dynamical fingerprint of tropical Pacific sea surface temperatures on the decadal-scale variability of cool-season Arctic precipitation , 2011 .

[45]  M. Eichler Granger causality and path diagrams for multivariate time series , 2007 .

[46]  S. Havlin,et al.  Pattern of climate network blinking links follows El Niño events , 2008 .

[47]  Gwendal Rivière,et al.  Role of Rossby wave breaking in the west Pacific teleconnection , 2010 .

[48]  P. Spirtes,et al.  From probability to causality , 1991 .

[49]  Paul J. Roebber,et al.  What Do Networks Have to Do with Climate , 2006 .

[50]  Yi Deng,et al.  Diagnostic and dynamical analyses of two outstanding aspects of storm tracks , 2007 .

[51]  Gwendal Rivière,et al.  Characteristics of the Atlantic Storm-Track Eddy Activity and Its Relation with the North Atlantic Oscillation , 2005 .

[52]  Chris Wiggins,et al.  ARACNE: An Algorithm for the Reconstruction of Gene Regulatory Networks in a Mammalian Cellular Context , 2004, BMC Bioinformatics.

[53]  Judea Pearl,et al.  Equivalence and Synthesis of Causal Models , 1990, UAI.

[54]  Clark Glymour,et al.  Search for Additive Nonlinear Time Series Causal Models , 2008, J. Mach. Learn. Res..

[55]  Yi Deng,et al.  An Idealized Model Study Relevant to the Dynamics of the Midwinter Minimum of the Pacific Storm Track , 2005 .

[56]  Tom Burr,et al.  Causation, Prediction, and Search , 2003, Technometrics.

[57]  Jayanta K. Ghosh,et al.  Bayesian Networks and Decision Graphs, 2nd Edition by Finn V. Jensen, Thomas D. Nielsen , 2008 .

[58]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[59]  P. Spirtes,et al.  An Algorithm for Fast Recovery of Sparse Causal Graphs , 1991 .

[60]  Sukyoung Lee,et al.  Synoptic View of the North Atlantic Oscillation , 2004 .

[61]  José Manuel Gutiérrez,et al.  Bayesian Networks for Probabilistic Weather Prediction , 2002, ECAI.

[62]  Dennis L. Hartmann,et al.  Different ENSO teleconnections and their effects on the stratospheric polar vortex , 2008 .

[63]  A. Tsonis,et al.  Topology and predictability of El Niño and La Niña networks. , 2008, Physical review letters.

[64]  Richard E. Neapolitan,et al.  Learning Bayesian networks , 2007, KDD '07.

[65]  Paul J. Roebber,et al.  The architecture of the climate network , 2004 .

[66]  Yi Deng,et al.  Intraseasonal Modulation of the North Pacific Storm Track by Tropical Convection in Boreal Winter , 2011 .

[67]  Yi Deng,et al.  Nature of the Differences in the Intraseasonal Variability of the Pacific and Atlantic Storm Tracks: A Diagnostic Study , 2005 .