Temporal Causal Inference with Time Lag

Accurate causal inference among time series helps to better understand the interactive scheme behind the temporal variables. For time series analysis, an unavoidable issue is the existence of time lag among different temporal variables. That is, past evidence would take some time to cause a future effect instead of an immediate response. To model this process, existing approaches commonly adopt a prefixed time window to define the lag. However, in many real-world applications, this parameter may vary among different time series, and it is hard to be predefined with a fixed value. In this letter, we propose to learn the causal relations as well as the lag among different time series simultaneously from data. Specifically, we develop a probabilistic decomposed slab-and-spike (DSS) model to perform the inference by applying a pair of decomposed spike-and-slab variables for the model coefficients, where the first variable is used to estimate the causal relationship and the second one captures the lag information among different temporal variables. For parameter inference, we propose an efficient expectation propagation (EP) algorithm to solve the DSS model. Experimental results conducted on both synthetic and real-world problems demonstrate the effectiveness of the proposed method. The revealed time lag can be well validated by the domain knowledge within the real-world applications.

[1]  Amit Dhurandhar Learning Maximum Lag for Grouped Graphical Granger Models , 2010, 2010 IEEE International Conference on Data Mining Workshops.

[2]  Yan Liu,et al.  Granger Causality for Time-Series Anomaly Detection , 2012, 2012 IEEE 12th International Conference on Data Mining.

[3]  Yan Liu,et al.  FBLG: a simple and effective approach for temporal dependence discovery from time series data , 2014, KDD.

[4]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[5]  D. Hernández-Lobato Prediction based on averages over automatically induced learners: ensemble methods and Bayesian techniques , 2009 .

[6]  P. Gilbert Combining var estimation and state space model reduction for simple good predictions , 1995 .

[7]  Yan Liu,et al.  Temporal causal modeling with graphical granger methods , 2007, KDD '07.

[8]  Michael P. H. Stumpf,et al.  Statistical inference of the time-varying structure of gene-regulation networks , 2010, BMC Systems Biology.

[9]  Honglak Lee,et al.  Efficient L1 Regularized Logistic Regression , 2006, AAAI.

[10]  Kaigui Bian,et al.  Mining Dependencies Considering Time Lag in Spatio-Temporal Traffic Data , 2015, WAIM.

[11]  G. Carter,et al.  The generalized correlation method for estimation of time delay , 1976 .

[12]  Yan Liu,et al.  Learning dynamic temporal graphs for oil-production equipment monitoring system , 2009, KDD.

[13]  Mathias Drton,et al.  A SINful approach to Gaussian graphical model selection , 2005 .

[14]  Lei Han,et al.  Overlapping decomposition for causal graphical modeling , 2012, KDD.

[15]  Daniel Hernández-Lobato,et al.  Expectation propagation in linear regression models with spike-and-slab priors , 2015, Machine Learning.

[16]  Daniel Hernández Lobato Prediction based on averages over automatically induced learners ensemble methods and Bayesian techniques , 2009 .

[17]  Abdulnasser Hatemi-J,et al.  Multivariate tests for autocorrelation in the stable and unstable VAR models , 2004 .

[18]  Xi Chen,et al.  Learning Spatial-Temporal Varying Graphs with Applications to Climate Data Analysis , 2010, AAAI.

[19]  Yan Liu,et al.  Granger Causality Analysis in Irregular Time Series , 2012, SDM.

[20]  Yan Liu,et al.  Learning Temporal Causal Graphs for Relational Time-Series Analysis , 2010, ICML.

[21]  Daniel Hernández-Lobato,et al.  Generalized spike-and-slab priors for Bayesian group feature selection using expectation propagation , 2013, J. Mach. Learn. Res..

[22]  Hugh Chipman,et al.  Bayesian variable selection with related predictors , 1995, bayes-an/9510001.

[23]  Anna Goldenberg,et al.  Tractable learning of large Bayes net structures from sparse data , 2004, ICML.

[24]  J. Seinfeld,et al.  Atmospheric Chemistry and Physics: From Air Pollution to Climate Change , 1997 .

[25]  Nir Friedman,et al.  Inferring Cellular Networks Using Probabilistic Graphical Models , 2004, Science.

[26]  Yan Liu,et al.  Temporal Graphical Models for Cross-Species Gene Regulatory Network Discovery , 2011, J. Bioinform. Comput. Biol..

[27]  T. Wilbanks,et al.  Contribution of Working Group II to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change , 2007 .

[28]  Eric P. Xing,et al.  Fast structure learning in generalized stochastic processes with latent factors , 2013, KDD.