Learning causal graphs of nonlinear structural vector autoregressive model using information theory criteria

Detection and clarification of cause-effect relationships among variables is an important problem in time series analysis. Traditional causality inference methods have a salient limitation that the model must be linear and with Gaussian noise. Although additive model regression can effectively infer the nonlinear causal relationships of additive nonlinear time series, it suffers from the limitation that contemporaneous causal relationships of variables must be linear and not always valid to test conditional independence relations. This paper provides a nonparametric method that employs both mutual information and conditional mutual information to identify causal structure of a class of nonlinear time series models, which extends the additive nonlinear times series to nonlinear structural vector autoregressive models. An algorithm is developed to learn the contemporaneous and the lagged causal relationships of variables. Simulations demonstrate the effectiveness of the proposed method.

[1]  Carsten O. Daub,et al.  Estimating mutual information using B-spline functions – an improved similarity measure for analysing gene expression data , 2004, BMC Bioinformatics.

[2]  Michael I. Jordan,et al.  Learning graphical models for stationary time series , 2004, IEEE Transactions on Signal Processing.

[3]  Qiang Zhao,et al.  Decomposition of structural learning about directed acyclic graphs , 2006, Artif. Intell..

[4]  Alessio Moneta,et al.  Graphical causal models and VARs: an empirical assessment of the real business cycles hypothesis , 2008 .

[5]  Kevin D. Hoover AUTOMATIC INFERENCE OF THE CONTEMPORANEOUS CAUSAL ORDER OF A SYSTEM OF EQUATIONS , 2005, Econometric Theory.

[6]  K. Hoover,et al.  Searching for the Causal Structure of a Vector Autoregression , 2003 .

[7]  P. Hall,et al.  On the estimation of entropy , 1993 .

[8]  J. N. R. Jeffers,et al.  Graphical Models in Applied Multivariate Statistics. , 1990 .

[9]  Clark Glymour,et al.  Search for Additive Nonlinear Time Series Causal Models , 2008, J. Mach. Learn. Res..

[10]  Eckehard Olbrich,et al.  Inferring chaotic dynamics from time-series: On which length scale determinism becomes visible , 1997 .

[11]  M. Eichler Granger causality and path diagrams for multivariate time series , 2007 .

[12]  M. N. Goria,et al.  A new class of random vector entropy estimators and its applications in testing statistical hypotheses , 2005 .

[13]  P. Spirtes,et al.  Causation, prediction, and search , 1993 .

[14]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[15]  Bogdan Savchynskyy,et al.  Discriminative Learning of Max-Sum Classifiers , 2008, J. Mach. Learn. Res..

[16]  P. Spirtes,et al.  An Algorithm for Fast Recovery of Sparse Causal Graphs , 1991 .

[17]  Les Oxley,et al.  Constructing structural VAR models with conditional independence graphs , 2009, Math. Comput. Simul..

[18]  H. Kantz,et al.  Analysing the information flow between financial time series , 2002 .

[19]  P. Grassberger,et al.  Estimation of the Kolmogorov entropy from a chaotic signal , 1983 .

[20]  James Theiler,et al.  Generalized redundancies for time series analysis , 1995 .

[21]  Marek J. Druzdzel,et al.  Insensitivity of Constraint-Based Causal Discovery Algorithms to Violations of the Assumption of Multivariate Normality , 2008, FLAIRS Conference.