Testing whether linear equations are causal: A free probability theory approach

We propose a method that infers whether linear relations between two high-dimensional variables X and Y are due to a causal influence from X to Y or from Y to X. The earlier proposed so-called Trace Method is extended to the regime where the dimension of the observed variables exceeds the sample size. Based on previous work, we postulate conditions that characterize a causal relation between X and Y. Moreover, we describe a statistical test and argue that both causal directions are typically rejected if there is a common cause. A full theoretical analysis is presented for the deterministic case but our approach seems to be valid for the noisy case, too, for which we additionally present an approach based on a sparsity constraint. The discussed method yields promising results for both simulated and real world data.

[1]  Y. Kano,et al.  Causal Inference Using Nonnormality , 2004 .

[2]  O. Johnson Free Random Variables , 2004 .

[3]  J. Lemeire,et al.  Causal Models as Minimal Descriptions of Multivariate Systems , 2006 .

[4]  Bernhard Schölkopf,et al.  Telling cause from effect based on high-dimensional observations , 2009, ICML.

[5]  Nir Friedman,et al.  Gaussian Process Networks , 2000, UAI.

[6]  Tom Burr,et al.  Causation, Prediction, and Search , 2003, Technometrics.

[7]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[8]  Roland Speicher,et al.  FREE PROBABILITY THEORY AND NON-CROSSING PARTITIONS , 1997 .

[9]  Bernhard Schölkopf,et al.  Causal Inference Using the Algorithmic Markov Condition , 2008, IEEE Transactions on Information Theory.

[10]  Bernhard Schölkopf,et al.  Probabilistic latent variable models for distinguishing between cause and effect , 2010, NIPS.

[11]  Bernhard Schölkopf,et al.  Nonlinear causal discovery with additive noise models , 2008, NIPS.

[12]  R. Speicher Free Probability Theory , 1996, Oberwolfach Reports.

[13]  Michel Loève,et al.  Probability Theory I , 1977 .

[14]  R. Reynolds,et al.  The NCEP/NCAR 40-Year Reanalysis Project , 1996, Renewable Energy.

[15]  Bernhard Schölkopf,et al.  Inferring deterministic causal relations , 2010, UAI.

[16]  G. Stewart The Efficient Generation of Random Orthogonal Matrices with an Application to Condition Estimators , 1980 .

[17]  Jianqing Fan,et al.  Sure independence screening for ultrahigh dimensional feature space , 2006, math/0612857.

[18]  Bernhard Schölkopf,et al.  Causal Inference by Choosing Graphs with Most Plausible Markov Kernels , 2006, AI&M.