Reparametrization Invariance in non-parametric Causal Discovery

Causal discovery estimates the underlying physical process that generates the observed data: does X cause Y or does Y cause X? Current methodologies use structural conditions to turn the causal query into a statistical query, when only observational data is available. But what if these statistical queries are sensitive to causal invariants? This study investigates one such invariant: the causal relationship between X and Y is invariant to the marginal distributions of X and Y. We propose an algorithm that uses a non-parametric estimator that is robust to changes in the marginal distributions. This way we may marginalize the marginals, and inspect what relationship is intrinsically there. The resulting causal estimator is competitive with current methodologies and has high emphasis on the uncertainty in the causal query; an aspect just as important as the query itself.

[1]  Aapo Hyvärinen,et al.  A Linear Non-Gaussian Acyclic Model for Causal Discovery , 2006, J. Mach. Learn. Res..

[2]  Bernhard Schölkopf,et al.  Inferring deterministic causal relations , 2010, UAI.

[3]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[4]  L. Shepp Probability Essentials , 2002 .

[5]  Neil D. Lawrence,et al.  Probabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models , 2005, J. Mach. Learn. Res..

[6]  Bernhard Schölkopf,et al.  Measuring Statistical Dependence with Hilbert-Schmidt Norms , 2005, ALT.

[7]  Bernhard Schölkopf,et al.  Nonlinear causal discovery with additive noise models , 2008, NIPS.

[8]  R. Durrett Stochastic Calculus: A Practical Introduction , 1996 .

[9]  Bernhard Schölkopf,et al.  Ranking on Data Manifolds , 2003, NIPS.

[10]  Bernhard Schölkopf,et al.  Distinguishing Cause from Effect Using Observational Data: Methods and Benchmarks , 2014, J. Mach. Learn. Res..

[11]  Bernhard Schölkopf,et al.  Information-geometric approach to inferring causal directions , 2012, Artif. Intell..

[12]  Aapo Hyvärinen,et al.  Distinguishing causes from effects using nonlinear acyclic causal models , 2008, NIPS 2010.

[13]  Bernhard Schölkopf,et al.  Inference of Cause and Effect with Unsupervised Inverse Regression , 2015, AISTATS.

[14]  Bernhard Schölkopf,et al.  Cause-Effect Inference by Comparing Regression Errors , 2018, AISTATS.

[15]  P. Hall,et al.  Asymptotically optimal difference-based estimation of variance in nonparametric regression , 1990 .

[16]  Bernhard Schölkopf,et al.  Probabilistic latent variable models for distinguishing between cause and effect , 2010, NIPS.

[17]  J. Marron,et al.  On variance estimation in nonparametric regression , 1990 .

[18]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .