Bayesian Probabilities for Constraint-Based Causal Discovery

We target the problem of accuracy and robustness in causal inference from finite data sets. Our aim is to combine the inherent robustness of the Bayesian approach with the theoretical strength and clarity of constraint-based methods. We use a Bayesian score to obtain probability estimates on the input statements used in a constraint-based procedure. These are subsequently processed in decreasing order of reliability, letting more reliable decisions take precedence in case of conflicts, until a single output model is obtained. Tests show that a basic implementation of the resulting Bayesian Constraint-based Causal Discovery (BCCD) algorithm already outperforms established procedures such as FCI and Conservative PC. It indicates which causal decisions in the output have high reliability and which do not. The approach is easily adapted to other application areas such as complex independence tests.

[1]  Jiji Zhang,et al.  Detection of Unfaithfulness and Robust Causal Inference , 2008, Minds and Machines.

[2]  Franz von Kutschera,et al.  Causation , 1993, J. Philos. Log..

[3]  David Maxwell Chickering,et al.  Learning Bayesian Networks: The Combination of Knowledge and Statistical Data , 1994, Machine Learning.

[4]  Tom Heskes,et al.  A Logical Characterization of Constraint-Based Causal Discovery , 2011, UAI.

[5]  Dimitris Margaritis,et al.  EFFICIENT MARKOV NETWORK DISCOVERY USING PARTICLE FILTERS , 2009, Comput. Intell..

[6]  Judea Pearl,et al.  A Theory of Inferred Causation , 1991, KR.

[7]  Tom Burr,et al.  Causation, Prediction, and Search , 2003, Technometrics.

[8]  F. Chung,et al.  Connected Components in Random Graphs with Given Expected Degree Sequences , 2002 .

[9]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[10]  Peter Bühlmann,et al.  Causal Inference Using Graphical Models with the R Package pcalg , 2012 .

[11]  Tom Heskes,et al.  A Bayesian Approach to Constraint Based Causal Inference , 2012, UAI.

[12]  Thomas S. Richardson,et al.  Maximum likelihood fitting of acyclic directed mixed graphs to binary data , 2010, UAI.

[13]  Jiji Zhang,et al.  On the completeness of orientation rules for causal discovery in the presence of latent confounders and selection bias , 2008, Artif. Intell..

[14]  G. Melançon,et al.  Random generation of dags for graph drawing , 2000 .

[15]  R. Bouckaert.  Bayesian belief networks : from construction to inference , 1995 .

[16]  Richard E. Neapolitan,et al.  Learning Bayesian networks , 2007, KDD '07.

[17]  P. Spirtes,et al.  Ancestral graph Markov models , 2002 .

[18]  D. Heckerman,et al.  A Bayesian Approach to Causal Discovery , 2006 .

[19]  Peter Spirtes,et al.  Introduction to Causal Inference , 2010, J. Mach. Learn. Res..

[20]  Jiji Zhang,et al.  Adjacency-Faithfulness and Conservative Causal Inference , 2006, UAI.

[21]  Zoubin Ghahramani,et al.  The Hidden Life of Latent Variables: Bayesian Learning with Mixed Graph Models , 2009, J. Mach. Learn. Res..

[22]  David Maxwell Chickering,et al.  Optimal Structure Identification With Greedy Search , 2002, J. Mach. Learn. Res..

[23]  J. Pearl.  Causality: Models, Reasoning and Inference , 2000 .