Learning Bayesian network structure using Markov blanket decomposition

Causal structure learning algorithms construct Bayesian networks from observational data. Using non-interventional data, existing constraint-based algorithms may return I-equivalent partially directed acyclic graphs. However, these algorithms do not fully exploit the graphical properties of Bayesian networks, and require many redundant tests that reduce both speed and accuracy. In this paper, we introduce ideas to exploit such properties to increase the speed and accuracy of causal structure learning for multivariate normal data. In numerical experiments on five benchmarking networks our proposed algorithm was faster and more accurate than recently-developed algorithms.

[1]  P. Spirtes,et al.  Causation, Prediction, and Search, 2nd Edition , 2001 .

[2]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1999, Innovations in Bayesian Networks.

[3]  Aapo Hyvärinen,et al.  A Linear Non-Gaussian Acyclic Model for Causal Discovery , 2006, J. Mach. Learn. Res..

[4]  Patrik O. Hoyer,et al.  Discovering Cyclic Causal Models by Independent Components Analysis , 2008, UAI.

[5]  Nir Friedman,et al.  Probabilistic Graphical Models: Principles and Techniques - Adaptive Computation and Machine Learning , 2009 .

[6]  Judea Pearl,et al.  Equivalence and Synthesis of Causal Models , 1990, UAI.

[7]  Sebastian Thrun,et al.  Bayesian Network Induction via Local Neighborhoods , 1999, NIPS.

[8]  Christopher Meek,et al.  Causal inference and causal explanation with background knowledge , 1995, UAI.

[9]  P. Spirtes,et al.  Causation, prediction, and search , 1993 .

[10]  Mathias Drton,et al.  A SINful approach to Gaussian graphical model selection , 2005 .

[11]  Ron Kohavi,et al.  Irrelevant Features and the Subset Selection Problem , 1994, ICML.

[12]  Judea Pearl,et al.  A Theory of Inferred Causation , 1991, KR.

[13]  Constantin F. Aliferis,et al.  Towards Principled Feature Selection: Relevancy, Filters and Wrappers , 2003 .

[14]  Chi-Hyuck Jun,et al.  A causal discovery algorithm using multiple regressions , 2010, Pattern Recognit. Lett..

[15]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[16]  R Scheines,et al.  The TETRAD Project: Constraint Based Aids to Causal Model Specification. , 1998, Multivariate behavioral research.

[17]  Dimitris Margaritis,et al.  Distribution-Free Learning of Bayesian Network Structure in Continuous Domains , 2005, AAAI.

[18]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[19]  Michael P. Wellman,et al.  Real-world applications of Bayesian networks , 1995, CACM.

[20]  A. Philip Dawid,et al.  Beware of the DAG! , 2008, NIPS Causality: Objectives and Assessment.

[21]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[22]  André Elisseeff,et al.  Using Markov Blankets for Causal Structure Learning , 2008, J. Mach. Learn. Res..