A New Polynomial Time Algorithm for Bayesian Network Structure Learning

We propose a new algorithm called SCD for learning the structure of a Bayesian network. The algorithm is a kind of constraint-based algorithm. By taking advantage of variable ordering, it only requires polynomial time conditional independence tests and learns the exact structure theoretically. A variant which adopts the Bayesian Dirichlet scoring function is also presented for practical purposes. The performance of the algorithms are analyzed in several aspects and compared with other existing algorithms. In addition, we define a new evaluation metric named EP power which measures the proportion of errors caused by previously made mistakes in the learning sequence, and use the metric for verifying the robustness of the proposed algorithms.

[1]  Judea Pearl,et al.  Fusion, Propagation, and Structuring in Belief Networks , 1986, Artif. Intell..

[2]  Gregory F. Cooper,et al.  A Bayesian Method for the Induction of Probabilistic Networks from Data , 1992 .

[3]  Judea Pearl,et al.  A Theory of Inferred Causation , 1991, KR.

[4]  David Heckerman,et al.  Learning With Bayesian Networks (Abstract) , 1995, ICML.

[5]  Fabio Gagliardi Cozman,et al.  Generating Random Bayesian Networks with Constraints on Induced Width , 2004, ECAI.

[6]  Gregory F. Cooper,et al.  The ALARM Monitoring System: A Case Study with two Probabilistic Inference Techniques for Belief Networks , 1989, AIME.

[7]  M. Roulston Estimating the errors on measured entropy and mutual information , 1999 .

[8]  Richard Scheines,et al.  Constructing Bayesian Network Models of Gene Expression Networks from Microarray Data , 2000 .

[9]  Harald Steck,et al.  Constraint-based structural learning in Bayesian networks using finite data sets , 2001 .

[10]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[11]  P. Spirtes,et al.  Causation, prediction, and search , 1993 .

[12]  David A. Bell,et al.  Learning Bayesian networks from data: An information-theory based approach , 2002, Artif. Intell..

[13]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .

[14]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1999, Innovations in Bayesian Networks.

[15]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[16]  William H. Hsu,et al.  Genetic wrappers for feature selection in decision tree induction and variable ordering in Bayesian network structure learning , 2004, Inf. Sci..