An Algorithm for the Construction of Bayesian Network Structures from Data

Previous algorithms for the construction of Bayesian belief network structures from data have been either highly dependent on conditional independence (CI) tests, or have required an ordering on the nodes to be supplied by the user. We present an algorithm that integrates these two approaches - CI tests are used to generate an ordering on the nodes from the database which is then used to recover the underlying Bayesian network structure using a non CI based method. Results of preliminary evaluation of the algorithm on two networks (ALARM and LED) are presented. We also discuss some algorithm performance issues and open problems.

[1]  Kevin T. Kelly,et al.  Discovering Causal Structure. , 1989 .

[2]  P. Spirtes,et al.  An Algorithm for Fast Recovery of Sparse Causal Graphs , 1991 .

[3]  N. Wermuth,et al.  Graphical Models for Associations between Variables, some of which are Qualitative and some Quantitative , 1989 .

[4]  Erik Sandewall,et al.  Principles of knowledge representation and reasoning: proceedings of the second International Conference (KR91) , 1991 .

[5]  P. Spirtes,et al.  Causality From Probability , 1989 .

[6]  Edward H. Herskovits,et al.  Computer-based probabilistic-network construction , 1992 .

[7]  Judea Pearl,et al.  When can association graphs admit a causal interpretation , 1994 .

[8]  Ross D. Shachter.  A Graph-Based Inference Method for Conditional Independence , 1991, UAI.

[9]  Judea Pearl,et al.  An Algorithm for Deciding if a Set of Observed Independencies Has a Causal Explanation , 1992, UAI.

[10]  Gregory F. Cooper,et al.  The ALARM Monitoring System: A Case Study with two Probabilistic Inference Techniques for Belief Networks , 1989, AIME.

[11]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .

[12]  Marco Valtorta,et al.  A Parallel Constructor of Markov Networks , 1994 .

[13]  David Heckerman,et al.  Advances in Probabilistic Reasoning , 1994, Conference on Uncertainty in Artificial Intelligence.

[14]  Judea Pearl,et al.  A Theory of Inferred Causation , 1991, KR.

[15]  Stuart L. Crawford,et al.  Constructor: A System for the Induction of Probabilistic Models , 1990, AAAI.

[16]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[17]  Douglas W. Nychka,et al.  Discovering Causal Structure , 1989 .