A new approach for learning belief networks using independence criteria

In the paper we describe a new independence-based approach for learning Belief Networks. The proposed algorithm avoids some of the drawbacks of this approach by making an intensive use of low order conditional independence tests. Particularly, the set of zero- and first-order independence statements are used in order to obtain a prior skeleton of the network, and also to fix and remove arrows from this skeleton. Then, a refinement procedure, based on minimum cardinality d-separating sets, which uses a small number of conditional independence tests of higher order, is carried out to produce the final graph. Our algorithm needs an ordering of the variables in the model as the input. An algorithm that partially overcomes this problem is also presented. ” 2000

[1]  Michael P. Wellman,et al.  Real-world applications of Bayesian networks , 1995, CACM.

[2]  J. Huete,et al.  On the use of independence relationships for learning simplified belief networks , 1997 .

[3]  Gregory F. Cooper,et al.  An Entropy-driven System for Construction of Probabilistic Expert Systems from Databases , 1990, UAI.

[4]  S. Kullback,et al.  Information Theory and Statistics , 1959 .

[5]  Pedro Larrañaga,et al.  Learning Bayesian network structures by searching for the best ordering with genetic algorithms , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[6]  P. Spirtes,et al.  An Algorithm for Fast Recovery of Sparse Causal Graphs , 1991 .

[7]  Luis M. de Campos,et al.  Independency relationships and learning algorithms for singly connected networks , 1998, J. Exp. Theor. Artif. Intell..

[8]  Alice M. Agogino,et al.  Automated Construction of Sparse Bayesian Networks from Unstructured Probabilistic Models and Domain Information , 2013, UAI.

[9]  Wai Lam,et al.  Using Causal Information and Local Measures to Learn Bayesian Networks , 1993, UAI.

[10]  Solomon Kullback,et al.  Information Theory and Statistics , 1970, The Mathematical Gazette.

[11]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[12]  David Maxwell Chickering,et al.  Learning Bayesian Networks is NP-Complete , 2016, AISTATS.

[13]  Edward H. Herskovits,et al.  Computer-based probabilistic-network construction , 1992 .

[14]  Moninder Singh,et al.  Construction of Bayesian network structures from data: A brief survey and an efficient algorithm , 1995, Int. J. Approx. Reason..

[15]  Judea Pearl,et al.  Causal networks: semantics and expressiveness , 2013, UAI.

[16]  Franz von Kutschera,et al.  Causation , 1993, J. Philos. Log..

[17]  David Haussler,et al.  Decision Theoretic Generalizations of the PAC Model for Neural Net and Other Learning Applications , 1992, Inf. Comput..

[18]  J. Pearl,et al.  Learning simple causal structures , 1993 .

[19]  Stuart L. Crawford,et al.  Constructor: A System for the Induction of Probabilistic Models , 1990, AAAI.

[20]  David J. Spiegelhalter,et al.  Bayesian analysis in expert systems , 1993 .

[21]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[22]  Remco R. Bouckaert,et al.  Optimizing Causal Orderings for Generating DAGs from Data , 1992, UAI.

[23]  Gregory F. Cooper,et al.  The ALARM Monitoring System: A Case Study with two Probabilistic Inference Techniques for Belief Networks , 1989, AIME.

[24]  P. Spirtes,et al.  Causation, prediction, and search , 1993 .

[25]  Wray L. Buntine.  A Guide to the Literature on Learning Probabilistic Networks from Data , 1996, IEEE Trans. Knowl. Data Eng..

[26]  E. H. Mamdani,et al.  Real-World Applications of Bayesian Networks - Introduction. , 1995 .

[27]  Luis M. de Campos,et al.  Aproximación de una ordenación de variables en Redes Causales mediante Algoritmos Genéticos , 1997, Inteligencia Artif..

[28]  Luis M. de Campos,et al.  On the use of independence relationships for learning simplified belief networks , 1997, Int. J. Intell. Syst..

[29]  Gregory F. Cooper,et al.  A Bayesian Method for the Induction of Probabilistic Networks from Data , 1992 .

[30]  Judea Pearl,et al.  A Theory of Inferred Causation , 1991, KR.

[31]  Luis M. de Campos,et al.  An Algorithm for Finding Minimum d-Separating Sets in Belief Networks , 1996, UAI.

[32]  Christopher Meek,et al.  Learning Bayesian Networks with Discrete Variables from Data , 1995, KDD.