A Novel Hybrid Evolutionary Algorithm for Learning Bayesian Networks from Incomplete Data

Existing Structural Expectation-Maximization (EM) algorithms for learning Bayesian networks from incomplete data usually adopt the greedy hill climbing search method, which may make the algorithms find sub-optimal solutions. In this paper, we present a new Structural EM algorithm which employs a hybrid evolutionary algorithm as the search method. The experimental results on the data sets generated from several benchmark networks illustrate that our algorithm outperforms some state-of-the-art learning algorithms.

[1]  Kathryn B. Laskey,et al.  Learning Bayesian networks from incomplete data using evolutionary algorithms , 1999 .

[2]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[3]  David Maxwell Chickering,et al.  Learning Equivalence Classes of Bayesian Network Structures , 1996, UAI.

[4]  Wai Lam,et al.  LEARNING BAYESIAN BELIEF NETWORKS: AN APPROACH BASED ON THE MDL PRINCIPLE , 1994, Comput. Intell..

[5]  Kwong-Sak Leung,et al.  An efficient data mining method for learning Bayesian networks using an evolutionary algorithm-based hybrid approach , 2004, IEEE Transactions on Evolutionary Computation.

[6]  Paola Sebastiani,et al.  The Use of Exogenous Knowledge to Learn Bayesian Networks from Incomplete Databases , 1997, IDA.

[7]  S. Lauritzen.  The EM algorithm for graphical association models with missing data , 1995 .

[8]  Pedro Larrañaga,et al.  An improved Bayesian structural EM algorithm for learning Bayesian networks for clustering , 2000, Pattern Recognit. Lett..

[9]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[10]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[11]  Paola Sebastiani,et al.  Parameter Estimation in Bayesian Networks from Incomplete Databases , 1998, Intell. Data Anal..

[12]  Nir Friedman,et al.  The Bayesian Structural EM Algorithm , 1998, UAI.

[13]  Adnan Darwiche,et al.  Inference in belief networks: A procedural guide , 1996, Int. J. Approx. Reason..

[14]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1999, Innovations in Bayesian Networks.

[15]  Pedro Larrañaga,et al.  Learning Recursive Bayesian Multinets for Data Clustering by Means of Constructive Induction , 2002, Machine Learning.

[16]  Nir Friedman,et al.  Learning Belief Networks in the Presence of Missing Values and Hidden Variables , 1997, ICML.