A new genetic approach for structure learning of Bayesian networks: Matrix genetic algorithm

In this paper, a novel method for structure learning of a Bayesian network (BN) is developed. A new genetic approach called the matrix genetic algorithm (MGA) is proposed. In this method, an individual structure is represented as a matrix chromosome and each matrix chromosome is encoded as concatenation of upper and lower triangular parts. The two triangular parts denote the connection in the BN structure. Further, new genetic operators are developed to implement the MGA. The genetic operators are closed in the set of the directed acyclic graph (DAG). Finally, the proposed scheme is applied to real world and benchmark applications, and its effectiveness is demonstrated through computer simulation.

[1]  Euntai Kim,et al.  Structure Learning of Bayesian Networks Using Dual Genetic Algorithm , 2008, IEICE Trans. Inf. Syst..

[2]  Nicandro Cruz-Ramírez,et al.  A Method Based on Genetic Algorithms and Fuzzy Logic to Induce Bayesian Networks , 2004, ENC.

[3]  Gregory M. Provan,et al.  Learning Bayesian Networks Using Feature Selection , 1995, AISTATS.

[4]  José A. Gámez,et al.  Partial abductive inference in Bayesian belief networks - an evolutionary computation approach by using problem-specific genetic operators , 2002, IEEE Trans. Evol. Comput..

[5]  David Heckerman,et al.  Learning Bayesian Networks: Search Methods and Experimental Results , 1995 .

[6]  Wooyong Chung,et al.  Context-aware application for smart home based on Bayesian network , 2007 .

[7]  Byoung-Tak Zhang,et al.  Bayesian model averaging of Bayesian network classifiers over multiple node-orders: application to sparse datasets , 2005, IEEE Trans. Syst. Man Cybern. Part B.

[8]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[9]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[10]  Sachin Shetty,et al.  Structure learning of Bayesian networks using a semantic genetic algorithm-based approach , 2005, ITRE 2005. 3rd International Conference on Information Technology: Research and Education, 2005..

[11]  Xiao-Lin Li,et al.  Learning Bayesian networks structures from incomplete data based on extending evolutionary programming , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[12]  Pedro Larrañaga,et al.  Learning Bayesian network structures by searching for the best ordering with genetic algorithms , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[13]  Shao-Zhong Zhang,et al.  An improved EM algorithm for Bayesian networks parameter learning , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[14]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[15]  Luis M. de Campos,et al.  Learning with CASTLE , 1991, ECSQARU.

[16]  Gregory F. Cooper,et al.  The ALARM Monitoring System: A Case Study with two Probabilistic Inference Techniques for Belief Networks , 1989, AIME.

[17]  Finn Verner Jensen,et al.  Introduction to Bayesian Networks , 2008, Innovations in Bayesian Networks.

[18]  Tapio Seppänen,et al.  Bayesian approach to sensor-based context awareness , 2003, Personal and Ubiquitous Computing.

[19]  Haiqin Wang,et al.  A method for evaluating elicitation schemes for probabilistic models , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[20]  Pedro Larrañaga,et al.  Structure Learning of Bayesian Networks by Genetic Algorithms: A Performance Analysis of Control Parameters , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 2000, Springer Berlin Heidelberg.

[22]  Kwong-Sak Leung,et al.  An efficient data mining method for learning Bayesian networks using an evolutionary algorithm-based hybrid approach , 2004, IEEE Transactions on Evolutionary Computation.