Particle swarm optimization based method for Bayesian Network structure learning

Bayesian Networks (BNs) are good tools for representing knowledge and reasoning under conditions of uncertainty. In general, learning Bayesian Network structure from a data-set is considered a NP-hard problem, due to the search space complexity. A novel structure-learning method, based on PSO (Particle Swarm Optimization) and the K2 algorithm, is presented in this paper. To learn the structure of a bayesian network, PSO here is used for searching in the space of orderings. Then the fitness of each ordering is calculated by running the K2 algorithm and returning the score of the network consistent with it. The experimental results demonstrate that our approach produces better performance compared to others BN structure learning algorithms.

[1]  Julie Cowie,et al.  Particle Swarm Optimisation for learning Bayesian Networks , 2007, World Congress on Engineering.

[2]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[3]  Paulo Cesar G. da Costa,et al.  Uncertainty Representation and Reasoning in Complex Systems , 2009, Complex Systems in Knowledge-based Environments.

[4]  Pedro Larrañaga,et al.  Structure Learning of Bayesian Networks by Hybrid Genetic Algorithms , 1995, AISTATS.

[5]  Jose Miguel Puerta,et al.  Ant colony optimization for learning Bayesian networks , 2002, Int. J. Approx. Reason..

[6]  William H. Hsu,et al.  A Permutation Genetic Algorithm For Variable Ordering In Learning Bayesian Networks From Data , 2002, GECCO.

[7]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[8]  Kevin Murphy,et al.  A brief introduction to graphical models and bayesian networks , 1998 .

[9]  Guoliang Xue,et al.  Applying two-level simulated annealing on Bayesian structure learning to infer genetic networks , 2004 .

[10]  Wai Lam,et al.  LEARNING BAYESIAN BELIEF NETWORKS: AN APPROACH BASED ON THE MDL PRINCIPLE , 1994, Comput. Intell..

[11]  Gregory F. Cooper,et al.  The ALARM Monitoring System: A Case Study with two Probabilistic Inference Techniques for Belief Networks , 1989, AIME.

[12]  Franz von Kutschera,et al.  Causation , 1993, J. Philos. Log..

[13]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[14]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[15]  Xiao-Lin Li.  A Particle Swarm Optimization and Immune Theory-Based Algorithm for Structure Learning of Bayesian Networks , 2010 .

[16]  Constantin F. Aliferis,et al.  The max-min hill-climbing Bayesian network structure learning algorithm , 2006, Machine Learning.

[17]  A. Hasman,et al.  Probabilistic reasoning in intelligent systems: Networks of plausible inference , 1991 .

[18]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[19]  W. Marsden.  I and J , 2012 .

[20]  Gregory F. Cooper,et al.  A Bayesian Method for the Induction of Probabilistic Networks from Data , 1992 .

[21]  Judea Pearl,et al.  A Theory of Inferred Causation , 1991, KR.

[22]  Luis M. de Campos,et al.  A new approach for learning belief networks using independence criteria , 2000, Int. J. Approx. Reason..