Distributed Particle Swarm Optimization for Structural Bayesian Network Learning

Particle Swarm Optimization (PSO) was first introduced as a concept for a non-linear optimizer by Kennedy and Eberhart in 1995. Their seminal work articulates a technique of evolutionary computation, which has its origin in artificial intelligence and simplified social models such as bird flocking and fish schooling (Kennedy & Eberhart, Nov. 1995; Kennedy & Eberhart, Oct. 1995). Its early appeal lay in its use of only primitive mathematical operators and computational economy with regard to both memory and speed. The authors were influenced by the work of Reynolds, Heppner and Grenander in modeling bird flocking and recognized that the fundamental hypothesis to the development of PSO is that an evolutionary advantage is obtained by the social sharing of information among members of the same species. They stated that the simulation of the graceful but unpredictable choreography of a bird flock by collision-proof agents could be used as an effective optimizer for a wide range of functions.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[3]  Paola Sebastiani,et al.  Bayesian Inference with Missing Data Using Bound and Collapse , 2000 .

[4]  S.L. Ho,et al.  A particle swarm optimization method with enhanced global search ability for design optimizations of electromagnetic devices , 2006, IEEE Transactions on Magnetics.

[5]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[6]  M. El-Hawary,et al.  Enhancing the particle swarm optimizer via proper parameters selection , 2002, IEEE CCECE2002. Canadian Conference on Electrical and Computer Engineering. Conference Proceedings (Cat. No.02CH37373).

[7]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[8]  Luciano Blasi,et al.  Particle Swarm Approach in Finding Optimum Aircraft Configuration , 2007 .

[9]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1999, Innovations in Bayesian Networks.

[10]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[11]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[12]  Peng-Yeng Yin,et al.  A discrete particle swarm algorithm for optimal polygonal approximation of digital curves , 2004, J. Vis. Commun. Image Represent..

[13]  Nir Friedman,et al.  Learning Belief Networks in the Presence of Missing Values and Hidden Variables , 1997, ICML.

[14]  Masao Iwamatsu,et al.  Locating All the Global Minima Using Multi-Species Particle Swarm Optimizer: The Inertia Weight and The Constriction Factor Variants , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[15]  Ziya Arnavut,et al.  Fault diagnosis for airplane engines using Bayesian networks and distributed particle swarm optimization , 2007, Parallel Comput..

[16]  Ganesh K. Venayagamoorthy,et al.  Particle swarm-based optimal partitioning algorithm for combinational CMOS circuits , 2007, Eng. Appl. Artif. Intell..

[17]  Ferat Sahin,et al.  Structural learning of Bayesian networks from complete data using the scatter search documents , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[18]  David Maxwell Chickering,et al.  Large-Sample Learning of Bayesian Networks is NP-Hard , 2002, J. Mach. Learn. Res..

[19]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[20]  Haibin Yu,et al.  A hybrid PSO-GD based intelligent method for machine diagnosis , 2006, Digit. Signal Process..

[21]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[22]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[23]  Y. Rahmat-Samii,et al.  Boundary Conditions in Particle Swarm Optimization Revisited , 2007, IEEE Transactions on Antennas and Propagation.

[24]  Ka Wing Chan,et al.  Transient stability constrained optimal power flow using particle swarm optimisation , 2007 .

[25]  Wai Lam,et al.  LEARNING BAYESIAN BELIEF NETWORKS: AN APPROACH BASED ON THE MDL PRINCIPLE , 1994, Comput. Intell..

[26]  A.S. Mohan,et al.  A Microparticle Swarm Optimizer for the Reconstruction of Microwave Images , 2007, IEEE Transactions on Antennas and Propagation.

[27]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[28]  Pin Luarn,et al.  A discrete version of particle swarm optimization for flowshop scheduling problems , 2007, Comput. Oper. Res..

[29]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[30]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[31]  Edward H. Herskovits,et al.  Computer-based probabilistic-network construction , 1992 .

[32]  H. Fan.  A modification to particle swarm optimization algorithm , 2002 .

[33]  Ziya Arnavut,et al.  Generating and exploiting bayesian networks for fault diagnosis in airplane engines , 2006, 2006 IEEE International Conference on Granular Computing.