Empirical studies on parallel network construction of Bayesian optimization algorithms

This paper discusses a parallel optimization algorithm based on evolutionary algorithms with probabilistic model-building in order to design a robust search algorithm that can be applicable to a wide-spectrum of application problems effectively and reliably. Probabilistic model building genetic algorithm, which is also called estimation of distribution algorithm, is a promising approach in evolutionary computation and its parallelization has been investigated. We propose an improvement of parallel network construction in distributed Bayesian optimization algorithms which estimate distribution of promising solutions as Bayesian networks. Through numerical experiments on an actual parallel architecture, we show the effectiveness of our approach compared to the conventional parallelization. Also we perform experiments on a real-world application problem: protein structure predictions.

[1]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[2]  Tomoyuki Hiroyasu,et al.  A New Model of Parallel Distributed Genetic Algorithms for Cluster Systems: Dual Individual DGAs , 2000, ISHPC.

[3]  Masaharu Munetomo,et al.  Empirical Investigations on Parallelized Linkage Identification , 2004, PPSN.

[4]  Global minimum configuration of a small peptide for the ECEPP/2 and ECEPP/3 force fields , 1997 .

[5]  Heinz Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions II. Continuous Parameters , 1996, PPSN.

[6]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[7]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[8]  Heinz Mühlenbein,et al.  FDA -A Scalable Evolutionary Algorithm for the Optimization of Additively Decomposed Functions , 1999, Evolutionary Computation.

[9]  D. Goldberg,et al.  BOA: the Bayesian optimization algorithm , 1999 .

[10]  David Maxwell Chickering,et al.  Learning Bayesian networks: The combination of knowledge and statistical data , 1995, Mach. Learn..

[11]  Erick Cantú-Paz Designing Efficient and Accurate Parallel Genetic Algorithms , 1999 .

[12]  Martin Pelikan,et al.  Marginal Distributions in Evolutionary Algorithms , 2007 .

[13]  Masaharu Munetomo,et al.  A Parallel Genetic Algorithm Based on Linkage Identification , 2003, GECCO.