Evolutionary algorithm using kernel density estimation model in continuous domain

Estimation of Distribution Algorithm (EDA) is a kind of evolutionary algorithm which updates and samples from probabilistic model in evolutionary course. The key of EDA is the construction of probability model suitable for real distribution. Gaussian distribution is widely used in EDAs but the assumption of normality is not realistic for many real-life problems. In this paper, a new EDA using kernel density estimation (KEDA) is introduced. Adaptive change strategy of kernel width is presented and selection scheme, sampling method are also given cooperated with KEDA. The results of 5 benchmark functions show that results of KEDA outperform PBILC, UMDAC, EDAG, H-EDA.

[1]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[2]  David E. Goldberg,et al.  The compact genetic algorithm , 1999, IEEE Trans. Evol. Comput..

[3]  Pedro Larrañaga,et al.  Optimization in Continuous Domains by Learning and Simulation of Gaussian Networks , 2000 .

[4]  Hua Xu,et al.  Cross entropy and adaptive variance scaling in continuous EDA , 2007, GECCO '07.

[5]  Michèle Sebag,et al.  Extending Population-Based Incremental Learning to Continuous Search Spaces , 1998, PPSN.

[6]  Paul A. Viola,et al.  MIMIC: Finding Optima by Estimating Probability Densities , 1996, NIPS.

[7]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[8]  丁楠,et al.  Histogram-Based Estimation of Distribution Algorithm： A Competent Method for Continuous Optimization , 2008 .

[9]  Qingfu Zhang,et al.  On the convergence of a class of estimation of distribution algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[10]  Zengqi Sun,et al.  Histogram-Based Estimation of Distribution Algorithm: A Competent Method for Continuous Optimization , 2008, Journal of Computer Science and Technology.

[11]  G. Harik.  Linkage Learning via Probabilistic Modeling in the ECGA , 1999 .

[12]  Bin Li,et al.  Continuous Optimization based-on Boosting Gaussian Mixture Model , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[13]  M. Pelikán,et al.  The Bivariate Marginal Distribution Algorithm , 1999 .

[14]  D. Goldberg,et al.  BOA: the Bayesian optimization algorithm , 1999 .

[15]  Xin Yao,et al.  Covariance matrix repairing in Gaussian based EDAs , 2007, 2007 IEEE Congress on Evolutionary Computation.

[16]  D. Goldberg,et al.  Evolutionary Algorithm Using Marginal Histogram Models in Continuous Domain , 2007 .

[17]  S. Baluja,et al.  Combining Multiple Optimization Runs with Optimal Dependency Trees , 1997 .