Preventing premature convergence in a PSO and EDA hybrid

Particle Swarm Optimization (PSO) is a stochastic optimization approach that originated from earlier attempts to simulate the behavior of birds and was successfully applied in many applications as an optimization tool. Estimation of distributions algorithms (EDAs) are a class of evolutionary algorithms which build a probabilistic model capturing the search space properties and use this model to generate new individuals. One research trend that emerged in the past few years is the hybridization of PSO and EDA algorithms. In this work, we examine one of these hybrids attempts that uses a Gaussian model for capturing the search space characteristics. We compare two different approaches, previously introduced into EDAs to prevent premature convergence, when incorporated into this hybrid algorithm. The performance of the hybrid algorithm with and without these approaches is studied using a suite of well-known benchmark optimization functions.

[1]  Pedro Larrañaga,et al.  Estimation of Distribution Algorithms , 2002, Genetic Algorithms and Evolutionary Computation.

[2]  Louise Travé-Massuyès,et al.  Telephone Network Traffic Overloading Diagnosis and Evolutionary Computation Techniques , 1997, Artificial Evolution.

[3]  Franz Rothlauf,et al.  The correlation-triggered adaptive variance scaling IDEA , 2006, GECCO.

[4]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[5]  Jose Miguel Puerta,et al.  Initial approaches to the application of islands-based parallel EDAs in continuous domains , 2005, 2005 International Conference on Parallel Processing Workshops (ICPPW'05).

[6]  Mohammed El-Abd,et al.  Particle swarm optimization with varying bounds , 2007, 2007 IEEE Congress on Evolutionary Computation.

[7]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[8]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[9]  Marco Antonio Montes de Oca,et al.  An Estimation of Distribution Particle Swarm Optimization Algorithm , 2006, ANTS Workshop.

[10]  Michèle Sebag,et al.  Extending Population-Based Incremental Learning to Continuous Search Spaces , 1998, PPSN.

[11]  Marcus Gallagher,et al.  Real-valued Evolutionary Optimization using a Flexible Probability Density Estimator , 1999, GECCO.

[12]  Marcus Gallagher,et al.  On the importance of diversity maintenance in estimation of distribution algorithms , 2005, GECCO '05.

[13]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .