A cooperative particle swarm optimizer with migration of heterogeneous probabilistic models

Particle Swarm Optimization (PSO) is a stochastic optimization approach that originated from simulations of bird flocking, and that has been successfully used in many applications as an optimization tool. Estimation of distribution algorithms (EDAs) are a class of evolutionary algorithms which perform a two-step process: building a probabilistic model from which good solutions may be generated and then using this model to generate new individuals. Two distinct research trends that emerged in the past few years are the hybridization of PSO and EDA algorithms and the parallelization of EDAs to exploit the idea of exchanging the probabilistic model information. In this work, we propose the use of a cooperative PSO/EDA algorithm based on the exchange of heterogeneous probabilistic models. The model is heterogeneous because the cooperating PSO/EDA algorithms use different methods to sample the search space. Three different exchange approaches are tested and compared in this work. In all these approaches, the amount of information exchanged is adapted based on the performance of the two cooperating swarms. The performance of the cooperative model is compared to the existing state-of-the-art PSO cooperative approaches using a suite of well-known benchmark optimization functions.

[1]  M. Kamel,et al.  A Taxonomy of Cooperative Search Algorithms , 2005, Hybrid Metaheuristics.

[2]  Jose Miguel Puerta,et al.  Initial approaches to the application of islands-based parallel EDAs in continuous domains , 2005, 2005 International Conference on Parallel Processing Workshops (ICPPW'05).

[3]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[4]  Mohammed El-Abd,et al.  Particle swarm optimization with varying bounds , 2007, 2007 IEEE Congress on Evolutionary Computation.

[5]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search , 2005, 2005 IEEE Congress on Evolutionary Computation.

[6]  Heinz Mühlenbein,et al.  The Equation for Response to Selection and Its Use for Prediction , 1997, Evolutionary Computation.

[7]  Marcus Gallagher,et al.  Experimental results for the special session on real-parameter optimization at CEC 2005: a simple, continuous EDA , 2005, 2005 IEEE Congress on Evolutionary Computation.

[8]  Michèle Sebag,et al.  Extending Population-Based Incremental Learning to Continuous Search Spaces , 1998, PPSN.

[9]  Marco Dorigo,et al.  Ant colony optimization for continuous domains , 2008, Eur. J. Oper. Res..

[10]  Jose Miguel Puerta,et al.  Migration of Probability Models Instead of Individuals: An Alternative When Applying the Island Model to EDAs , 2004, PPSN.

[11]  Mohammed El-Abd,et al.  A Taxonomy of Cooperative Particle Swarm Optimizers , 2008 .

[12]  Pedro Larrañaga,et al.  Estimation of Distribution Algorithms , 2002, Genetic Algorithms and Evolutionary Computation.

[13]  Pedro Larrañaga,et al.  Towards a New Evolutionary Computation - Advances in the Estimation of Distribution Algorithms , 2006, Towards a New Evolutionary Computation.

[14]  Jiri Ocenasek,et al.  Migration of probabilistic models for island-based bivariate EDA algorithm , 2007, GECCO '07.

[15]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[16]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[17]  Jin-Kao Hao,et al.  Proceedings of Artificial Evolution , 2011 .

[18]  Alberto Ochoa,et al.  A Parallel Island Model for Estimation of Distribution Algorithms , 2006, Towards a New Evolutionary Computation.

[19]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[20]  Marcus Gallagher,et al.  Real-valued Evolutionary Optimization using a Flexible Probability Density Estimator , 1999, GECCO.

[21]  Maurice Clerc,et al.  Performance evaluation of TRIBES, an adaptive particle swarm optimization algorithm , 2009, Swarm Intelligence.

[22]  Franz Rothlauf,et al.  The correlation-triggered adaptive variance scaling IDEA , 2006, GECCO.

[23]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[24]  Marco Antonio Montes de Oca,et al.  An Estimation of Distribution Particle Swarm Optimization Algorithm , 2006, ANTS Workshop.

[25]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[26]  Kevin D. Seppi,et al.  Exposing origin-seeking bias in PSO , 2005, GECCO '05.

[27]  Jirí Jaros,et al.  Parallel BMDA with probability model migration , 2007, 2007 IEEE Congress on Evolutionary Computation.

[28]  Louise Travé-Massuyès,et al.  Telephone Network Traffic Overloading Diagnosis and Evolutionary Computation Techniques , 1997, Artificial Evolution.

[29]  J. A. Lozano,et al.  Towards a New Evolutionary Computation: Advances on Estimation of Distribution Algorithms (Studies in Fuzziness and Soft Computing) , 2006 .

[30]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[31]  David E. Goldberg,et al.  Multiple-Deme Parallel Estimation of Distribution Algorithms: Basic Framework and Application , 2003, PPAM.

[32]  Tomoyuki Hiroyasu,et al.  Distributed Probabilistic Model-Building Genetic Algorithm , 2002 .