A study of parallel and distributed particle swarm optimization methods

The goal of this paper is to present four new parallel and distributed particle swarm optimization methods and to experimentally compare their performances on a wide set of benchmark functions. These methods include a genetic algorithm whose individuals are co-evolving swarms, an "island model"-based multi-swarm system, where swarms are independent and they interact by means of particle migrations at regular time steps, and their respective variants enriched by adding a repulsive component to the particles. The benchmark functions used in our experimental study are two new sets of test functions (whose difficulty can be tuned by simply modifying the values of few real-valued parameters), the well known Rastrigin test functions, and the test functions proposed in the CEC 2005 numerical optimization competition. We show that the proposed repulsive multi-swarm system outperforms all the other presented methods.

[1]  Changhe Li,et al.  Fast Multi-Swarm Optimization for Dynamic Optimization Problems , 2008, 2008 Fourth International Conference on Natural Computation.

[2]  Giancarlo Mauri,et al.  An empirical comparison of parallel and distributed particle swarm optimization methods , 2010, GECCO '10.

[3]  Tony White,et al.  Towards multi-swarm problem solving in networks , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[4]  Leonardo Vanneschi,et al.  An Empirical Study of Multipopulation Genetic Programming , 2003, Genetic Programming and Evolvable Machines.

[5]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search , 2005, 2005 IEEE Congress on Evolutionary Computation.

[6]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[7]  Yi Jiang,et al.  Applying Multi-Swarm Accelerating Particle Swarm Optimization to Dynamic Continuous Functions , 2009, 2009 Second International Workshop on Knowledge Discovery and Data Mining.

[8]  Q. Henry Wu,et al.  MCPSO: A multi-swarm cooperative particle swarm optimizer , 2007, Appl. Math. Comput..

[9]  Jian Li,et al.  Solving constrained optimization via a modified genetic particle swarm optimization , 2008, e-Forensics '08.

[10]  A. A. Zhigli︠a︡vskiĭ,et al.  Stochastic Global Optimization , 2007 .

[11]  Roger Sauter,et al.  Introduction to Probability and Statistics for Engineers and Scientists , 2005, Technometrics.

[12]  Liu Zhiming,et al.  Solving Constrained Optimization via a Modified Genetic Particle Swarm Optimization , 2008, First International Workshop on Knowledge Discovery and Data Mining (WKDD 2008).

[13]  Mihai Oltean,et al.  Evolving the Structure of the Particle Swarm Optimization Algorithms , 2006, EvoCOP.

[14]  Jürgen Branke,et al.  Multi-swarm Optimization in Dynamic Environments , 2004, EvoWorkshops.

[15]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[16]  A. Zhigljavsky.  Stochastic Global Optimization , 2008, International Encyclopedia of Statistical Science.

[17]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[18]  Leonardo Vanneschi,et al.  Theory and practice for efficient genetic programming , 2004 .

[19]  Min Huang,et al.  Multi-swarm particle swarm optimization based risk management model for virtual enterprise , 2009, GEC '09.