Comparative Study of Parallel Variants for a Particle Swarm Optimization

The Particle Swarm Optimization (PSO) algorithm is a well known alternative for global optimization based on a bio‐inspired heuristic. PSO has good performance, low computational complexity and few parameters. Heuristic techniques have been widely studied in the last twenty years and the scientific community is still interested in technological alternatives that accelerate these algorithms in order to apply them to bigger and more complex problems. This article presents an empirical study of some parallel variants for a PSO algorithm, implemented on a Graphic Process Unit (GPU) device with multi‐thread support and using the most recent model of parallel programming for these cases. The main idea is to show that, with the help of a multithreading GPU, it is possible to significantly improve the PSO algorithm performance by means of a simple and almost straightforward parallel programming, getting the computing power of cluster in a conventional personal computer.

[1]  Marco Dorigo,et al.  The ant colony optimization meta-heuristic , 1999 .

[2]  Naga K. Govindaraju,et al.  A Survey of General‐Purpose Computation on Graphics Hardware , 2007 .

[3]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[4]  Kevin Skadron,et al.  Scalable parallel programming , 2008, 2008 IEEE Hot Chips 20 Symposium (HCS).

[5]  B J Fregly,et al.  Parallel global optimization with the particle swarm algorithm , 2004, International journal for numerical methods in engineering.

[6]  Bo Li,et al.  Parallelizing particle swarm optimization , 2005, PACRIM. 2005 IEEE Pacific Rim Conference on Communications, Computers and signal Processing, 2005..

[7]  Konstantinos E. Parsopoulos,et al.  MULTIOBJECTIVE OPTIMIZATION USING PARALLEL VECTOR EVALUATED PARTICLE SWARM OPTIMIZATION , 2003 .

[8]  Ponnuthurai N. Suganthan,et al.  A novel concurrent particle swarm optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[9]  Y. Rahmat-Samii,et al.  Parallel particle swarm optimization and finite- difference time-domain (PSO/FDTD) algorithm for multiband and wide-band patch antenna designs , 2005, IEEE Transactions on Antennas and Propagation.

[10]  D.S. Weile,et al.  Application of a parallel particle swarm optimization scheme to the design of electromagnetic absorbers , 2005, IEEE Transactions on Antennas and Propagation.

[11]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[12]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[13]  Jeng-Shyang Pan,et al.  A Parallel Particle Swarm Optimization Algorithm with Communication Strategies , 2005, J. Inf. Sci. Eng..

[14]  Anthony Brabazon,et al.  Self-organising swarm (SOSwarm) , 2008, Soft Comput..

[15]  Wolfgang Banzhaf,et al.  Fast Genetic Programming on GPUs , 2007, EuroGP.

[16]  Hui-min Ma,et al.  Research on parallel particle swarm optimization algorithm based on cultural evolution for the multi-level capacitated lot-sizing problem , 2008, 2008 Chinese Control and Decision Conference.

[17]  Jürgen Branke,et al.  Multi-objective particle swarm optimization on computer grids , 2007, GECCO '07.

[18]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[19]  Wolfgang Banzhaf,et al.  Fast Genetic Programming and Artificial Developmental Systems on GPUs , 2007, 21st International Symposium on High Performance Computing Systems and Applications (HPCS'07).

[20]  Thomas Stützle,et al.  Ant Colony Optimization , 2009, EMO.

[21]  William B. Langdon,et al.  A SIMD Interpreter for Genetic Programming on GPU Graphics Cards , 2007, EuroGP.

[22]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.