Improving solution characteristics of particle swarm optimization using digital pheromones

In this paper, a new approach to particle swarm optimization (PSO) using digital pheromones to coordinate swarms within an n-dimensional design space is presented. In a basic PSO, an initial randomly generated population swarm propagates toward the global optimum over a series of iterations. The direction of the swarm movement in the design space is based on an individual particle’s best position in its history trail (pBest), and the best particle in the entire swarm (gBest). This information is used to generate a velocity vector indicating a search direction toward a promising location in the design space. The premise of the research presented in this paper is based on the fact that the search direction for each swarm member is dictated by only two candidates—pBest and gBest, which are not efficient to locate the global optimum, particularly in multi-modal optimization problems. In addition, poor move sets specified by pBest in the initial stages of optimization can trap the swarm in a local minimum or cause slow convergence. This paper presents the use of digital pheromones for aiding communication within the swarm to improve the search efficiency and reliability, resulting in improved solution quality, accuracy, and efficiency. With empirical proximity analysis, the pheromone strength in a region of the design space is determined. The swarm then reacts accordingly based on the probability that this region may contain an optimum. The additional information from pheromones causes the particles within the swarm to explore the design space thoroughly and locate the solution more efficiently and accurately than a basic PSO. This paper presents the development of this method and results from several multi-modal test cases.

[1]  James Kennedy,et al.  Proceedings of the 1998 IEEE International Conference on Evolutionary Computation [Book Review] , 1999, IEEE Transactions on Evolutionary Computation.

[2]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[3]  P. Suganthan.  Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[4]  B. P. Wang,et al.  Particle Swarm Optimization for Mixed Discrete, Integer and Continuous Variables , 2004 .

[5]  B. Bochenek,et al.  Structural optimization for post-buckling behavior using particle swarms , 2006 .

[6]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[7]  S. Jayanti,et al.  Corrosion fatigue through particle swarm optimization , 2003 .

[8]  Tapabrata Ray,et al.  ENGINEERING DESIGN OPTIMIZATION USING A SWARM WITH AN INTELLIGENT INFORMATION SHARING AMONG INDIVIDUALS , 2001 .

[9]  Ac Ratnaweera,et al.  Particle swarm optimisation with time varying acceleration coefficients , 2002 .

[10]  Albert A. Groenwold,et al.  A Study of Global Optimization Using Particle Swarms , 2005, J. Glob. Optim..

[11]  Eliot Winer,et al.  Three-Dimensional Path Planning of Unmanned Aerial Vehicles Using Particle Swarm Optimization , 2006 .

[12]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[13]  Tony White,et al.  Towards multi-swarm problem solving in networks , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[14]  Rui Huang,et al.  Mobile Agent Routing Based on a Two-Stage Optimization Model and a Hybrid Evolutionary Algorithm in Wireless Sensor Networks , 2006, ICNC.

[15]  Chunguang Zhou,et al.  Particle swarm optimization for traveling salesman problem , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[16]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[17]  Godfrey C. Onwubolu,et al.  New optimization techniques in engineering , 2004, Studies in Fuzziness and Soft Computing.

[18]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[19]  Jing Liu,et al.  Quantum-Behaved Particle Swarm Optimization for Integer Programming , 2006, ICONIP.

[20]  Ning Zhong,et al.  A Hybrid Discrete Particle Swarm Optimization for the Traveling Salesman Problem , 2006, SEAL.

[21]  P. Eberhard,et al.  Using Augmented Lagrangian Particle Swarm Optimization for Constrained Problems in Engineering , 2009 .

[22]  Byung-Il Koh,et al.  Parallel asynchronous particle swarm optimization , 2006, International journal for numerical methods in engineering.

[23]  Russell C. Eberhart,et al.  Solving Constrained Nonlinear Optimization Problems with Particle Swarm Optimization , 2002 .

[24]  Russell C. Eberhart,et al.  Swarm intelligence for permutation optimization: a case study of n-queens problem , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[25]  Jigui Sun,et al.  An Improved Discrete Particle Swarm Optimization Algorithm for TSP , 2007, 2007 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Workshops.

[26]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[27]  J. Sobieszczanski-Sobieski,et al.  Multidisciplinary optimization of a transport aircraft wing using particle swarm optimization , 2004 .

[28]  Albert A. Groenwold,et al.  Sizing design of truss structures using particle swarms , 2003 .

[29]  Eliot Winer,et al.  A parallel implementation of particle swarm optimization using digital pheromones , 2006 .

[30]  Suganthan.  [IEEE 1999. Congress on Evolutionary Computation-CEC99 - Washington, DC, USA (6-9 July 1999)] Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406) - Particle swarm optimiser with neighbourhood operator , 1999 .

[31]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[32]  Godfrey C. Onwubolu,et al.  Optimal path for automated drilling operations by a new heuristic approach using particle swarm optimization , 2004 .

[33]  B J Fregly,et al.  Parallel global optimization with the particle swarm algorithm , 2004, International journal for numerical methods in engineering.

[34]  Marco Dorigo,et al.  Distributed Optimization by Ant Colonies , 1992 .

[35]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[36]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[37]  Eliot Winer,et al.  Implementation of Digital Pheromones for Use in Particle Swarm Optimization , 2006 .

[38]  Bin Shen,et al.  Heuristic Information Based Improved Fuzzy Discrete PSO Method for Solving TSP , 2006, PRICAI.

[39]  Eliot Winer,et al.  Multimodal UAV ground control system , 2006 .

[40]  H. Van Dyke Parunak,et al.  DIGITAL PHEROMONES FOR AUTONOMOUS COORDINATION OF SWARMING UAV'S , 2002 .

[41]  Russell C. Eberhart,et al.  Particle swarm with extended memory for multiobjective optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[42]  Hitoshi Iba,et al.  Particle swarm optimization with Gaussian mutation , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[43]  P. Eberhard,et al.  Using augmented Lagrangian particle swarm optimization for constrained problems in engineering">Using augmented Lagrangian particle swarm optimization for constrained problems in engineering , 2006 .

[44]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[45]  Michael N. Vrahatis,et al.  Recent approaches to global optimization problems through Particle Swarm Optimization , 2002, Natural Computing.

[46]  Jigui Sun,et al.  A Hybrid Particle Swarm Optimization for Binary CSPs , 2006, ICIC.

[47]  Xiaohui Hu,et al.  Engineering optimization with particle swarm , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[48]  Shang He,et al.  An improved particle swarm optimizer for mechanical design optimization problems , 2004 .

[49]  P. Fourie,et al.  The particle swarm optimization algorithm in size and shape optimization , 2002 .

[50]  Wang Yi,et al.  An Adaptive Stochastic Collision Detection Between Deformable Objects Using Particle Swarm Optimization , 2006, EvoWorkshops.

[51]  James H. Oliver,et al.  UAV Swarm Control: Calculating Digital Pheromone Fields with the GPU , 2006 .

[52]  Koetsu Yamazaki,et al.  Penalty function approach for the mixed discrete nonlinear problems by particle swarm optimization , 2006 .

[53]  R. Steele.  Optimization , 2005 .

[54]  Eric Bonabeau,et al.  Swarm Intelligence: A New C2 Paradigm with an Application to Control Swarms of UAVs , 2003 .

[55]  R. K. Suresh,et al.  Discrete Particle Swarm Optimization (DPSO) Algorithm for Permutation Flowshop Scheduling to Minimize Makespan , 2005, ICNC.

[56]  Hongwei Liu,et al.  Virus-Evolutionary Particle Swarm Optimization Algorithm , 2006, ICNC.