A Brief Historical Review of Particle Swarm Optimization (PSO)

Mathematics Department, Universidad de Oviedo, 33007 Oviedo, SpainParticle Swarm Optimization is an evolutionary algorithm that has been applied to many differentengineering and technological problems with considerable success. Since its first publication in1995, it has been continually modified trying to improve its convergence properties. Thus, manyvariants have been proposed in the literature. Some of these variants were related to a particularproblem and had little application outside the field where they have been proposed. Others havebeen used for solving different kind of problems and have enjoyed a longer life. These PSO variantshave been used to solve a wide range of optimization and inverse problems: continuous, discrete,dynamical, multioptima, combinatorial, with and without additional constraints. In this paper webriefly review the history of Particle Swarm Optimization, insisting in the importance of the stochasticstability analysis of the particle trajectories in order to achieve convergence.

[1]  R. W. Dobbins,et al.  Computational intelligence PC tools , 1996 .

[2]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[3]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[4]  Chukwudi Anyakoha,et al.  A review of particle swarm optimization. Part II: hybridisation, combinatorial, multicriteria and constrained optimization, and indicative applications , 2008, Natural Computing.

[5]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Siti Mariyam Shamsuddin,et al.  Particle Swarm Optimization: Technique, System and Challenges , 2011 .

[7]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[8]  Masanori Sugisaka,et al.  An Effective Search Method for Neural Network Based Face Detection Using Particle Swarm Optimization , 2005, IEICE Trans. Inf. Syst..

[9]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[10]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[11]  Derek T. Green,et al.  Biases in Particle Swarm Optimization , 2010 .

[12]  Visakan Kadirkamanathan,et al.  Stability analysis of the particle dynamics in particle swarm optimizer , 2006, IEEE Transactions on Evolutionary Computation.

[13]  Juan Luis Fernández-Martínez,et al.  Theoretical analysis of particle swarm trajectories through a mechanical analogy , 2008 .

[14]  Ulf Grenander,et al.  A stochastic nonlinear model for coordinated bird flocks , 1990 .

[15]  E. Kirubakaran,et al.  A Hybrid PSO with Dynamic Inertia Weight and GA Approach for Discovering Classification Rule in Data Mining , 2012 .

[16]  Ahmed A. Kishk,et al.  Physical Theory for Particle Swarm Optimization , 2007 .

[17]  J. Fernández-Martínez,et al.  Stochastic Stability Analysis of the Linear Continuous and Discrete PSO Models , 2011, IEEE Transactions on Evolutionary Computation.

[18]  Shiyuan Yang,et al.  Stochastic convergence analysis and parameter selection of the standard particle swarm optimization algorithm , 2007, Inf. Process. Lett..

[19]  E. Ozcan,et al.  Particle swarm optimization: surfing the waves , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[20]  J. F. Martínez,et al.  The generalized PSO: a new door to PSO evolution , 2008 .

[21]  Ajith Abraham,et al.  Inertia Weight strategies in Particle Swarm Optimization , 2011, 2011 Third World Congress on Nature and Biologically Inspired Computing.

[22]  Ellips Masehian,et al.  Particle Swarm Optimization Methods, Taxonomy and Applications , 2009 .

[23]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[24]  Bijaya K. Panigrahi,et al.  An inertia-adaptive particle swarm system with particle mobility factor for improved global optimization , 2010, Neural Computing and Applications.

[25]  Michael N. Vrahatis,et al.  Particle swarm optimization for integer programming , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[26]  Chukwudi Anyakoha,et al.  A review of particle swarm optimization. Part I: background and development , 2007, Natural Computing.

[27]  U. Baumgartner,et al.  Particle swarm optimization - mass-spring system analogon , 2002 .

[28]  Riccardo Poli,et al.  Dynamics and stability of the sampling distribution of particle swarm optimisers via moment analysis , 2008 .

[29]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[30]  Yongling Zheng,et al.  On the convergence analysis and parameter selection in particle swarm optimization , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[31]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[32]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[33]  Michael J. Tompkins,et al.  On the topography of the cost functional in linear and nonlinear inverse problems , 2012 .

[34]  Juan Luis Fernández-Martínez,et al.  STOCHASTIC STABILITY AND NUMERICAL ANALYSIS OF TWO NOVEL ALGORITHMS OF THE PSO FAMILY: PP-GPSO AND RR-GPSO , 2012 .

[35]  Thomas Stützle,et al.  Frankenstein's PSO: A Composite Particle Swarm Optimization Algorithm , 2009, IEEE Transactions on Evolutionary Computation.

[36]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[37]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[38]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[39]  Reza Firsandaya Malik,et al.  New particle swarm optimizer with sigmoid increasing inertia weight , 2007 .

[40]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[41]  Liyan Zhang,et al.  Empirical study of particle swarm optimizer with an increasing inertia weight , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[42]  Zhihua Cui,et al.  Using Fitness Landscape to Improve the Performance of Particle Swarm Optimization , 2012 .

[43]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[44]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[45]  Marco Dorigo,et al.  Distributed Optimization by Ant Colonies , 1992 .

[46]  Esperanza García Gonzalo,et al.  The PSO family: deduction, stochastic analysis and comparison , 2009, Swarm Intelligence.

[47]  James Kennedy,et al.  Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).