Convergence and stochastic stability analysis of particle swarm optimization variants with generic parameter distributions

In this paper we present the convergence and stochastic stability analysis of a set of PSO variants: those that differ with the classical PSO in the statistical distribution of the three PSO tuning parameters: inertia weight, local and global acceleration. We provide an analytical expression for the upper limit of the second order stability regions (the so called USL curves) of the particle trajectories that can be applied to most of these PSO algorithms. Thus, this work generalizes to this set the result found in the literature for the classical PSO. We apply this analysis to some of these variants. Finally, numerical experiments have been performed that confirm the known fact that the best algorithm performance is provided tuning the PSO parameters close to the USL curve.

[1]  M. Clerc.  Stagnation Analysis in Particle Swarm Optimisation or What Happens When Nothing Happens , 2006 .

[2]  J. Fernández-Martínez,et al.  Stochastic Stability Analysis of the Linear Continuous and Discrete PSO Models , 2011, IEEE Transactions on Evolutionary Computation.

[3]  Shiyuan Yang,et al.  Stochastic convergence analysis and parameter selection of the standard particle swarm optimization algorithm , 2007, Inf. Process. Lett..

[4]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[5]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[6]  Leandro dos Santos Coelho,et al.  PSO-E: Particle Swarm with Exponential Distribution , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[7]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[8]  Riccardo Poli,et al.  Dynamics and stability of the sampling distribution of particle swarm optimisers via moment analysis , 2008 .

[9]  Yongling Zheng,et al.  On the convergence analysis and parameter selection in particle swarm optimization , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[11]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[12]  Jing J. Liang,et al.  Evaluation of Comprehensive Learning Particle Swarm Optimizer , 2004, ICONIP.

[13]  Leandro dos Santos Coelho,et al.  Coevolutionary Particle Swarm Optimization Using Gaussian Distribution for Solving Constrained Optimization Problems , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  James Kennedy,et al.  Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[15]  Riccardo Poli,et al.  Mean and Variance of the Sampling Distribution of Particle Swarm Optimizers During Stagnation , 2009, IEEE Transactions on Evolutionary Computation.

[16]  An improved PSO method using Gaussian distributed random variables for electromagnetic optimization , 2008, 2008 IEEE Antennas and Propagation Society International Symposium.

[17]  Visakan Kadirkamanathan,et al.  Stability analysis of the particle dynamics in particle swarm optimizer , 2006, IEEE Transactions on Evolutionary Computation.

[18]  Esperanza García Gonzalo,et al.  The PSO family: deduction, stochastic analysis and comparison , 2009, Swarm Intelligence.

[19]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[20]  L. Coelho,et al.  Predictive Controller Tuning Using Modified Particle Swarm Optimization Based on Cauchy and Gaussian Distributions , 2005 .

[21]  Russell C. Eberhart,et al.  Tracking and optimizing dynamic systems with particle swarms , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[22]  Lehrstuhl für Elektrische,et al.  Gaussian swarm: a novel particle swarm optimization algorithm , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[23]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[24]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..