Mean and Variance of the Sampling Distribution of Particle Swarm Optimizers During Stagnation

Several theoretical analyses of the dynamics of particle swarms have been offered in the literature over the last decade. Virtually all rely on substantial simplifications, often including the assumption that the particles are deterministic. This has prevented the exact characterization of the sampling distribution of the particle swarm optimizer (PSO). In this paper we introduce a novel method that allows us to exactly determine all the characteristics of a PSO sampling distribution and explain how it changes over any number of generations, in the presence stochasticity. The only assumption we make is stagnation, i.e., we study the sampling distribution produced by particles in search for a better personal best. We apply the analysis to the PSO with inertia weight, but the analysis is also valid for the PSO with constriction and other forms of PSO.

[1]  Chilukuri K. Mohan,et al.  Analysis of a simple particle swarm optimization system , 1998 .

[2]  U. Baumgartner,et al.  Particle swarm optimization - mass-spring system analogon , 2002 .

[3]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[4]  James Kennedy,et al.  Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[5]  Daniele Peri,et al.  Particle Swarm Optimization: efficient globally convergent modifications , 2006 .

[6]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[7]  Keiichiro Yasuda,et al.  Adaptive particle swarm optimization , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[8]  Pandu R. Tadikamalla,et al.  A Probability Distribution and its Uses in Fitting Data , 1979 .

[9]  M. Clerc.  Stagnation Analysis in Particle Swarm Optimisation or What Happens When Nothing Happens , 2006 .

[10]  A. Lakhany,et al.  Estimating the parameters of the generalized lambda distribution , 2000 .

[11]  Susanna W. M. Au-Yeung,et al.  Finding Probability Distributions From Moments , 2003 .

[12]  Visakan Kadirkamanathan,et al.  Stability analysis of the particle dynamics in particle swarm optimizer , 2006, IEEE Transactions on Evolutionary Computation.

[13]  S. Zahl.  Bounds for the Central Limit Theorem Error , 1966 .

[14]  T. Blackwell,et al.  Particle swarms and population diversity , 2005, Soft Comput..

[15]  James Kennedy,et al.  The Behavior of Particles , 1998, Evolutionary Programming.

[16]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[17]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[18]  Emilio F. Campana,et al.  Dynamic system analysis and initial particles position in Particle Swarm Optimization , 2006 .

[19]  Riccardo Poli,et al.  Continuous optimisation theory made easy? finite-element models of evolutionary strategies, genetic algorithms and particle swarm optimizers , 2007, FOGA'07.

[20]  E. Ozcan,et al.  Particle swarm optimization: surfing the waves , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[21]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[22]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..