Variance of particle location in the stochastic model of PSO with inertia weight

In the Particle Swarm Optimization (PSO) method, the behavior of particles depends on movement parameters. Effective application of the PSO method in real-world problems requires stable behavior of particles in the swarm. In the stochastic particle stability analysis, recurrent formulas of expected value and variance of particle location are used. An explicit formula for the variance can also be obtained, however, it cannot be applied in practice due to its complexity. In our research, we propose assumptions guaranteeing a simple explicit formula for location variance. For the formula and given assumptions, we show stability areas in the particle configuration space, which guarantee order-2* stability of particles also for probability distributions of movement parameters other than uniform. The areas are verified in simulations.

[1]  Chilukuri K. Mohan,et al.  Analysis of a simple particle swarm optimization system , 1998 .

[2]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[3]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[4]  Andries Petrus Engelbrecht,et al.  Particle swarm optimizer: The impact of unstable particles on performance , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[5]  Shiyuan Yang,et al.  Stochastic convergence analysis and parameter selection of the standard particle swarm optimization algorithm , 2007, Inf. Process. Lett..

[6]  D. Broomhead,et al.  Exact analysis of the sampling distribution for the canonical particle swarm optimiser and its convergence during stagnation , 2007, GECCO '07.

[7]  Riccardo Poli,et al.  Mean and Variance of the Sampling Distribution of Particle Swarm Optimizers During Stagnation , 2009, IEEE Transactions on Evolutionary Computation.

[8]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..

[9]  Tim Blackwell,et al.  A Study of Collapse in Bare Bones Particle Swarm Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[10]  Andries Petrus Engelbrecht,et al.  A generalized theoretical deterministic particle swarm model , 2014, Swarm Intelligence.

[11]  Qunfeng Liu,et al.  Order-2 Stability Analysis of Particle Swarm Optimization , 2015, Evolutionary Computation.

[12]  Christopher Wesley Cleghorn,et al.  Particle Swarm Optimization: Understanding Order-2 Stability Guarantees , 2019, EvoApplications.

[13]  Andries Petrus Engelbrecht,et al.  Particle swarm stability: a theoretical extension using the non-stagnate distribution assumption , 2018, Swarm Intelligence.

[14]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[15]  Zbigniew Michalewicz,et al.  Stability Analysis of the Particle Swarm Optimization Without Stagnation Assumption , 2016, IEEE Transactions on Evolutionary Computation.