Cognitive Bare Bones Particle Swarm Optimisation with Jumps

The 'bare bones' BB formulation of particle swarm optimisation PSO was originally advanced as a model of PSO dynamics. The idea was to model the forces between particles with sampling from a probability distribution in the hope of understanding swarm behaviour with a conceptually simpler particle update rule. 'Bare bones with jumps' BBJ proposes three significant extensions to the BB algorithm: i two social neighbourhoods, ii a tuneable parameter that can advantageously bring the swarm to the 'edge of collapse' and iii a component-by-component probabilistic jump to anywhere in the search space. The purpose of this paper is to investigate the role of jumping within a specific BBJ algorithm, cognitive BBJ cBBJ. After confirming the effectiveness of cBBJ, this paper finds that: jumping in one component only is optimal over the 30 dimensional benchmarks of this study; that a small per particle jump probability of 1/30 works well for these benchmarks; jumps are chiefly beneficial during the early stages of optimisation and finally this work supplies evidence that jumping provides escape from regions surrounding sub-optimal minima.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[3]  Renato A. Krohling,et al.  Gaussian particle swarm with jumps , 2005, 2005 IEEE Congress on Evolutionary Computation.

[4]  James Kennedy,et al.  Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[5]  Mohamed S. Kamel,et al.  Clustering ensemble using swarm intelligence , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[6]  Maurice Clerc,et al.  From Theory to Practice in Particle Swarm Optimization , 2011 .

[7]  Tim Blackwell,et al.  A Study of Collapse in Bare Bones Particle Swarm Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[8]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..

[9]  Konstantinos E. Parsopoulos,et al.  UPSO: A Unified Particle Swarm Optimization Scheme , 2019, International Conference of Computational Methods in Sciences and Engineering 2004 (ICCMSE 2004).

[10]  Riccardo Poli,et al.  Mean and Variance of the Sampling Distribution of Particle Swarm Optimizers During Stagnation , 2009, IEEE Transactions on Evolutionary Computation.

[11]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[12]  Michael G. Epitropakis,et al.  Evolving cognitive and social experience in Particle Swarm Optimization through Differential Evolution: A hybrid approach , 2012, Inf. Sci..

[13]  Jorge Peña,et al.  Theoretical and empirical study of particle swarms with additive stochasticity and different recombination operators , 2008, GECCO '08.

[14]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[15]  Michael N. Vrahatis,et al.  Particle Swarm Optimization and Intelligence: Advances and Applications , 2010 .

[16]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[17]  Jürgen Branke,et al.  Experimental Analysis of Bound Handling Techniques in Particle Swarm Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[18]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[19]  Mohammad Majid al-Rifaie,et al.  Bare Bones Particle Swarms with Jumps , 2012, ANTS.

[20]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[21]  Michael N. Vrahatis,et al.  Unified Particle Swarm Optimization for Solving Constrained Engineering Optimization Problems , 2005, ICNC.

[22]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[23]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[24]  Andries Petrus Engelbrecht,et al.  A Convergence Proof for the Particle Swarm Optimiser , 2010, Fundam. Informaticae.

[25]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[26]  Tim Blackwell,et al.  Origin of bursts , 2007, GECCO '07.