Topology selection for particle swarm optimization

Particle swarm optimization (PSO) uses a social topology for particles to share information among neighbors during optimization. A large number of existing literatures have shown that the topology affects the performance of PSO and an optimal topology is problem-dependent, but currently there is a lack of study on this issue. In this paper, we first analyze a class of deterministic regular topologies with regard to what affect the optimality of algorithmic parameters (e.g., the number of particles and the topological degree), so as to provide a guide to topology selections for PSO. Both theoretical analysis and numerical experiments are performed and reported in detail. The theoretical analysis reveals that the optimality of algorithmic parameters is dependent on the computational budget available. In particular, the optimal number of particles increases unstrictly as the computational budget increases, while for any fixed number of particles the optimal degree decreases unstrictly as computational budget increases. The only condition is that the computational budget cannot exceed a constant measuring the hardness of the benchmark function set. With a total of 198 regular topologies and 9 different numbers of particles tested on 90 benchmark functions using a recently reported data profiling technique, numerical experiments verify the theoretical derivations. Based on these results, two formulas are developed to help choose optimal topology parameters for increased ease and applicability of PSO to real-world problems.

[1]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[2]  M. Perc,et al.  Resolution of the Stochastic Strategy Spatial Prisoner's Dilemma by Means of Particle Swarm Optimization , 2011, PloS one.

[3]  Riccardo Poli,et al.  Analysis of the publications on the applications of particle swarm optimisation , 2008 .

[4]  Nor Ashidi Mat Isa,et al.  An adaptive two-layer particle swarm optimization with elitist learning strategy , 2014, Inf. Sci..

[5]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer for noisy and dynamic environments , 2006, Genetic Programming and Evolvable Machines.

[6]  Jun Zhang,et al.  Competitive and cooperative particle swarm optimization with information sharing mechanism for global optimization problems , 2015, Inf. Sci..

[7]  Chenggong Zhang,et al.  Scale-free fully informed particle swarm optimization algorithm , 2011, Inf. Sci..

[8]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[9]  E. Prempain,et al.  An improved particle swarm optimization for optimal power flow , 2004, 2004 International Conference on Power System Technology, 2004. PowerCon 2004..

[10]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2011, IEEE Trans. Evol. Comput..

[11]  John H. Holland,et al.  Genetic Algorithms and the Optimal Allocation of Trials , 1973, SIAM J. Comput..

[12]  Jian Guo,et al.  Topology Optimization of Particle Swarm Optimization , 2014, ICSI.

[13]  Serge Gratton,et al.  Globally convergent evolution strategies , 2015, Math. Program..

[14]  Jun Zhang,et al.  Small-world particle swarm optimization with topology adaptation , 2013, GECCO '13.

[15]  Hassan Bevrani,et al.  An On-Line PSO-Based Fuzzy Logic Tuning Approach: Microgrid Frequency Control Case Study , 2014 .

[16]  James Kennedy,et al.  Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[17]  T. T. Mirnalinee,et al.  From Optimization to Clustering: A Swarm Intelligence Approach , 2015 .

[18]  Stefan M. Wild,et al.  Benchmarking Derivative-Free Optimization Algorithms , 2009, SIAM J. Optim..

[19]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[20]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[21]  Christian Posthoff,et al.  Neighborhood Re-structuring in Particle Swarm Optimization , 2005, Australian Conference on Artificial Intelligence.

[22]  José Neves,et al.  Watch thy neighbor or how the swarm can learn from its environment , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[23]  Visakan Kadirkamanathan,et al.  Stability analysis of the particle dynamics in particle swarm optimizer , 2006, IEEE Transactions on Evolutionary Computation.

[24]  Andries Petrus Engelbrecht,et al.  Particle swarm variants: standardized convergence analysis , 2015, Swarm Intelligence.

[25]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Andrew Lim,et al.  Example-based learning particle swarm optimization for continuous optimization , 2012, Information Sciences.

[27]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[28]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[29]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[30]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[31]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[32]  Ying Tan,et al.  Fireworks Algorithm for Optimization , 2010, ICSI.

[33]  Matjaz Perc,et al.  A review of chaos-based firefly algorithms: Perspectives and research challenges , 2015, Appl. Math. Comput..

[34]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.

[35]  Chia-Feng Juang,et al.  Hierarchical Cluster-Based Multispecies Particle-Swarm Optimization for Fuzzy-System Optimization , 2010, IEEE Transactions on Fuzzy Systems.

[36]  J. Kennedy Stereotyping: improving particle swarm performance with cluster analysis , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[37]  Yuhui Shi,et al.  Brain Storm Optimization Algorithm , 2011, ICSI.

[38]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer and its adaptive variant , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[39]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..

[40]  Tim Blackwell,et al.  A Study of Collapse in Bare Bones Particle Swarm Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[41]  Peter Schegner,et al.  An Improved Particle Swarm Optimization for Optimal Power Flow , 2013 .

[42]  Nor Ashidi Mat Isa,et al.  Particle swarm optimization with increasing topology connectivity , 2014, Eng. Appl. Artif. Intell..

[43]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[44]  Qunfeng Liu,et al.  Order-2 Stability Analysis of Particle Swarm Optimization , 2015, Evolutionary Computation.

[45]  Riccardo Poli,et al.  A Model for Analysing the Collective Dynamic Behaviour and Characterising the Exploitation of Population-Based Algorithms , 2014, Evolutionary Computation.

[46]  Shiyuan Yang,et al.  Stochastic convergence analysis and parameter selection of the standard particle swarm optimization algorithm , 2007, Inf. Process. Lett..

[47]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[48]  Riccardo Poli,et al.  Mean and Variance of the Sampling Distribution of Particle Swarm Optimizers During Stagnation , 2009, IEEE Transactions on Evolutionary Computation.

[49]  Christian Posthoff,et al.  Randomized directed neighborhoods with edge migration in particle swarm optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[50]  Iztok Fister,et al.  Particle swarm optimization for automatic creation of complex graphic characters , 2015 .

[51]  Bo Yang,et al.  Improving particle swarm optimization using multi-layer searching strategy , 2014, Inf. Sci..