Particle swarm optimization with neighborhood-based budget allocation

The standard particle swarm optimization (PSO) algorithm allocates the total available budget of function evaluations equally and concurrently among the particles of the swarm. In the present work, we propose a new variant of PSO where each particle is dynamically assigned different computational budget based on the quality of its neighborhood. The main goal is to favor particles with high-quality neighborhoods by asynchronously providing them with more function evaluations than the rest. For this purpose, we define quality criteria to assess a neighborhood with respect to the information it possesses in terms of solutions’ quality and diversity. Established stochastic techniques are employed for the final selection among the particles. Different variants are proposed by combining various quality criteria in a single- or multi-objective manner. The proposed approach is assessed on widely used test suites as well as on a set of real-world problems. Experimental evidence reveals the efficiency of the proposed approach and its competitiveness against other PSO-based variants as well as different established algorithms.

[1]  Rajesh Kumar,et al.  Directed Bee Colony Optimization Algorithm , 2014, Swarm Evol. Comput..

[2]  Konstantinos E. Parsopoulos,et al.  Particle swarm optimization with budget allocation through neighborhood ranking , 2013, GECCO '13.

[3]  Yaochu Jin,et al.  Dynamic Weighted Aggregation for evolutionary multi-objective optimization: why does it work and how? , 2001 .

[4]  Mark Johnston,et al.  Optimal computing budget allocation in particle swarm optimization , 2013, GECCO '13.

[5]  Thomas Bartz-Beielstein,et al.  Particle Swarm Optimization and Sequential Sampling in Noisy Environments , 2007, Metaheuristics.

[6]  Mahamed G. H. Omran,et al.  Global-best harmony search , 2008, Appl. Math. Comput..

[7]  M. N. Vrahatis,et al.  Particle swarm optimization method in multiobjective problems , 2002, SAC '02.

[8]  Reza Akbari,et al.  A rank based particle swarm optimization algorithm with dynamic adaptation , 2011, J. Comput. Appl. Math..

[9]  Yu-Lin He,et al.  Particle swarm optimization for determining fuzzy measures from data , 2011, Inf. Sci..

[10]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[11]  Loo Hay Lee,et al.  Simulation optimization using the Particle Swarm Optimization with optimal computing budget allocation , 2011, Proceedings of the 2011 Winter Simulation Conference (WSC).

[12]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[13]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[14]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[15]  Rajesh Kumar,et al.  A boundary restricted adaptive particle swarm optimization for data clustering , 2013, Int. J. Mach. Learn. Cybern..

[16]  Mark Johnston,et al.  Resampling in Particle Swarm Optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[17]  Isaac E. Lagaris,et al.  Particle swarm optimization with deliberate loss of information , 2012, Soft Comput..

[18]  Ling Wang,et al.  Particle swarm optimization for function optimization in noisy environment , 2006, Appl. Math. Comput..

[19]  Choi-Hong Lai,et al.  Parallel quantum-behaved particle swarm optimization , 2014, Int. J. Mach. Learn. Cybern..

[20]  Larry J. Eshelman,et al.  The CHC Adaptive Search Algorithm: How to Have Safe Search When Engaging in Nontraditional Genetic Recombination , 1990, FOGA.

[21]  Mauricio Zambrano-Bigiarini,et al.  Standard Particle Swarm Optimisation 2011 at CEC-2013: A baseline for future PSO improvements , 2013, 2013 IEEE Congress on Evolutionary Computation.

[22]  Suganthan [IEEE 1999. Congress on Evolutionary Computation-CEC99 - Washington, DC, USA (6-9 July 1999)] Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406) - Particle swarm optimiser with neighbourhood operator , 1999 .

[23]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[24]  Ajith Abraham,et al.  A New Approach for Solving Nonlinear Equations Systems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[25]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[26]  L. Darrell Whitley,et al.  Ruffled by Ridges: How Evolutionary Algorithms Can Fail , 2004, GECCO.

[27]  Rajesh Kumar,et al.  An Intelligent Tuned Harmony Search algorithm for optimisation , 2012, Inf. Sci..

[28]  Miaomiao Wang,et al.  Improved particle swarm optimization based approach for bilevel programming problem-an application on supply chain model , 2014, Int. J. Mach. Learn. Cybern..

[29]  Michael N. Vrahatis,et al.  Particle Swarm Optimization and Intelligence: Advances and Applications , 2010 .

[30]  R. Poli An Analysis of Publications on Particle Swarm Optimisation Applications , 2007 .

[31]  Francisco Gortázar,et al.  Path relinking for large-scale global optimization , 2011, Soft Comput..

[32]  Francisco Herrera,et al.  Editorial scalability of evolutionary algorithms and other metaheuristics for large-scale continuous optimization problems , 2011, Soft Comput..

[33]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.