A novel hybrid adaptive collaborative approach based on particle swarm optimization and local search for dynamic optimization problems

We propose a hybrid collaborative model based on fuzzy social-only particle swarm optimization and local search methods for dynamic optimization problems.We examine the performance of the proposed model on moving peaks benchmark (MPB) which is one of the most widely used benchmarks in the literature.We further extend the basic algorithm using novel resource management schemes, i.e. competition and hibernation, to improve the performance of the basic model.We investigate the influence of different components and parameters on the performance of the proposed algorithms.We propose the performance comparison between the proposed method and several well-known and recently proposed models. This paper proposes a novel hybrid approach based on particle swarm optimization and local search, named PSOLS, for dynamic optimization problems. In the proposed approach, a swarm of particles with fuzzy social-only model is frequently applied to estimate the location of the peaks in the problem landscape. Upon convergence of the swarm to previously undetected positions in the search space, a local search agent (LSA) is created to exploit the respective region. Moreover, a density control mechanism is introduced to prevent too many LSAs crowding in the search space. Three adaptations to the basic approach are then proposed to manage the function evaluations in the way that are mostly allocated to the most promising areas of the search space. The first adapted algorithm, called HPSOLS, is aimed at improving PSOLS by stopping the local search in LSAs that are not contributing much to the search process. The second adapted, algorithm called CPSOLS, is a competitive algorithm which allocates extra function evaluations to the best performing LSA. The third adapted algorithm, called CHPSOLS, combines the fundamental ideas of HPSOLS and CPSOLS in a single algorithm. An extensive set of experiments is conducted on a variety of dynamic environments, generated by the moving peaks benchmark, to evaluate the performance of the proposed approach. Results are also compared with those of other state-of-the-art algorithms from the literature. The experimental results indicate the superiority of the proposed approach.

[1]  Mohammad Reza Meybodi,et al.  Speciation based firefly algorithm for optimization in dynamic environments , 2012 .

[2]  Mohammad Reza Meybodi,et al.  Adaptive Particle Swarm Optimization Algorithm in Dynamic Environments , 2011, 2011 Third International Conference on Computational Intelligence, Modelling & Simulation.

[3]  Salwani Abdullah,et al.  A multi-population harmony search algorithm with external archive for dynamic optimization problems , 2014, Inf. Sci..

[4]  Shengxiang Yang,et al.  A particle swarm optimization based memetic algorithm for dynamic optimization problems , 2010, Natural Computing.

[5]  Dumitru Dumitrescu,et al.  A collaborative model for tracking optima in dynamic environments , 2007, 2007 IEEE Congress on Evolutionary Computation.

[6]  Hartmut Schmeck,et al.  Designing evolutionary algorithms for dynamic optimization problems , 2003 .

[7]  Dumitru Dumitrescu,et al.  Evolutionary swarm cooperative optimization in dynamic environments , 2009, Natural Computing.

[8]  Mohammad Reza Meybodi,et al.  mNAFSA: A novel approach for optimization in dynamic environments with global changes , 2014, Swarm Evol. Comput..

[9]  Lisa Ann Osadciw,et al.  Density estimation using a new dimension adaptive particle swarm optimization algorithm , 2009, Swarm Intelligence.

[10]  Jürgen Branke,et al.  Multiswarms, exclusion, and anti-convergence in dynamic environments , 2006, IEEE Transactions on Evolutionary Computation.

[11]  Ponnuthurai N. Suganthan,et al.  A Distance-Based Locally Informed Particle Swarm Model for Multimodal Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[12]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[13]  M. R. Meybodi,et al.  A multi-role cellular PSO for dynamic environments , 2009, 2009 14th International CSI Computer Conference.

[14]  Changhe Li,et al.  A Clustering Particle Swarm Optimizer for Locating and Tracking Multiple Optima in Dynamic Environments , 2010, IEEE Transactions on Evolutionary Computation.

[15]  Gillian Dobbie,et al.  Research on particle swarm optimization based clustering: A systematic review of literature and techniques , 2014, Swarm Evol. Comput..

[16]  Shengxiang Yang,et al.  A memetic particle swarm optimisation algorithm for dynamic multi-modal optimisation problems , 2012, Int. J. Syst. Sci..

[17]  Mohammad Mehdi Ebadzadeh,et al.  A novel particle swarm optimization algorithm with adaptive inertia weight , 2011, Appl. Soft Comput..

[18]  Shengxiang Yang,et al.  Triggered Memory-Based Swarm Optimization in Dynamic Environments , 2007, EvoWorkshops.

[19]  Changhe Li,et al.  A General Framework of Multipopulation Methods With Clustering in Undetectable Dynamic Environments , 2012, IEEE Transactions on Evolutionary Computation.

[20]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[21]  Shengxiang Yang,et al.  Particle Swarm Optimization With Composite Particles in Dynamic Environments , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Mohammad Reza Meybodi,et al.  novel multi-swarm algorithm for optimization in dynamic environments based n particle swarm optimization , 2013 .

[23]  Sanjib Ganguly,et al.  Multi-objective planning of electrical distribution systems incorporating sectionalizing switches and tie-lines using particle swarm optimization , 2012, Swarm Evol. Comput..

[24]  Russell C. Eberhart,et al.  Adaptive particle swarm optimization: detection and response to dynamic systems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[25]  Mohammad Reza Meybodi,et al.  Two phased cellular PSO: A new collaborative cellular algorithm for optimization in dynamic environments , 2012, 2012 IEEE Congress on Evolutionary Computation.

[26]  Mohammad Reza Meybodi,et al.  A New Particle Swarm Optimization Algorithm for Dynamic Environments , 2010, SEMCCO.

[27]  Mohammad Reza Meybodi,et al.  A note on the paper "A multi-population harmony search algorithm with external archive for dynamic optimization problems" by Turky and Abdullah , 2014, Inf. Sci..

[28]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer for noisy and dynamic environments , 2006, Genetic Programming and Evolvable Machines.

[29]  Mohammad Reza Meybodi,et al.  A new artificial fish swarm algorithm for dynamic optimization problems , 2012, 2012 IEEE Congress on Evolutionary Computation.

[30]  Girolamo Fornarelli,et al.  An unsupervised multi-swarm clustering technique for image segmentation , 2013, Swarm Evol. Comput..

[31]  Zbigniew Michalewicz,et al.  Searching for optima in non-stationary environments , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[32]  Mohammad Mehdi Ebadzadeh,et al.  A competitive clustering particle swarm optimizer for dynamic optimization problems , 2012, Swarm Intelligence.

[33]  Tim Blackwell,et al.  Particle Swarm Optimization in Dynamic Environments , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[34]  Xiaodong Li,et al.  Particle Swarms for Dynamic Optimization Problems , 2008, Swarm Intelligence.

[35]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[36]  Peter J. Bentley,et al.  Don't push me! Collision-avoiding swarms , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[37]  Salwani Abdullah,et al.  A multi-population electromagnetic algorithm for dynamic optimisation problems , 2014, Appl. Soft Comput..

[38]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[39]  Andries Petrus Engelbrecht,et al.  Training feedforward neural networks with dynamic particle swarm optimisation , 2012, Swarm Intelligence.

[40]  Andries Petrus Engelbrecht,et al.  Differential evolution for dynamic environments with unknown numbers of optima , 2013, J. Glob. Optim..

[41]  Swagatam Das,et al.  A Cluster-Based Differential Evolution Algorithm With External Archive for Optimization in Dynamic Environments , 2013, IEEE Transactions on Cybernetics.

[42]  Jianwei Li,et al.  A two-swarm cooperative particle swarms optimization , 2014, Swarm Evol. Comput..

[43]  Xiaodong Li,et al.  This article has been accepted for inclusion in a future issue. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 Locating and Tracking Multiple Dynamic Optima by a Particle Swarm Model Using Speciation , 2022 .

[44]  M. A. El-Shorbagy,et al.  Local search based hybrid particle swarm optimization algorithm for multiobjective optimization , 2012, Swarm Evol. Comput..

[45]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[46]  Mohammad Reza Meybodi,et al.  A hibernating multi-swarm optimization algorithm for dynamic environments , 2010, 2010 Second World Congress on Nature and Biologically Inspired Computing (NaBIC).

[47]  Andries Petrus Engelbrecht,et al.  Using Competitive Population Evaluation in a differential evolution algorithm for dynamic environments , 2012, Eur. J. Oper. Res..

[48]  Seid H. Pourtakdoust,et al.  A new hybrid approach for dynamic continuous optimization problems , 2012, Appl. Soft Comput..

[49]  Changhe Li,et al.  Benchmark generator for the IEEE WCCI-2012 competition on evolutionary computation for dynamic optimization problems. Technical Report 2011. , 2011 .

[50]  Shengxiang Yang,et al.  Evolutionary dynamic optimization: A survey of the state of the art , 2012, Swarm Evol. Comput..

[51]  Mohammad Reza Meybodi,et al.  CDEPSO: a bi-population hybrid approach for dynamic optimization problems , 2014, Applied Intelligence.

[52]  Mohammad Reza Meybodi,et al.  Cellular PSO: A PSO for Dynamic Environments , 2009, ISICA.

[54]  Carlos Cruz Corona,et al.  Efficient multi-swarm PSO algorithms for dynamic environments , 2011, Memetic Comput..