Quantum firefly swarms for multimodal dynamic optimization problems

Abstract Optimization problems have attracted attention of researchers for decades. Commonly, problem related data and problem domain are assumed to be exactly known beforehand and to remain stationary. However, numerous real life optimization problems are dynamic. In practice, unpredictable events like due date changes, arrivals of new jobs or cancellations yield to changes in parameters, constraints or variables. In addition to the challenges of traditional stationary optimization problems, diverse parts of the problem space should also be monitored to keep track of moving optima in dynamic problems. Therefore, dividing a population (swarm) into smaller sized sub-swarms is a promising strategy particularly for multi-modal problems. In this context, the present work extends Firefly Algorithm (FA) as a multi-population based algorithm to solve multi-modal dynamic optimization problems due to its popularity and demonstrated competitive performance. Quantum particles are employed to monitor the neighborhoods of the best solutions of each sub-swarm in order to overcome the loss of diversity problem. Quantum strategy is also used to respond to dynamic events. Moreover, economical FA along with a simpler move function is introduced in order to consume fitness evaluations more efficiently. Most of the previous approaches ignore prioritizing sub-swarms which can be advantageous. For example, sub-swarms can either be evolved sequentially, randomly or they can be prioritized via some learning-based techniques. Thus, more promising regions might be discovered at earlier evaluations. In this context, the proposed FA extension is further enhanced with such prioritizing strategies, which are based on the feedback from sub-swarms. The experiments are conducted on the well-known Moving Peaks Benchmark along with comparisons with well-known methods. The proposed FA is found as promising and competitive according to the outcomes of the comprehensive experimental study.

[1]  Hartmut Schmeck,et al.  Designing evolutionary algorithms for dynamic optimization problems , 2003 .

[2]  Changhe Li,et al.  Fast Multi-Swarm Optimization for Dynamic Optimization Problems , 2008, 2008 Fourth International Conference on Natural Computation.

[3]  Adil Baykasoglu,et al.  Dynamic optimization in binary search spaces via weighted superposition attraction algorithm , 2018, Expert Syst. Appl..

[4]  Xiaodong Li,et al.  Adaptively Choosing Neighbourhood Bests Using Species in a Particle Swarm Optimizer for Multimodal Function Optimization , 2004, GECCO.

[5]  Russell C. Eberhart,et al.  Adaptive particle swarm optimization: detection and response to dynamic systems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[6]  John J. Grefenstette,et al.  Genetic Algorithms for Changing Environments , 1992, PPSN.

[7]  Adil Baykasoglu,et al.  An improved firefly algorithm for solving dynamic multidimensional knapsack problems , 2014, Expert Syst. Appl..

[8]  Shengxiang Yang,et al.  Genetic Algorithms with Memory- and Elitism-Based Immigrants in Dynamic Environments , 2008, Evolutionary Computation.

[9]  Kalmanje Krishnakumar,et al.  Micro-Genetic Algorithms For Stationary And Non-Stationary Function Optimization , 1990, Other Conferences.

[10]  M. W. Mustafa,et al.  Optimal allocation and sizing of Distributed Generation in distribution system via Firefly Algorithm , 2012, 2012 IEEE International Power Engineering and Optimization Conference Melaka, Malaysia.

[11]  Mohammad Reza Meybodi,et al.  CellularDE: A Cellular Based Differential Evolution for Dynamic Optimization Problems , 2011, ICANNGA.

[12]  Xiaodong Li,et al.  Adaptively choosing niching parameters in a PSO , 2006, GECCO.

[13]  Shengxiang Yang,et al.  Memory Based on Abstraction for Dynamic Fitness Functions , 2008, EvoWorkshops.

[14]  A. Kai Qin,et al.  Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[15]  Mohammad Reza Meybodi,et al.  CDEPSO: a bi-population hybrid approach for dynamic optimization problems , 2014, Applied Intelligence.

[16]  Mohammad Reza Meybodi,et al.  Cellular PSO: A PSO for Dynamic Environments , 2009, ISICA.

[17]  Salwani Abdullah,et al.  A multi-population harmony search algorithm with external archive for dynamic optimization problems , 2014, Inf. Sci..

[18]  Tim M. Blackwell,et al.  Swarms in Dynamic Environments , 2003, GECCO.

[19]  Carlos Cruz Corona,et al.  Simple control rules in a cooperative system for dynamic optimisation problems , 2009, Int. J. Gen. Syst..

[20]  Shengxiang Yang,et al.  A self-organizing random immigrants genetic algorithm for dynamic optimization problems , 2007, Genetic Programming and Evolvable Machines.

[21]  Shengxiang Yang,et al.  Learning behavior in abstract memory schemes for dynamic optimization problems , 2009, Soft Comput..

[22]  Janez Brest,et al.  Self-Adaptive Differential Evolution Algorithm in Constrained Real-Parameter Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[23]  Adil Baykasoglu,et al.  A multi-population firefly algorithm for dynamic optimization problems , 2015, 2015 IEEE International Conference on Evolving and Adaptive Intelligent Systems (EAIS).

[24]  Shigeyoshi Tsutsui,et al.  Forking Genetic Algorithms: GAs with Search Space Division Schemes , 1997, Evolutionary Computation.

[25]  Adil Baykasoglu,et al.  Evolutionary and population-based methods versus constructive search strategies in dynamic combinatorial optimization , 2017, Inf. Sci..

[26]  Andries Petrus Engelbrecht,et al.  Differential evolution for dynamic environments with unknown numbers of optima , 2013, J. Glob. Optim..

[27]  Xiaodong Li,et al.  Using regression to improve local convergence , 2007, 2007 IEEE Congress on Evolutionary Computation.

[28]  Graham Kendall,et al.  An adaptive multi-population artificial bee colony algorithm for dynamic optimisation problems , 2016, Knowl. Based Syst..

[29]  Ming Yang,et al.  An Adaptive Multi-Swarm Optimizer for Dynamic Optimization Problems , 2014, Evolutionary Computation.

[30]  Mohammad Reza Meybodi,et al.  Speciation based firefly algorithm for optimization in dynamic environments , 2012 .

[31]  Ronald W. Morrison,et al.  Designing Evolutionary Algorithms for Dynamic Environments , 2004, Natural Computing Series.

[32]  Changhe Li,et al.  A survey of swarm intelligence for dynamic optimization: Algorithms and applications , 2017, Swarm Evol. Comput..

[33]  Helen G. Cobb,et al.  An Investigation into the Use of Hypermutation as an Adaptive Operator in Genetic Algorithms Having Continuous, Time-Dependent Nonstationary Environments , 1990 .

[34]  Min Huang,et al.  Artificial Bee Colony Optimizer Based on Bee Life-Cycle for Stationary and Dynamic Optimization , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[35]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[36]  Changhe Li,et al.  A clustering particle swarm optimizer for dynamic optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[37]  A. Sima Etaner-Uyar,et al.  A new population based adaptive domination change mechanism for diploid genetic algorithms in dynamic environments , 2005, Soft Comput..

[38]  R. K. Ursem Multinational evolutionary algorithms , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[39]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[40]  A. Sima Etaner-Uyar,et al.  The Memory Indexing Evolutionary Algorithm for Dynamic Environments , 2005, EvoWorkshops.

[41]  Hui Cheng,et al.  Genetic Algorithms With Immigrants and Memory Schemes for Dynamic Shortest Path Routing Problems in Mobile Ad Hoc Networks , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[42]  Swagatam Das,et al.  Cluster-based differential evolution with Crowding Archive for niching in dynamic environments , 2014, Inf. Sci..

[43]  Changhe Li,et al.  A Clustering Particle Swarm Optimizer for Locating and Tracking Multiple Optima in Dynamic Environments , 2010, IEEE Transactions on Evolutionary Computation.

[44]  David E. Goldberg,et al.  Nonstationary Function Optimization Using Genetic Algorithms with Dominance and Diploidy , 1987, ICGA.

[45]  Salwani Abdullah,et al.  A multi-population electromagnetic algorithm for dynamic optimisation problems , 2014, Appl. Soft Comput..

[46]  Hendrik Richter Memory Design for Constrained Dynamic Optimization Problems , 2010, EvoApplications.

[47]  Jürgen Branke,et al.  Multiswarms, exclusion, and anti-convergence in dynamic environments , 2006, IEEE Transactions on Evolutionary Computation.

[48]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[49]  Christoph F. Eick,et al.  Supporting Polyploidy in Genetic Algorithms Using Dominance Vectors , 1997, Evolutionary Programming.

[50]  Shengxiang Yang,et al.  A memetic algorithm with adaptive hill climbing strategy for dynamic optimization problems , 2009, Soft Comput..

[51]  Mohammad Reza Meybodi,et al.  A New Particle Swarm Optimization Algorithm for Dynamic Environments , 2010, SEMCCO.

[52]  Salwani Abdullah,et al.  A dual-population multi operators harmony search algorithm for dynamic optimization problems , 2018, Comput. Ind. Eng..

[53]  Martin Middendorf,et al.  A Hierarchical Particle Swarm Optimizer for Dynamic Optimization Problems , 2004, EvoWorkshops.

[54]  Jinde Cao,et al.  Leader-Following Consensus of Nonlinear Multiagent Systems With Stochastic Sampling , 2017, IEEE Transactions on Cybernetics.

[55]  Amir Nakib,et al.  A multiple local search algorithm for continuous dynamic optimization , 2013, J. Heuristics.

[56]  Janez Brest,et al.  A comprehensive review of firefly algorithms , 2013, Swarm Evol. Comput..

[57]  Carlos Cruz,et al.  Optimization in dynamic environments: a survey on problems, methods and measures , 2011, Soft Comput..

[58]  Bin Li,et al.  Multi-strategy ensemble particle swarm optimization for dynamic optimization , 2008, Inf. Sci..

[59]  Peter J. Bentley,et al.  Dynamic Search With Charged Swarms , 2002, GECCO.

[60]  Mohammad Reza Meybodi,et al.  A hibernating multi-swarm optimization algorithm for dynamic environments , 2010, 2010 Second World Congress on Nature and Biologically Inspired Computing (NaBIC).

[61]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[62]  Andries Petrus Engelbrecht,et al.  Using Competitive Population Evaluation in a differential evolution algorithm for dynamic environments , 2012, Eur. J. Oper. Res..

[63]  Jürgen Branke,et al.  Multi-swarm Optimization in Dynamic Environments , 2004, EvoWorkshops.

[64]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[65]  Haluk Topcuoglu,et al.  Impact of sensor-based change detection schemes on the performance of evolutionary dynamic optimization techniques , 2018, Soft Comput..

[66]  Alberto García-Villoria,et al.  Introducing dynamic diversity into a discrete particle swarm optimization , 2009, Comput. Oper. Res..

[67]  Mohammad Mehdi Ebadzadeh,et al.  History-Driven Particle Swarm Optimization in dynamic and uncertain environments , 2016, Neurocomputing.

[68]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[69]  Xin Yao,et al.  Experimental study on population-based incremental learning algorithms for dynamic optimization problems , 2005, Soft Comput..

[70]  Jürgen Branke,et al.  A Multi-population Approach to Dynamic Optimization Problems , 2000 .

[71]  M. Carmen Garrido,et al.  Facing dynamic optimization using a cooperative metaheuristic configured via fuzzy logic and SVMs , 2011, Appl. Soft Comput..

[72]  Xiaodong Li,et al.  This article has been accepted for inclusion in a future issue. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 Locating and Tracking Multiple Dynamic Optima by a Particle Swarm Model Using Speciation , 2022 .

[73]  Arvind S. Mohais,et al.  DynDE: a differential evolution for dynamic optimization problems , 2005, 2005 IEEE Congress on Evolutionary Computation.

[74]  Haluk Topcuoglu,et al.  A hyper-heuristic based framework for dynamic optimization problems , 2014, Appl. Soft Comput..

[75]  Xiaodong Li,et al.  Particle Swarms for Dynamic Optimization Problems , 2008, Swarm Intelligence.

[76]  Mohammad Reza Meybodi,et al.  An adaptive bi-flight cuckoo search with variable nests for continuous dynamic optimization problems , 2017, Applied Intelligence.

[77]  Souham Meshoul,et al.  WD2O: a novel wind driven dynamic optimization approach with effective change detection , 2017, Applied Intelligence.

[78]  Mohammad Reza Meybodi,et al.  novel multi-swarm algorithm for optimization in dynamic environments based n particle swarm optimization , 2013 .

[79]  Xiaodong Li,et al.  Particle swarm with speciation and adaptation in a dynamic environment , 2006, GECCO.

[80]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[81]  Seid H. Pourtakdoust,et al.  A new hybrid approach for dynamic continuous optimization problems , 2012, Appl. Soft Comput..

[82]  Ponnuthurai N. Suganthan,et al.  Evolutionary programming with ensemble of explicit memories for dynamic optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[83]  Gary G. Yen,et al.  Dynamic Evolutionary Algorithm With Variable Relocation , 2009, IEEE Transactions on Evolutionary Computation.

[84]  Shengxiang Yang,et al.  Associative Memory Scheme for Genetic Algorithms in Dynamic Environments , 2006, EvoWorkshops.

[85]  Erik D. Goodman,et al.  A neighbor-based learning particle swarm optimizer with short-term and long-term memory for dynamic optimization problems , 2018, Inf. Sci..

[86]  Shengxiang Yang,et al.  On the Design of Diploid Genetic Algorithms for Problem Optimization in Dynamic Environments , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[87]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[88]  Jenny Fajardo Calderín,et al.  Algorithm portfolio based scheme for dynamic optimization problems , 2015, Int. J. Comput. Intell. Syst..