A Distributed Multiple Populations Framework for Evolutionary Algorithm in Solving Dynamic Optimization Problems

Aiming to dynamic optimization problems (DOPs), this paper develops a novel general distributed multiple populations (DMP) framework for evolutionary algorithms (EAs). DMP employs six strategies designed in three levels (i.e., population-level, subpopulation-level, and individual-level) to deal with different kinds of DOPs. First, the population-level subpopulation division estimation strategy in initialization phase rationally divides the whole population into several subpopulations to explore distinct subareas of search space sufficiently. Then, during the steady evolutionary process, diversity preservation in individual-level and population-level accelerates the responsiveness of the whole population to a new landscape, while subpopulation-level self-learning of elitist individuals promotes the exploitation of promising areas. Moreover, in subpopulation-level, the archive quality assurance technique avoids repeat exploring the same peaks by storing the locations of different peaks with low redundancy. When landscape variation occurs, in population-level, historical information containing excellent evolutionary pattern is recorded to guide the population evolution better in the new environment. DMP framework is easy to implement in various EAs due to its well generality and independence about operators and parameters of the embedded algorithm. Four DMP-EAs are accomplished in this paper whose basic algorithms are particle swarm optimization (PSO) and differential evolution (DE) with different settings. The performance of the four proposed DMP-EAs is evaluated on all the widely used complex DOP benchmarks from CEC 2009. The testing results indicate that the DMP-EAs generally significantly outperform many state-of-the-art dynamic EAs (DEAs) on most of DOP benchmarks.

[1]  Jun Zhang,et al.  Competitive and cooperative particle swarm optimization with information sharing mechanism for global optimization problems , 2015, Inf. Sci..

[2]  Changhe Li,et al.  A General Framework of Multipopulation Methods With Clustering in Undetectable Dynamic Environments , 2012, IEEE Transactions on Evolutionary Computation.

[3]  Kwok-Wo Wong,et al.  An improved particle swarm optimization algorithm combined with piecewise linear chaotic map , 2007, Appl. Math. Comput..

[4]  Xiaohua Jia,et al.  Power Metering for Virtual Machine in Cloud Computing-Challenges and Opportunities , 2014, IEEE Access.

[5]  Jun Zhang,et al.  Fast Micro-Differential Evolution for Topological Active Net Optimization , 2016, IEEE Transactions on Cybernetics.

[6]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[7]  Bin Li,et al.  Multi-strategy ensemble particle swarm optimization for dynamic optimization , 2008, Inf. Sci..

[8]  Guolong Chen,et al.  A PSO-Optimized Real-Time Fault-Tolerant Task Allocation Algorithm in Wireless Sensor Networks , 2015, IEEE Transactions on Parallel and Distributed Systems.

[9]  Robert L. Smith,et al.  Simulated annealing for constrained global optimization , 1994, J. Glob. Optim..

[10]  Jie Zhang,et al.  Coevolutionary Particle Swarm Optimization With Bottleneck Objective Learning Strategy for Many-Objective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[11]  Kalmanje Krishnakumar,et al.  Micro-Genetic Algorithms For Stationary And Non-Stationary Function Optimization , 1990, Other Conferences.

[12]  Gary G. Yen,et al.  Dynamic Evolutionary Algorithm With Variable Relocation , 2009, IEEE Transactions on Evolutionary Computation.

[13]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[14]  Erik D. Goodman,et al.  A neighbor-based learning particle swarm optimizer with short-term and long-term memory for dynamic optimization problems , 2018, Inf. Sci..

[15]  S. Tsutsui,et al.  Function optimization in nonstationary environment using steady state genetic algorithms with aging of individuals , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[16]  Dumitru Dumitrescu,et al.  A collaborative model for tracking optima in dynamic environments , 2007, 2007 IEEE Congress on Evolutionary Computation.

[17]  Shengxiang Yang,et al.  Analysis of fitness landscape modifications in evolutionary dynamic optimization , 2014, Inf. Sci..

[18]  Wei Luo,et al.  Improved Differential Evolution With a Modified Orthogonal Learning Strategy , 2017, IEEE Access.

[19]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[20]  René Thomsen,et al.  Multimodal optimization using crowding-based differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[21]  Xiaodong Li,et al.  Adaptively choosing niching parameters in a PSO , 2006, GECCO.

[22]  Jürgen Branke,et al.  Multiswarms, exclusion, and anti-convergence in dynamic environments , 2006, IEEE Transactions on Evolutionary Computation.

[23]  Jason Gu,et al.  Solution of an Economic Dispatch Problem Through Particle Swarm Optimization: A Detailed Survey – Part II , 2017, IEEE Access.

[24]  Shinn-Ying Ho,et al.  OPSO: Orthogonal Particle Swarm Optimization and Its Application to Task Assignment Problems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[25]  Tzuu-Hseng S. Li,et al.  Development of an Automatic Emotional Music Accompaniment System by Fuzzy Logic and Adaptive Partition Evolutionary Genetic Algorithm , 2015, IEEE Access.

[26]  Dongrui Fan,et al.  An Evolutionary Technique for Performance-Energy-Temperature Optimized Scheduling of Parallel Tasks on Multi-Core Processors , 2016, IEEE Transactions on Parallel and Distributed Systems.

[27]  Jun Zhang,et al.  Adaptive particle swarm optimization with variable relocation for dynamic optimization problems , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[28]  Krzysztof Trojanowski,et al.  Immune-based algorithms for dynamic optimization , 2009, Inf. Sci..

[29]  Xin Yao,et al.  Benchmark Generator for CEC'2009 Competition on Dynamic Optimization , 2008 .

[30]  Jürgen Branke,et al.  A Multi-population Approach to Dynamic Optimization Problems , 2000 .

[31]  Carlos A. Coello Coello,et al.  A T-cell algorithm for solving dynamic optimization problems , 2011, Inf. Sci..

[32]  Jun Zhang,et al.  Dual-Strategy Differential Evolution With Affinity Propagation Clustering for Multimodal Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[33]  Jun Zhang,et al.  Cloudde: A Heterogeneous Differential Evolution Algorithm and Its Distributed Cloud Version , 2017, IEEE Transactions on Parallel and Distributed Systems.

[34]  Andries Petrus Engelbrecht,et al.  A novel particle swarm niching technique based on extensive vector operations , 2010, Natural Computing.

[35]  Manu Vardhan,et al.  Cost Effective Genetic Algorithm for Workflow Scheduling in Cloud Under Deadline Constraint , 2016, IEEE Access.

[36]  Meie Shen,et al.  Differential Evolution With Two-Level Parameter Adaptation , 2014, IEEE Transactions on Cybernetics.

[37]  Marjan Kaedi,et al.  Biasing the transition of Bayesian optimization algorithm between Markov chain states in dynamic environments , 2016, Inf. Sci..

[38]  Jun Zhang,et al.  An Efficient Ant Colony System Based on Receding Horizon Control for the Aircraft Arrival Sequencing and Scheduling Problem , 2010, IEEE Transactions on Intelligent Transportation Systems.

[39]  Yan Zhang,et al.  An Integrated Optimization+ Learning Approach to Optimal Dynamic Pricing for the Retailer with Multi-type Customers in Smart Grids , 2016, Inf. Sci..

[40]  Jiannong Cao,et al.  Multiple Populations for Multiple Objectives: A Coevolutionary Technique for Solving Multiobjective Optimization Problems , 2013, IEEE Transactions on Cybernetics.

[41]  Ming Yang,et al.  Multi-population methods in unconstrained continuous dynamic environments: The challenges , 2015, Inf. Sci..

[42]  Janez Brest,et al.  Differential evolution and differential ant-stigmergy on dynamic optimisation problems , 2013, Int. J. Syst. Sci..

[43]  Bernhard Sendhoff,et al.  Constructing Dynamic Optimization Test Problems Using the Multi-objective Optimization Concept , 2004, EvoWorkshops.

[44]  Ming Yang,et al.  An Adaptive Multipopulation Framework for Locating and Tracking Multiple Optima , 2016, IEEE Transactions on Evolutionary Computation.

[45]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[46]  Adil Baykasoglu,et al.  Evolutionary and population-based methods versus constructive search strategies in dynamic combinatorial optimization , 2017, Inf. Sci..

[47]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[48]  David E. Goldberg,et al.  Nonstationary Function Optimization Using Genetic Algorithms with Dominance and Diploidy , 1987, ICGA.

[49]  John J. Grefenstette,et al.  Genetic Algorithms for Tracking Changing Environments , 1993, ICGA.

[50]  Ming Yang,et al.  An Adaptive Multi-Swarm Optimizer for Dynamic Optimization Problems , 2014, Evolutionary Computation.

[51]  Shengxiang Yang,et al.  Particle Swarm Optimization With Composite Particles in Dynamic Environments , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[52]  Luyi Shen,et al.  Multi-swarm Optimization with Chaotic Mapping for Dynamic Optimization Problems , 2015, 2015 8th International Symposium on Computational Intelligence and Design (ISCID).

[53]  Tianlong Gu,et al.  Historical and Heuristic-Based Adaptive Differential Evolution , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[54]  Kok Cheong Wong,et al.  A New Diploid Scheme and Dominance Change Mechanism for Non-Stationary Function Optimization , 1995, ICGA.

[55]  Swagatam Das,et al.  A Cluster-Based Differential Evolution Algorithm With External Archive for Optimization in Dynamic Environments , 2013, IEEE Transactions on Cybernetics.

[56]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, ANTS Conference.

[57]  Swagatam Das,et al.  Cluster-based differential evolution with Crowding Archive for niching in dynamic environments , 2014, Inf. Sci..

[58]  Jun Zhang,et al.  Multiobjective Cloud Workflow Scheduling: A Multiple Populations Ant Colony System Approach , 2019, IEEE Transactions on Cybernetics.

[59]  Swagatam Das,et al.  An Adaptive Differential Evolution Algorithm for Global Optimization in Dynamic Environments , 2014, IEEE Transactions on Cybernetics.

[60]  Stergios I. Roumeliotis,et al.  A Multi-Objective Exploration Strategy for Mobile Robots Under Operational Constraints , 2013, IEEE Access.

[61]  Janez Brest,et al.  Dynamic optimization using Self-Adaptive Differential Evolution , 2009, 2009 IEEE Congress on Evolutionary Computation.

[62]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[63]  Agostinho C. Rosa,et al.  A comparative study on the performance of dissortative mating and immigrants-based strategies for evolutionary dynamic optimization , 2011, Inf. Sci..

[64]  Salwani Abdullah,et al.  A multi-population harmony search algorithm with external archive for dynamic optimization problems , 2014, Inf. Sci..

[65]  Tung-Kuan Liu,et al.  Solving the Flexible Job Shop Scheduling Problem With Makespan Optimization by Using a Hybrid Taguchi-Genetic Algorithm , 2015, IEEE Access.

[66]  Terence C. Fogarty,et al.  A Genetic Algorithm with Variable Range of Local Search for Tracking Changing Environments , 1996, PPSN.

[67]  Tung-Kuan Liu,et al.  Solving Distributed and Flexible Job-Shop Scheduling Problems for a Real-World Fastener Manufacturer , 2014, IEEE Access.

[68]  Liqun Liu,et al.  Heterogeneous Differential Evolution with Memory Enhanced Brownian and Quantum Individuals for Dynamic Optimization Problems , 2018, Int. J. Pattern Recognit. Artif. Intell..

[69]  Zhiwen Yu,et al.  Orthogonal learning particle swarm optimization with variable relocation for dynamic optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).