A dynamic multi-objective evolutionary algorithm using a change severity-based adaptive population management strategy

In addition to the need for simultaneously optimizing several competing objectives, many real-world problems are also dynamic in nature. These problems are called dynamic multi-objective optimization problems. Applying evolutionary algorithms to solve dynamic optimization problems has obtained great attention among many researchers. However, most of works are restricted to the single-objective case. In this work, we propose an adaptive hybrid population management strategy using memory, local search and random strategies, to effectively handle environment dynamicity for the multi-objective case where objective functions change over time. Moreover, the proposed strategy is based on a new technique that detects the change severity, according to which it adjusts the number of memory and random solutions to be used. This ensures, on the one hand, a high level of convergence and on the other hand, the required diversity. We propose a dynamic version of the Non dominated Sorting Genetic Algorithm II, within which we integrate the above-mentioned strategies. Empirical results show that our proposal based on the use of the adaptive strategy is able to handle dynamic environments and to track the Pareto front as it changes over time. Moreover, when confronted with several recently proposed dynamic algorithms, it has presented competitive and better results on most problems.

[1]  Julio Ortega Lopera,et al.  Parallel Processing for Multi-objective Optimization in Dynamic Environments , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[2]  Shengxiang Yang,et al.  Genetic Algorithms with Memory- and Elitism-Based Immigrants in Dynamic Environments , 2008, Evolutionary Computation.

[3]  Bin Li,et al.  Investigation of memory-based multi-objective optimization evolutionary algorithm in dynamic environment , 2009, 2009 IEEE Congress on Evolutionary Computation.

[4]  Kalyanmoy Deb,et al.  Dynamic Multi-objective Optimization and Decision-Making Using Modified NSGA-II: A Case Study on Hydro-thermal Power Scheduling , 2007, EMO.

[5]  John J. Grefenstette,et al.  Case-Based Initialization of Genetic Algorithms , 1993, ICGA.

[6]  Zhuhong Zhang,et al.  Multiobjective optimization immune algorithm in dynamic environments and its application to greenhouse control , 2008, Appl. Soft Comput..

[7]  Carlos A. Coello Coello,et al.  Improving PSO-Based Multi-objective Optimization Using Crowding, Mutation and epsilon-Dominance , 2005, EMO.

[8]  Enrique Alba,et al.  Metaheuristics for Dynamic Optimization , 2012, Metaheuristics for Dynamic Optimization.

[9]  Il Hong Suh,et al.  Dynamic multi-objective optimization based on membrane computing for control of time-varying unstable plants , 2011, Inf. Sci..

[10]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[11]  Enrique Alba,et al.  Metaheuristics for Dynamic Vehicle Routing , 2013, Metaheuristics for Dynamic Optimization.

[12]  Changhe Li,et al.  A General Framework of Multipopulation Methods With Clustering in Undetectable Dynamic Environments , 2012, IEEE Transactions on Evolutionary Computation.

[13]  John J. Grefenstette,et al.  Genetic Algorithms for Changing Environments , 1992, PPSN.

[14]  Kay Chen Tan,et al.  A Competitive-Cooperative Coevolutionary Paradigm for Dynamic Multiobjective Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[15]  W. Cedeno,et al.  On the use of niching for dynamic landscapes , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[16]  Andries Petrus Engelbrecht,et al.  Benchmarks for dynamic multi-objective optimisation algorithms , 2014, CSUR.

[17]  Bin Li,et al.  Multi-strategy ensemble evolutionary algorithm for dynamic multi-objective optimization , 2010, Memetic Comput..

[18]  Carlos A. Coello Coello,et al.  HCS: A New Local Search Strategy for Memetic Multiobjective Evolutionary Algorithms , 2010, IEEE Transactions on Evolutionary Computation.

[19]  R.W. Morrison,et al.  Triggered hypermutation revisited , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[20]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[21]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[22]  Shengxiang Yang,et al.  Environment identification-based memory scheme for estimation of distribution algorithms in dynamic environments , 2011, Soft Comput..

[23]  Lamjed Ben Said,et al.  A Multiple Reference Point-based evolutionary algorithm for dynamic multi-objective optimization with undetectable changes , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[24]  Jingxuan Wei,et al.  A novel particle swarm optimization algorithm with local search for dynamic constrained multi-objective optimization problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[25]  Paolo Amato,et al.  An ALife-Inspired Evolutionary Algorithm for Dynamic Multiobjective Optimization Problems , 2005 .

[26]  Bernhard Sendhoff,et al.  Constructing Dynamic Optimization Test Problems Using the Multi-objective Optimization Concept , 2004, EvoWorkshops.

[27]  Xin Yao,et al.  Population-Based Incremental Learning With Associative Memory for Dynamic Environments , 2008, IEEE Transactions on Evolutionary Computation.

[28]  David Wallace,et al.  Dynamic multi-objective optimization with evolutionary algorithms: a forward-looking approach , 2006, GECCO.

[29]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[30]  Lin Li,et al.  Quantum immune clonal coevolutionary algorithm for dynamic multiobjective optimization , 2014, Soft Comput..

[31]  Peter A. N. Bosman Learning and Anticipation in Online Dynamic Optimization , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[32]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[33]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[34]  Hendrik Richter,et al.  Dynamic Fitness Landscape Analysis , 2013 .

[35]  Kalyanmoy Deb,et al.  Dynamic multiobjective optimization problems: test cases, approximations, and applications , 2004, IEEE Transactions on Evolutionary Computation.

[36]  David W. Coit,et al.  Multi-objective optimization using genetic algorithms: A tutorial , 2006, Reliab. Eng. Syst. Saf..

[37]  Jürgen Branke,et al.  Multiswarms, exclusion, and anti-convergence in dynamic environments , 2006, IEEE Transactions on Evolutionary Computation.

[38]  Mark Wineberg,et al.  The Shifting Balance Genetic Algorithm: improving the GA in a dynamic environment , 1999 .

[39]  Kay Chen Tan,et al.  A predictive gradient strategy for multiobjective evolutionary algorithms in a fast changing environment , 2010, Memetic Comput..

[40]  Lamjed Ben Said,et al.  Multi-objective Optimization with Dynamic Constraints and Objectives: New Challenges for Evolutionary Algorithms , 2015, GECCO.

[41]  Helen G. Cobb,et al.  An Investigation into the Use of Hypermutation as an Adaptive Operator in Genetic Algorithms Having Continuous, Time-Dependent Nonstationary Environments , 1990 .

[42]  Rasmus K. Ursem,et al.  Multinational GAs: Multimodal Optimization Techniques in Dynamic Environments , 2000, GECCO.

[43]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[44]  Qingfu Zhang,et al.  Prediction-Based Population Re-initialization for Evolutionary Dynamic Multi-objective Optimization , 2007, EMO.

[45]  Steven Guan,et al.  Evolving Dynamic Multi-Objective Optimization Problems with Objective Replacement , 2005, Artificial Intelligence Review.

[46]  Qingfu Zhang,et al.  A Population Prediction Strategy for Evolutionary Dynamic Multiobjective Optimization , 2014, IEEE Transactions on Cybernetics.