The effect of diversity maintenance on prediction in dynamic multi-objective optimization

Abstract There are many dynamic multi-objective optimization problems (DMOPs) in real-life engineering applications whose objectives change over time. After an environmental change occurs, prediction strategies are commonly used in dynamic multi-objective optimization algorithms to find the new Pareto optimal set (POS). Being able to make more accurate prediction means the algorithm requires fewer computational resources to make the population approximate to the Pareto optimal front (POF). This paper proposes a hybrid diversity maintenance method to improve prediction accuracy. The method consists of three steps, which are implemented after an environmental change. The first step, based on the moving direction of the center points, uses the prediction to relocate a number of solutions close to the new Pareto front. On the basis of self-defined minimum and maximum points of the POS in this paper, the second step applies the gradual search to produce some well-distributed solutions in the decision space so as to compensate for the inaccuracy of the first step, simultaneously and further enhancing the convergence and diversity of the population. In the third step, some diverse individuals are randomly generated within the region of next probable POS, which prompts the diversity of the population. Eventually the prediction becomes more accurate as the solutions with good convergence and diversity are selected after the non-dominated sort [1] on the combined solutions generated by the three steps. Compared with three other prediction methods on a series of test instances, our method is very competitive in convergence and diversity as well as the speed at which it responds to environmental changes.

[1]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[2]  Lin Li,et al.  Quantum immune clonal coevolutionary algorithm for dynamic multiobjective optimization , 2014, Soft Comput..

[3]  Shengxiang Yang,et al.  Shift-Based Density Estimation for Pareto-Based Algorithms in Many-Objective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[4]  Aluizio F. R. Araújo,et al.  Generalized immigration schemes for dynamic evolutionary multiobjective optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[5]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[6]  Jinhua Zheng,et al.  A population diversity maintaining strategy based on dynamic environment evolutionary model for dynamic multiobjective optimization , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[7]  David Wallace,et al.  Dynamic multi-objective optimization with evolutionary algorithms: a forward-looking approach , 2006, GECCO.

[8]  Qingfu Zhang,et al.  Prediction-Based Population Re-initialization for Evolutionary Dynamic Multi-objective Optimization , 2007, EMO.

[9]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[10]  Tapabrata Ray,et al.  Development of a memetic algorithm for Dynamic Multi-Objective Optimization and its applications for online neural network modeling of UAVs , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[11]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[12]  Yuping Wang,et al.  Hyper rectangle search based particle swarm algorithm for dynamic constrained multi-objective optimization problems , 2012, 2012 IEEE Congress on Evolutionary Computation.

[13]  Steven Guan,et al.  Evolving Dynamic Multi-Objective Optimization Problems with Objective Replacement , 2005, Artificial Intelligence Review.

[14]  Qingfu Zhang,et al.  A Population Prediction Strategy for Evolutionary Dynamic Multiobjective Optimization , 2014, IEEE Transactions on Cybernetics.

[15]  Kay Chen Tan,et al.  A predictive gradient strategy for multiobjective evolutionary algorithms in a fast changing environment , 2010, Memetic Comput..

[16]  Kalyanmoy Deb,et al.  Dynamic multiobjective optimization problems: test cases, approximations, and applications , 2004, IEEE Transactions on Evolutionary Computation.

[17]  Andries Petrus Engelbrecht,et al.  Solving dynamic multi-objective problems with vector evaluated particle swarm optimisation , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[18]  Andries Petrus Engelbrecht,et al.  Archive management for dynamic multi-objective optimisation problems using vector evaluated particle swarm optimisation , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[19]  Kay Chen Tan,et al.  Evolutionary Multi-objective Optimization in Uncertain Environments - Issues and Algorithms , 2009, Studies in Computational Intelligence.

[20]  Jason R. Schott Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimization. , 1995 .

[21]  Yuping Wang,et al.  New Evolutionary Algorithm for Dynamic Multiobjective Optimization Problems , 2006, ICNC.

[22]  Zhuhong Zhang,et al.  Multiobjective optimization immune algorithm in dynamic environments and its application to greenhouse control , 2008, Appl. Soft Comput..

[23]  Carlos A. Coello Coello,et al.  Improving PSO-Based Multi-objective Optimization Using Crowding, Mutation and epsilon-Dominance , 2005, EMO.

[24]  Zhang Ying Cloud Hypermutation Particle Swarm Optimization Algorithm Based on Cloud Model , 2011 .

[25]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[26]  Il Hong Suh,et al.  Dynamic multi-objective optimization based on membrane computing for control of time-varying unstable plants , 2011, Inf. Sci..

[27]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[28]  Min Liu,et al.  Novel prediction and memory strategies for dynamic multiobjective optimization , 2014, Soft Computing.

[29]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[30]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[31]  Gregorio Toscano Pulido,et al.  Handling Dynamic Multiobjective Problems with Particle Swarm Optimization , 2010, ICAART.

[32]  Erich Schikuta,et al.  A Dynamic Multi-Objective Optimization Framework for Selecting Distributed Deployments in a Heterogeneous Environment , 2011, ICCS.

[33]  Kalyanmoy Deb,et al.  Dynamic Multi-objective Optimization and Decision-Making Using Modified NSGA-II: A Case Study on Hydro-thermal Power Scheduling , 2007, EMO.

[34]  Kay Chen Tan,et al.  Dynamic Multiobjective Optimization Using Evolutionary Algorithm with Kalman Filter , 2013 .

[35]  Wang Yu-ping,et al.  Multiobjective evolutionary algorithm for dynamic nonlinear constrained optimization problems , 2009 .

[36]  Ronghua Shang,et al.  A Hybrid Dynamic Multi-objective Immune Optimization Algorithm Using Prediction Strategy and Improved Differential Evolution Crossover Operator , 2011, ICONIP.

[37]  Bojin Zheng,et al.  A New Dynamic Multi-objective Optimization Evolutionary Algorithm , 2007, Third International Conference on Natural Computation (ICNC 2007).

[38]  Mengjie Zhang,et al.  Simplex Model Based Evolutionary Algorithm for Dynamic Multi-Objective Optimization , 2011, Australasian Conference on Artificial Intelligence.

[39]  Kay Chen Tan,et al.  A Competitive-Cooperative Coevolutionary Paradigm for Dynamic Multiobjective Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[40]  C. Coello,et al.  Years of Evolutionary Multi-Objective Optimization : What Has Been Done and What Remains To Be Done , 2006 .

[41]  Kalyanmoy Deb,et al.  Dynamic Multiobjective Optimization Problems: Test Cases, Approximation, and Applications , 2003, EMO.

[42]  Shengxiang Yang,et al.  Evolutionary dynamic optimization: A survey of the state of the art , 2012, Swarm Evol. Comput..

[43]  Liu Min,et al.  Memory Enhanced Dynamic Multi-Objective Evolutionary Algorithm Based on Decomposition , 2013 .

[44]  Fang Liu,et al.  A sphere-dominance based preference immune-inspired algorithm for dynamic multi-objective optimization , 2010, GECCO '10.

[45]  Ming Yang,et al.  Multi-algorithm co-evolution strategy for Dynamic Multi-Objective TSP , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[46]  Bin Li,et al.  Multi-strategy ensemble evolutionary algorithm for dynamic multi-objective optimization , 2010, Memetic Comput..