Multi-objective differential evolution with dynamic covariance matrix learning for multi-objective optimization problems with variable linkages

Recently, many multi-objective differential evolution versions (MODEs) have been developed by incorporating the search engine of differential evolution (DE) and multi-objective processing mechanisms. However, most existing MODEs perform poorly in solving multi-objective optimization problems (MOPs) with variable linkages. The cause of this poor performance is the rotational variability of binomial crossover operator (BCO), which is not conducive to making simultaneous progress across all variables within a solution vector in the search for such MOPs. To alleviate the limitation, dynamic covariance matrix learning (DCML) based on the information distribution of the entire or a portion of the population is proposed to establish a proper coordinate system for the BCO by eigen decomposition. In this method, the rotational invariance of DE can be enhanced to a certain extent by releasing the interactions among the variables; thus, it is useful for MODEs to better balance their exploration and exploitation abilities. By integrating the DCML into existing MODEs, a class of new MODEs, which are called MODEsź+źDCML for short, are presented in this study. For comparison purposes, the proposed DCML strategy is applied to four commonly used MODEs. Twenty-nine benchmark problems with variable linkages are selected as the test suite to evaluate the performance of the proposed MODEsź+źDCML. The experimental results show that the proposed DCML can significantly improve the performance of the state-of-the-art MODEs in most test functions.

[1]  Ye Tian,et al.  A Knee Point-Driven Evolutionary Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[2]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[3]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[4]  Ponnuthurai N. Suganthan,et al.  Recent advances in differential evolution - An updated survey , 2016, Swarm Evol. Comput..

[5]  Ardeshir Bahreininejad,et al.  Water cycle algorithm for solving multi-objective optimization problems , 2014, Soft Computing.

[6]  Qingfu Zhang,et al.  Stable Matching-Based Selection in Evolutionary Multiobjective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[7]  Xiao Zhi Gao,et al.  Self-organizing multiobjective optimization based on decomposition with neighborhood ensemble , 2016, Neurocomputing.

[8]  Daniel N. Wilke,et al.  On rotationally invariant continuous-parameter genetic algorithms , 2014, Adv. Eng. Softw..

[9]  Ye Tian,et al.  An Efficient Approach to Nondominated Sorting for Evolutionary Multiobjective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[10]  Qingfu Zhang,et al.  Are All the Subproblems Equally Important? Resource Allocation in Decomposition-Based Multiobjective Evolutionary Algorithms , 2016, IEEE Transactions on Evolutionary Computation.

[11]  Shu-Mei Guo,et al.  Enhancing Differential Evolution Utilizing Eigenvector-Based Crossover Operator , 2015, IEEE Transactions on Evolutionary Computation.

[12]  Weiyi Qian,et al.  Adaptive differential evolution algorithm for multiobjective optimization problems , 2008, Appl. Math. Comput..

[13]  Qingfu Zhang,et al.  Multiobjective differential evolution algorithm based on decomposition for a type of multiobjective bilevel programming problems , 2016, Knowl. Based Syst..

[14]  Yaonan Wang,et al.  Multi-objective self-adaptive differential evolution with elitist archive and crowding entropy-based diversity measure , 2010, Soft Comput..

[15]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[16]  Ponnuthurai N. Suganthan,et al.  Multi-objective optimization using self-adaptive differential evolution algorithm , 2009, 2009 IEEE Congress on Evolutionary Computation.

[17]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[18]  W. Du,et al.  Multi-objective differential evolution with ranking-based mutation operator and its application in chemical process optimization , 2014 .

[19]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[20]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[21]  Fang Liu,et al.  MOEA/D with opposition-based learning for multiobjective optimization problem , 2014, Neurocomputing.

[22]  Tetsuyuki Takahama,et al.  Solving nonlinear optimization problems by Differential Evolution with a rotation-invariant crossover operation using Gram-Schmidt process , 2010, 2010 Second World Congress on Nature and Biologically Inspired Computing (NaBIC).

[23]  Jouni Lampinen,et al.  GDE3: the third evolution step of generalized differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[24]  Tea Tusar,et al.  GP-DEMO: Differential Evolution for Multiobjective Optimization based on Gaussian Process models , 2015, Eur. J. Oper. Res..

[25]  Bernhard Sendhoff,et al.  A Multiobjective Evolutionary Algorithm Using Gaussian Process-Based Inverse Modeling , 2015, IEEE Transactions on Evolutionary Computation.

[26]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[27]  Yong Wang,et al.  A regularity model-based multiobjective estimation of distribution algorithm with reducing redundant cluster operator , 2012, Appl. Soft Comput..

[28]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[29]  Kalyanmoy Deb,et al.  Multi-objective test problems, linkages, and evolutionary methodologies , 2006, GECCO.

[30]  H. B. Quek,et al.  Pareto-optimal set based multiobjective tuning of fuzzy automatic train operation for mass transit system , 1999 .

[31]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[32]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[33]  Fang Liu,et al.  MOEA/D with Baldwinian learning inspired by the regularity property of continuous multiobjective problem , 2014, Neurocomputing.

[34]  Carlos A. Coello Coello,et al.  Multi-objective Optimization Using Differential Evolution: A Survey of the State-of-the-Art , 2008 .

[35]  Kirsten Schmieder,et al.  Registration of CT and Intraoperative 3-D Ultrasound Images of the Spine Using Evolutionary and Gradient-Based Methods , 2008, IEEE Transactions on Evolutionary Computation.

[36]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[37]  Huaglory Tianfield,et al.  Biogeography-based optimization with covariance matrix based migration , 2016, Appl. Soft Comput..

[38]  Long Li,et al.  Differential evolution based on covariance matrix learning and bimodal distribution parameter setting , 2014, Appl. Soft Comput..

[39]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[40]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[41]  Lei Wang,et al.  MOEA/D-ARA+SBX: A new multi-objective evolutionary algorithm based on decomposition with artificial raindrop algorithm and simulated binary crossover , 2016, Knowl. Based Syst..

[42]  Maoguo Gong,et al.  Multiobjective Immune Algorithm with Nondominated Neighbor-Based Selection , 2008, Evolutionary Computation.

[43]  Fang Liu,et al.  MOEA/D with Adaptive Weight Adjustment , 2014, Evolutionary Computation.

[44]  Abir Chaabani,et al.  An Efficient Chemical Reaction Optimization Algorithm for Multiobjective Optimization , 2015, IEEE Transactions on Cybernetics.

[45]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[46]  Qingfu Zhang,et al.  A Self-Organizing Multiobjective Evolutionary Algorithm , 2016, IEEE Transactions on Evolutionary Computation.

[47]  Min-Yuan Cheng,et al.  A novel Multiple Objective Symbiotic Organisms Search (MOSOS) for time-cost-labor utilization tradeoff problem , 2016, Knowl. Based Syst..

[48]  Stefan Roth,et al.  Covariance Matrix Adaptation for Multi-objective Optimization , 2007, Evolutionary Computation.

[49]  Mehmet Fatih Tasgetiren,et al.  Multi-objective optimization based on self-adaptive differential evolution algorithm , 2007, 2007 IEEE Congress on Evolutionary Computation.

[50]  Millie Pant,et al.  An efficient Differential Evolution based algorithm for solving multi-objective optimization problems , 2011, Eur. J. Oper. Res..

[51]  Qingfu Zhang,et al.  Adaptive Replacement Strategies for MOEA/D , 2016, IEEE Transactions on Cybernetics.