A Survey of Weight Vector Adjustment Methods for Decomposition-Based Multiobjective Evolutionary Algorithms

Multiobjective evolutionary algorithms based on decomposition (MOEA/D) have attracted tremendous attention and achieved great success in the fields of optimization and decision-making. MOEA/Ds work by decomposing the target multiobjective optimization problem (MOP) into multiple single-objective subproblems based on a set of weight vectors. The subproblems are solved cooperatively in an evolutionary algorithm framework. Since weight vectors define the search directions and, to a certain extent, the distribution of the final solution set, the configuration of weight vectors is pivotal to the success of MOEA/Ds. The most straightforward method is to use predefined and uniformly distributed weight vectors. However, it usually leads to the deteriorated performance of MOEA/Ds on solving MOPs with irregular Pareto fronts. To deal with this issue, many weight vector adjustment methods have been proposed by periodically adjusting the weight vectors in a random, predefined, or adaptive way. This article focuses on weight vector adjustment on a simplex and presents a comprehensive survey of these weight vector adjustment methods covering the weight vector adaptation strategies, theoretical analyses, benchmark test problems, and applications. The current limitations, new challenges, and future directions of weight vector adjustment are also discussed.

[1]  Fang Liu,et al.  MOEA/D with Adaptive Weight Adjustment , 2014, Evolutionary Computation.

[2]  Yuren Zhou,et al.  A Vector Angle-Based Evolutionary Algorithm for Unconstrained Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[3]  Roman Neruda,et al.  Incorporating User Preferences in MOEA/D through the Coevolution of Weights , 2015, GECCO.

[4]  Ye Tian,et al.  An Indicator-Based Multiobjective Evolutionary Algorithm With Reference Point Adaptation for Better Versatility , 2018, IEEE Transactions on Evolutionary Computation.

[5]  Qingfu Zhang,et al.  Learning to Decompose: A Paradigm for Decomposition-Based Multiobjective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[6]  Qingfu Zhang,et al.  On the use of random weights in MOEA/D , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[7]  Xin Yao,et al.  Integration of Preferences in Decomposition Multiobjective Optimization , 2017, IEEE Transactions on Cybernetics.

[8]  Qguhm -DVNLHZLF,et al.  On the performance of multiple objective genetic local search on the 0 / 1 knapsack problem . A comparative experiment , 2000 .

[9]  Xiangxiang Zeng,et al.  MOEA/HD: A Multiobjective Evolutionary Algorithm Based on Hierarchical Decomposition , 2019, IEEE Transactions on Cybernetics.

[10]  Hui Li,et al.  An Adaptive Evolutionary Multi-Objective Approach Based on Simulated Annealing , 2011, Evolutionary Computation.

[11]  Ke Ma,et al.  Entropy based evolutionary algorithm with adaptive reference points for many-objective optimization problems , 2018, Inf. Sci..

[12]  Kalyanmoy Deb,et al.  Non-linear Dimensionality Reduction Procedures for Certain Large-Dimensional Multi-objective Optimization Problems: Employing Correntropy and a Novel Maximum Variance Unfolding , 2007, EMO.

[13]  Yuren Zhou,et al.  Evolutionary Many-Objective Optimization Based on Dynamical Decomposition , 2019, IEEE Transactions on Evolutionary Computation.

[14]  Qingfu Zhang,et al.  Adaptive Operator Selection With Bandits for a Multiobjective Evolutionary Algorithm Based on Decomposition , 2014, IEEE Transactions on Evolutionary Computation.

[15]  Qingfu Zhang,et al.  Interactive MOEA/D for multi-objective decision making , 2011, GECCO '11.

[16]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[17]  Mitsuo Gen,et al.  Specification of Genetic Search Directions in Cellular Multi-objective Genetic Algorithms , 2001, EMO.

[18]  Michał K. Tomczyk,et al.  Decomposition-Based Interactive Evolutionary Algorithm for Multiple Objective Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[19]  Xin Yao,et al.  Interactive Decomposition Multiobjective Optimization Via Progressively Learned Value Functions , 2018, IEEE Transactions on Fuzzy Systems.

[20]  Xin Yao,et al.  Multiline Distance Minimization: A Visualized Many-Objective Test Problem Suite , 2018, IEEE Transactions on Evolutionary Computation.

[21]  Liang Sun,et al.  A Many-Objective Evolutionary Algorithm With Two Interacting Processes: Cascade Clustering and Reference Point Incremental Learning , 2018, IEEE Transactions on Evolutionary Computation.

[22]  Xiaoli Wang,et al.  MOEA/D with Adaptive Weight Vector Design , 2015, 2015 11th International Conference on Computational Intelligence and Security (CIS).

[23]  Qingfu Zhang,et al.  Multiobjective test problems with complicated Pareto fronts: Difficulties in degeneracy , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[24]  Licheng Jiao,et al.  Interactive Reference Region Based Multi-Objective Evolutionary Algorithm Through Decomposition , 2016, IEEE Access.

[25]  Shengxiang Yang,et al.  An Improved Multiobjective Optimization Evolutionary Algorithm Based on Decomposition for Complex Pareto Fronts , 2016, IEEE Transactions on Cybernetics.

[26]  A. Jaszkiewicz,et al.  Interactive multiobjective optimization with the Pareto memetic algorithm , 2007 .

[27]  Xin Yao,et al.  A benchmark test suite for evolutionary many-objective optimization , 2017, Complex & Intelligent Systems.

[28]  Qingfu Zhang,et al.  Decomposition-Based Algorithms Using Pareto Adaptive Scalarizing Methods , 2016, IEEE Transactions on Evolutionary Computation.

[29]  Liang Feng,et al.  Towards adaptive weight vectors for multiobjective evolutionary algorithm based on decomposition , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[30]  Qingfu Zhang,et al.  Adaptive weights generation for decomposition-based multi-objective optimization using Gaussian process regression , 2017, GECCO.

[31]  Jie Chen,et al.  Solving the uncertain multi-objective multi-stage weapon target assignment problem via MOEA/D-AWA , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[32]  Piotr Czyzżak,et al.  Pareto simulated annealing—a metaheuristic technique for multiple‐objective combinatorial optimization , 1998 .

[33]  Qingfu Zhang,et al.  Adaptively Allocating Search Effort in Challenging Many-Objective Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[34]  Xinye Cai,et al.  A two-phase many-objective evolutionary algorithm with penalty based adjustment for reference lines , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[35]  J. Dennis,et al.  NORMAL-BOUNDARY INTERSECTION: AN ALTERNATE METHOD FOR GENERATING PARETO OPTIMAL POINTS IN MULTICRITERIA OPTIMIZATION PROBLEMS , 1996 .

[36]  Mengmeng Zhang,et al.  Multi-objective energy consumption scheduling based on decomposition algorithm with the non-uniform weight vector , 2016, Appl. Soft Comput..

[37]  Gang Chen,et al.  A PSO-Based Reference Point Adaption Method for Genetic Programming Hyper-Heuristic in Many-Objective Job Shop Scheduling , 2017, ACALCI.

[38]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[39]  Tapabrata Ray,et al.  Decomposition Based Evolutionary Algorithm with a Dual Set of reference vectors , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[40]  Jürgen Branke,et al.  Consideration of Partial User Preferences in Evolutionary Multiobjective Optimization , 2008, Multiobjective Optimization.

[41]  Wen Zhu,et al.  A modified PBI approach for multi-objective optimization with complex Pareto fronts , 2018, Swarm Evol. Comput..

[42]  Kalyanmoy Deb,et al.  An Improved Adaptive Approach for Elitist Nondominated Sorting Genetic Algorithm for Many-Objective Optimization , 2013, EMO.

[43]  Olivier L. de Weck,et al.  Adaptive Weighted Sum Method for Multiobjective Optimization , 2004 .

[44]  Bin Zhang,et al.  Decomposition-based sub-problem optimal solution updating direction-guided evolutionary many-objective algorithm , 2018, Inf. Sci..

[45]  Murat Köksalan,et al.  An Interactive Evolutionary Metaheuristic for Multiobjective Combinatorial Optimization , 2003, Manag. Sci..

[46]  Markus Olhofer,et al.  Reference vector based a posteriori preference articulation for evolutionary multiobjective optimization , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[47]  Hisao Ishibuchi,et al.  Performance of Decomposition-Based Many-Objective Algorithms Strongly Depends on Pareto Front Shapes , 2017, IEEE Transactions on Evolutionary Computation.

[48]  Naoki Hamada,et al.  On scalability of Adaptive Weighted Aggregation for multiobjective function optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[49]  Carlos A. Coello Coello,et al.  Improved Metaheuristic Based on the R2 Indicator for Many-Objective Optimization , 2015, GECCO.

[50]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[51]  Andrzej P. Wierzbicki,et al.  A parallel multiple reference point approach for multi-objective optimization , 2010, Eur. J. Oper. Res..

[52]  Xiaodong Li,et al.  Integrating user preferences and decomposition methods for many-objective optimization , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[53]  Jie Zhang,et al.  Multiobjective optimization by decomposition with Pareto-adaptive weight vectors , 2011, ICNC.

[54]  Peter J. Fleming,et al.  On finding well-spread pareto optimal solutions by preference-inspired co-evolutionary algorithm , 2013, GECCO '13.

[55]  Xinye Cai,et al.  A Decomposition-Based Many-Objective Evolutionary Algorithm With Two Types of Adjustments for Direction Vectors , 2018, IEEE Transactions on Cybernetics.

[56]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[57]  Kalyanmoy Deb,et al.  Multi-objective test problems, linkages, and evolutionary methodologies , 2006, GECCO.

[58]  Hisao Ishibuchi,et al.  Pareto Fronts of Many-Objective Degenerate Test Problems , 2016, IEEE Transactions on Evolutionary Computation.

[59]  Hisao Ishibuchi,et al.  Adapting Reference Vectors and Scalarizing Functions by Growing Neural Gas to Handle Irregular Pareto Fronts , 2020, IEEE Transactions on Evolutionary Computation.

[60]  Fang Liu,et al.  MOEA/D with biased weight adjustment inspired by user preference and its application on multi-objective reservoir flood control problem , 2016, Soft Comput..

[61]  Yaochu Jin Effectiveness of Weighted Aggregation of Objectives for Evolutionary Multiobjective Optimization : Methods , Analysis and Applications , 2005 .

[62]  Hisao Ishibuchi,et al.  Difficulties in specifying reference points to calculate the inverted generational distance for many-objective optimization problems , 2014, 2014 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making (MCDM).

[63]  Carlos A. Coello Coello,et al.  Handling preferences in evolutionary multiobjective optimization: a survey , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[64]  Xin Yao,et al.  What Weights Work for You? Adapting Weights for Any Pareto Front Shape in Decomposition-Based Evolutionary Multiobjective Optimisation , 2017, Evolutionary Computation.

[65]  Hamid Khaloozadeh,et al.  Dynamically Weighted Continuous Ant Colony Optimization for Bi-Objective Portfolio Selection Using Value-at-Risk , 2009, 2009 Third Asia International Conference on Modelling & Simulation.

[66]  Hai-Lin Liu,et al.  A novel constraint-handling technique based on dynamic weights for constrained optimization problems , 2017, Soft Computing.

[67]  Shengxiang Yang,et al.  A Strength Pareto Evolutionary Algorithm Based on Reference Direction for Multiobjective and Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[68]  Yiu-ming Cheung,et al.  T-MOEA/D: MOEA/D with Objective Transform in Multi-objective Problems , 2010, 2010 International Conference of Information Science and Management Engineering.

[69]  Isao Ono,et al.  Adaptive Weighted Aggregation with Step Size Control Weight Adaptation for Multiobjective Continuous Function Optimization , 2015 .

[70]  Yuping Wang,et al.  A Space Division Multiobjective Evolutionary Algorithm Based on Adaptive Multiple Fitness Functions , 2016, Int. J. Pattern Recognit. Artif. Intell..

[71]  Qingfu Zhang,et al.  Interrelationship-Based Selection for Decomposition Multiobjective Optimization , 2015, IEEE Transactions on Cybernetics.

[72]  Tapabrata Ray,et al.  An Enhanced Decomposition-Based Evolutionary Algorithm With Adaptive Reference Vectors , 2018, IEEE Transactions on Cybernetics.

[73]  Satoru Hiwa,et al.  Adaptive weight vector assignment method for MOEA/D , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[74]  Hisao Ishibuchi,et al.  A multi-objective genetic local search algorithm and its application to flowshop scheduling , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[75]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[76]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[77]  Paolo Serafini,et al.  Simulated Annealing for Multi Objective Optimization Problems , 1994 .

[78]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[79]  Kaname Narukawa,et al.  Adaptive Reference Vector Generation for Inverse Model Based Evolutionary Multiobjective Optimization with Degenerate and Disconnected Pareto Fronts , 2015, EMO.

[80]  Yiu-ming Cheung,et al.  A parameterless decomposition-based evolutionary multi-objective algorithm , 2018, 2018 Tenth International Conference on Advanced Computational Intelligence (ICACI).

[81]  Peter J. Fleming,et al.  Preference-inspired co-evolutionary algorithms using weight vectors , 2015, Eur. J. Oper. Res..

[82]  Qingfu Zhang,et al.  Decomposition of a Multiobjective Optimization Problem Into a Number of Simple Multiobjective Subproblems , 2014, IEEE Transactions on Evolutionary Computation.

[83]  Hisao Ishibuchi,et al.  Use of Two Reference Points in Hypervolume-Based Evolutionary Multiobjective Optimization Algorithms , 2018, PPSN.

[84]  Jiang Siwei,et al.  Multiobjective optimization by decomposition with Pareto-adaptive weight vectors , 2011, 2011 Seventh International Conference on Natural Computation.

[85]  Kaisa Miettinen,et al.  Introduction to Multiobjective Optimization: Noninteractive Approaches , 2008, Multiobjective Optimization.

[86]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[87]  Kay Chen Tan,et al.  A multiobjective evolutionary algorithm using dynamic weight design method , 2012 .

[88]  Hong Li,et al.  MOEA/D + uniform design: A new version of MOEA/D for optimization problems with many objectives , 2013, Comput. Oper. Res..

[89]  Fang Liu,et al.  MOEA/D with uniform decomposition measurement for many-objective problems , 2014, Soft Computing.

[90]  Yiu-Ming Cheung,et al.  Self-Organizing Map-Based Weight Design for Decomposition-Based Many-Objective Evolutionary Algorithm , 2018, IEEE Transactions on Evolutionary Computation.

[91]  Han Liu,et al.  Dynamic reference vectors and biased crossover use for inverse model based evolutionary multi-objective optimization with irregular Pareto fronts , 2018, Applied Intelligence.

[92]  Xin Yao,et al.  R-Metric: Evaluating the Performance of Preference-Based Evolutionary Multiobjective Optimization Using Reference Points , 2018, IEEE Transactions on Evolutionary Computation.

[93]  Hai-Lin Liu,et al.  A Novel Weight Design in Multi-objective Evolutionary Algorithm , 2010, 2010 International Conference on Computational Intelligence and Security.

[94]  Kuangrong Hao,et al.  A Clustering-Based Adaptive Evolutionary Algorithm for Multiobjective Optimization With Irregular Pareto Fronts , 2019, IEEE Transactions on Cybernetics.

[95]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[96]  Yaochu Jin,et al.  Dynamic Weighted Aggregation for evolutionary multi-objective optimization: why does it work and how? , 2001 .

[97]  Xiaodong Li,et al.  Reference point based multi-objective optimization through decomposition , 2012, 2012 IEEE Congress on Evolutionary Computation.

[98]  Yaochu Jin,et al.  Adaptation of Reference Vectors for Evolutionary Many-objective Optimization of Problems with Irregular Pareto Fronts , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[99]  Liang Gao,et al.  Adjust weight vectors in MOEA/D for bi-objective optimization problems with discontinuous Pareto fronts , 2017, Soft Computing.

[100]  Frederico G. Guimarães,et al.  Evolutionary method for weight vector generation in Multi-Objective Evolutionary Algorithms based on decomposition and aggregation , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[101]  Tao Zhang,et al.  Localized Weighted Sum Method for Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[102]  Hisao Ishibuchi,et al.  Two-Layered Weight Vector Specification in Decomposition-Based Multi-Objective Algorithms for Many-Objective Optimization Problems , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[103]  Bernhard Sendhoff,et al.  Adapting Weighted Aggregation for Multiobjective Evolution Strategies , 2001, EMO.

[104]  Qingfu Zhang,et al.  On Tchebycheff Decomposition Approaches for Multiobjective Evolutionary Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[105]  Hui Li,et al.  Evolutionary Multi-objective Simulated Annealing with adaptive and competitive search direction , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[106]  Qingfu Zhang,et al.  An evolutionary many-objective optimisation algorithm with adaptive region decomposition , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[107]  Yuanyuan Jia,et al.  An improved reference point based multi-objective optimization by decomposition , 2016, Int. J. Mach. Learn. Cybern..

[108]  Kaisa Miettinen,et al.  Introduction to Multiobjective Optimization: Interactive Approaches , 2008, Multiobjective Optimization.

[109]  Roman Neruda,et al.  General tuning of weights in MOEA/D , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[110]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[111]  Antonin Ponsich,et al.  Generation techniques and a novel on-line adaptation strategy for weight vectors within decomposition-based MOEAs , 2019, GECCO.

[112]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[113]  Jie Zhang,et al.  Asymmetric Pareto-adaptive Scheme for Multiobjective Optimization , 2011, Australasian Conference on Artificial Intelligence.

[114]  Qingfu Zhang,et al.  The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances , 2009, 2009 IEEE Congress on Evolutionary Computation.

[115]  Shiu Yin Yuen,et al.  A Multiobjective Evolutionary Algorithm That Diversifies Population by Its Density , 2012, IEEE Transactions on Evolutionary Computation.

[116]  Qingfu Zhang,et al.  Evolutionary Many-Objective Optimization Based on Adversarial Decomposition , 2017, IEEE Transactions on Cybernetics.

[117]  Dipti Srinivasan,et al.  A Survey of Multiobjective Evolutionary Algorithms Based on Decomposition , 2017, IEEE Transactions on Evolutionary Computation.

[118]  Aluizio F. R. Araújo,et al.  MOEA/D with uniformly randomly adaptive weights , 2018, GECCO.