A survey of decomposition approaches in multiobjective evolutionary algorithms

Abstract Since the multiobjective evolutionary algorithm based on decomposition (MOEA/D) was proposed by Zhang and Li in 2007, this interesting framework has attracted a considerable attention from researchers. In MOEA/D, a multiobjective optimization problem is decomposed into a series of aggregated subproblems, which are optimized simultaneously in a collaborative way by using the information from their neighboring subproblems. The decomposition approach has significant impact on MOEA/D as it directs the evolutionary search. Many improved MOEA/D variants proposed various kinds of decomposition approaches and have shown promising performance for different kinds of problems. In this paper, we give a survey of decomposition approaches, which are classified into five categories, i.e., the tradition decomposition, the modified Tchebycheff decomposition, the modified penalty-based boundary intersection decomposition, the constrained decomposition, and other special cases of decomposition. Moreover, discussions are further given in this paper to analyze the performance of different decomposition approaches. One clarifies the difference between Tchebycheff decomposition and Pareto-based domination. The other one compares the performance of various decomposition approaches on different benchmark problems. Experiments results have demonstrated that the Tchebycheff decomposition and its varieties are robust on solving most problems while some specific decomposition approaches are very effective for some problems with special features.

[1]  Qingfu Zhang,et al.  Decomposition-Based Algorithms Using Pareto Adaptive Scalarizing Methods , 2016, IEEE Transactions on Evolutionary Computation.

[2]  Xin Yao,et al.  Corner Sort for Pareto-Based Many-Objective Optimization , 2014, IEEE Transactions on Cybernetics.

[3]  Ye Tian,et al.  An Indicator-Based Multiobjective Evolutionary Algorithm With Reference Point Adaptation for Better Versatility , 2018, IEEE Transactions on Evolutionary Computation.

[4]  Qingfu Zhang,et al.  Learning to Decompose: A Paradigm for Decomposition-Based Multiobjective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[5]  Xiaofeng Wang,et al.  Shape recognition based on neural networks trained by differential evolution algorithm , 2007, Neurocomputing.

[6]  Ivo F. Sbalzariniy,et al.  Multiobjective optimization using evolutionary algorithms , 2000 .

[7]  De-Shuang Huang,et al.  Genetic Optimization Of Radial Basis Probabilistic Neural Networks , 2004, Int. J. Pattern Recognit. Artif. Intell..

[8]  Qingfu Zhang,et al.  Are All the Subproblems Equally Important? Resource Allocation in Decomposition-Based Multiobjective Evolutionary Algorithms , 2016, IEEE Transactions on Evolutionary Computation.

[9]  Slim Bechikh,et al.  A New Decomposition-Based NSGA-II for Many-Objective Optimization , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Heike Trautmann,et al.  On the properties of the R2 indicator , 2012, GECCO '12.

[11]  Yong Wang,et al.  Scalarizing Functions in Decomposition-Based Multiobjective Evolutionary Algorithms , 2018, IEEE Transactions on Evolutionary Computation.

[12]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[13]  Shengxiang Yang,et al.  An Improved Multiobjective Optimization Evolutionary Algorithm Based on Decomposition for Complex Pareto Fronts , 2016, IEEE Transactions on Cybernetics.

[14]  Hong Li,et al.  MOEA/D + uniform design: A new version of MOEA/D for optimization problems with many objectives , 2013, Comput. Oper. Res..

[15]  Qingfu Zhang,et al.  Stable Matching-Based Selection in Evolutionary Multiobjective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[16]  Hui Li,et al.  On the differential evolution schemes in MOEA/D , 2010, 2010 Sixth International Conference on Natural Computation.

[17]  Shengxiang Yang,et al.  Pareto or Non-Pareto: Bi-Criterion Evolution in Multiobjective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[18]  Tao Zhang,et al.  Pareto adaptive penalty-based boundary intersection method for multi-objective optimization , 2017, Inf. Sci..

[19]  Aurora Trinidad Ramirez Pozo,et al.  Upper Confidence Bound (UCB) Algorithms for Adaptive Operator Selection in MOEA/D , 2015, EMO.

[20]  Kalyanmoy Deb,et al.  Investigating the Effect of Imbalance Between Convergence and Diversity in Evolutionary Multiobjective Algorithms , 2017, IEEE Transactions on Evolutionary Computation.

[21]  Kouichi Sakurai,et al.  One Pixel Attack for Fooling Deep Neural Networks , 2017, IEEE Transactions on Evolutionary Computation.

[22]  Xin Yao,et al.  Two-Archive Evolutionary Algorithm for Constrained Multiobjective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[23]  Xin Yao,et al.  Stochastic Ranking Algorithm for Many-Objective Optimization Based on Multiple Indicators , 2016, IEEE Transactions on Evolutionary Computation.

[24]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[25]  Jie Zhang,et al.  A Simple and Fast Hypervolume Indicator-Based Multiobjective Evolutionary Algorithm , 2015, IEEE Transactions on Cybernetics.

[26]  Jing J. Liang,et al.  A survey on multi-objective evolutionary algorithms for the solution of the environmental/economic dispatch problems , 2018, Swarm Evol. Comput..

[27]  Qingfu Zhang,et al.  Adaptive Replacement Strategies for MOEA/D , 2016, IEEE Transactions on Cybernetics.

[28]  Xinye Cai,et al.  A Decomposition-Based Many-Objective Evolutionary Algorithm With Two Types of Adjustments for Direction Vectors , 2018, IEEE Transactions on Cybernetics.

[29]  Tao Zhang,et al.  Localized Weighted Sum Method for Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[30]  Jianqiang Li,et al.  A novel adaptive control strategy for decomposition-based multiobjective algorithm , 2017, Comput. Oper. Res..

[31]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[32]  Sandra M. Venske,et al.  ADEMO/D: Multiobjective optimization by an adaptive differential evolution algorithm , 2014, Neurocomputing.

[33]  Xin Yao,et al.  Two_Arch2: An Improved Two-Archive Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[34]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[35]  Ye Tian,et al.  A Knee Point-Driven Evolutionary Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[36]  Hisao Ishibuchi,et al.  Adaptation of Scalarizing Functions in MOEA/D: An Adaptive Scalarizing Function-Based Multiobjective Evolutionary Algorithm , 2009, EMO.

[37]  Fang Liu,et al.  MOEA/D with Adaptive Weight Adjustment , 2014, Evolutionary Computation.

[38]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[39]  Qingfu Zhang,et al.  Adaptively Allocating Search Effort in Challenging Many-Objective Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[40]  Qingfu Zhang,et al.  Decomposition-Based-Sorting and Angle-Based-Selection for Evolutionary Multiobjective and Many-Objective Optimization , 2017, IEEE Transactions on Cybernetics.

[41]  Qingfu Zhang,et al.  MOEA/D-ACO: A Multiobjective Evolutionary Algorithm Using Decomposition and AntColony , 2013, IEEE Transactions on Cybernetics.

[42]  Hiroyuki Sato,et al.  Inverted PBI in MOEA/D and its impact on the search performance on multi and many-objective optimization , 2014, GECCO.

[43]  Jun Zhang,et al.  DECAL: Decomposition-Based Coevolutionary Algorithm for Many-Objective Optimization , 2019, IEEE Transactions on Cybernetics.

[44]  Tobias Friedrich,et al.  An Efficient Algorithm for Computing Hypervolume Contributions , 2010, Evolutionary Computation.

[45]  Haibo He,et al.  ar-MOEA: A Novel Preference-Based Dominance Relation for Evolutionary Multiobjective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[46]  Qingfu Zhang,et al.  Biased Multiobjective Optimization and Decomposition Algorithm , 2017, IEEE Transactions on Cybernetics.

[47]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[48]  Jianqiang Li,et al.  A Constrained Solution Update Strategy for Multiobjective Evolutionary Algorithm Based on Decomposition , 2019, Complex..

[49]  Antonio J. Nebro,et al.  jMetal: A Java framework for multi-objective optimization , 2011, Adv. Eng. Softw..

[50]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[51]  Hisao Ishibuchi,et al.  Simultaneous use of different scalarizing functions in MOEA/D , 2010, GECCO '10.

[52]  Qingfu Zhang,et al.  Balancing Convergence and Diversity by Using Two Different Reproduction Operators in MOEA/D: Some Preliminary Work , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[53]  Yilong Yin,et al.  A Hybrid Evolutionary Immune Algorithm for Multiobjective Optimization Problems , 2016, IEEE Transactions on Evolutionary Computation.

[54]  Lei Cai,et al.  Two-archive method for aggregation-based many-objective optimization , 2018, Inf. Sci..

[55]  Fang Liu,et al.  MOEA/D with uniform decomposition measurement for many-objective problems , 2014, Soft Computing.

[56]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[57]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[58]  Jia Wang,et al.  A Novel Many-Objective Optimization Algorithm Based on the Hybrid Angle-Encouragement Decomposition , 2018, ICIC.

[59]  Qingfu Zhang,et al.  The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances , 2009, 2009 IEEE Congress on Evolutionary Computation.

[60]  De-Shuang Huang,et al.  An improved approximation approach incorporating particle swarm optimization and a priori information into neural networks , 2010, Neural Computing and Applications.

[61]  Tao Zhang,et al.  On the effect of localized PBI method in MOEA/D for multi-objective optimization , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[62]  Peter J. Fleming,et al.  Methods for multi-objective optimization: An analysis , 2015, Inf. Sci..

[63]  Qingfu Zhang,et al.  Adaptive Operator Selection With Bandits for a Multiobjective Evolutionary Algorithm Based on Decomposition , 2014, IEEE Transactions on Evolutionary Computation.

[64]  Mario Inostroza-Ponta,et al.  A Memetic Algorithm Based on an NSGA-II Scheme for Phylogenetic Tree Inference , 2019, IEEE Transactions on Evolutionary Computation.

[65]  Qingfu Zhang,et al.  Constrained Subproblems in a Decomposition-Based Multiobjective Evolutionary Algorithm , 2016, IEEE Transactions on Evolutionary Computation.

[66]  Shengxiang Yang,et al.  A Comparative Study on Evolutionary Algorithms for Many-Objective Optimization , 2013, EMO.

[67]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[68]  Qingfu Zhang,et al.  Decomposition of a Multiobjective Optimization Problem Into a Number of Simple Multiobjective Subproblems , 2014, IEEE Transactions on Evolutionary Computation.

[69]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[70]  Carlos A. Coello Coello,et al.  MOMBI: A new metaheuristic for many-objective optimization based on the R2 indicator , 2013, 2013 IEEE Congress on Evolutionary Computation.

[71]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[72]  Qingfu Zhang,et al.  Matching-Based Selection With Incomplete Lists for Decomposition Multiobjective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[73]  Jun Zhang,et al.  A Diversity-Enhanced Resource Allocation Strategy for Decomposition-Based Multiobjective Evolutionary Algorithm , 2018, IEEE Transactions on Cybernetics.

[74]  Hisao Ishibuchi,et al.  Performance of Decomposition-Based Many-Objective Algorithms Strongly Depends on Pareto Front Shapes , 2017, IEEE Transactions on Evolutionary Computation.

[75]  Shengxiang Yang,et al.  Improving the multiobjective evolutionary algorithm based on decomposition with new penalty schemes , 2017, Soft Comput..

[76]  Qiuzhen Lin,et al.  A hybridized angle-encouragement-based decomposition approach for many-objective optimization problems , 2019, Appl. Soft Comput..

[77]  Shengxiang Yang,et al.  A Strength Pareto Evolutionary Algorithm Based on Reference Direction for Multiobjective and Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[78]  Qingfu Zhang,et al.  Interrelationship-Based Selection for Decomposition Multiobjective Optimization , 2015, IEEE Transactions on Cybernetics.

[79]  Tapabrata Ray,et al.  An Enhanced Decomposition-Based Evolutionary Algorithm With Adaptive Reference Vectors , 2018, IEEE Transactions on Cybernetics.

[80]  Qingfu Zhang,et al.  On Tchebycheff Decomposition Approaches for Multiobjective Evolutionary Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[81]  Qiuzhen Lin,et al.  Adaptive composite operator selection and parameter control for multiobjective evolutionary algorithm , 2016, Inf. Sci..

[82]  Carlos A. Coello Coello,et al.  Coevolutionary Multiobjective Evolutionary Algorithms: Survey of the State-of-the-Art , 2018, IEEE Trans. Evol. Comput..

[83]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[84]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.