A Survey of Evolutionary Algorithms for Multi-Objective Optimization Problems With Irregular Pareto Fronts

Evolutionary algorithms have been shown to be very successful in solving multi-objective optimization problems (MOPs). However, their performance often deteriorates when solving MOPs with irregular Pareto fronts. To remedy this issue, a large body of research has been performed in recent years and many new algorithms have been proposed. This paper provides a comprehensive survey of the research on MOPs with irregular Pareto fronts. We start with a brief introduction to the basic concepts, followed by a summary of the benchmark test problems with irregular problems, an analysis of the causes of the irregularity, and real-world optimization problems with irregular Pareto fronts. Then, a taxonomy of the existing methodologies for handling irregular problems is given and representative algorithms are reviewed with a discussion of their strengths and weaknesses. Finally, open challenges are pointed out and a few promising future directions are suggested.

[1]  Ke Ma,et al.  Entropy based evolutionary algorithm with adaptive reference points for many-objective optimization problems , 2018, Inf. Sci..

[2]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[3]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[4]  Zexuan Zhu,et al.  Multimodal Multiobjective Evolutionary Optimization With Dual Clustering in Decision and Objective Spaces , 2021, IEEE Transactions on Evolutionary Computation.

[5]  Ka-Chun Wong,et al.  A Self-Guided Reference Vector Strategy for Many-Objective Optimization , 2020, IEEE Transactions on Cybernetics.

[6]  Qingfu Zhang,et al.  Learning to Decompose: A Paradigm for Decomposition-Based Multiobjective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[7]  Ye Tian,et al.  An Indicator-Based Multiobjective Evolutionary Algorithm With Reference Point Adaptation for Better Versatility , 2018, IEEE Transactions on Evolutionary Computation.

[8]  Qingfu Zhang,et al.  Decomposition-Based Algorithms Using Pareto Adaptive Scalarizing Methods , 2016, IEEE Transactions on Evolutionary Computation.

[9]  Xuefeng Yan,et al.  Solving Multimodal Multiobjective Problems Through Zoning Search , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Tao Zhang,et al.  Localized Weighted Sum Method for Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[11]  Qingfu Zhang,et al.  On the use of two reference points in decomposition based multiobjective evolutionary algorithms , 2017, Swarm Evol. Comput..

[12]  Tapabrata Ray,et al.  Adaptive Sorting-Based Evolutionary Algorithm for Many-Objective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[13]  Jie Zhang,et al.  Asymmetric Pareto-adaptive Scheme for Multiobjective Optimization , 2011, Australasian Conference on Artificial Intelligence.

[14]  Fang Liu,et al.  MOEA/D with Adaptive Weight Adjustment , 2014, Evolutionary Computation.

[15]  Tapabrata Ray,et al.  Decomposition Based Evolutionary Algorithm with a Dual Set of reference vectors , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[16]  Kalyanmoy Deb,et al.  An Improved Adaptive Approach for Elitist Nondominated Sorting Genetic Algorithm for Many-Objective Optimization , 2013, EMO.

[17]  Ye Tian,et al.  A Multistage Evolutionary Algorithm for Better Diversity Preservation in Multiobjective Optimization , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[18]  Xiangxiang Zeng,et al.  MOEA/HD: A Multiobjective Evolutionary Algorithm Based on Hierarchical Decomposition , 2019, IEEE Transactions on Cybernetics.

[19]  Hisao Ishibuchi,et al.  Adapting Reference Vectors and Scalarizing Functions by Growing Neural Gas to Handle Irregular Pareto Fronts , 2020, IEEE Transactions on Evolutionary Computation.

[20]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[21]  Qingfu Zhang,et al.  Objective Reduction in Many-Objective Optimization: Linear and Nonlinear Algorithms , 2013, IEEE Transactions on Evolutionary Computation.

[22]  Yuren Zhou,et al.  An Evolution Path-Based Reproduction Operator for Many-Objective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[23]  Qingfu Zhang,et al.  Adaptive weights generation for decomposition-based multi-objective optimization using Gaussian process regression , 2017, GECCO.

[24]  Xin Yao,et al.  Multiobjective Test Problems with Degenerate Pareto Fronts , 2018, ArXiv.

[25]  Xinye Cai,et al.  A Decomposition-Based Many-Objective Evolutionary Algorithm With Two Types of Adjustments for Direction Vectors , 2018, IEEE Transactions on Cybernetics.

[26]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[27]  Kay Chen Tan,et al.  A multiobjective evolutionary algorithm using dynamic weight design method , 2012 .

[28]  Xiaoliang Ma,et al.  A Many-Objective Evolutionary Algorithm Based on a Two-Round Selection Strategy , 2019, IEEE Transactions on Cybernetics.

[29]  Liang Feng,et al.  Towards adaptive weight vectors for multiobjective evolutionary algorithm based on decomposition , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[30]  Hisao Ishibuchi,et al.  A Study of the Naïve Objective Space Normalization Method in MOEA/D , 2019, 2019 IEEE Symposium Series on Computational Intelligence (SSCI).

[31]  Qingfu Zhang,et al.  Evolutionary Many-Objective Optimization Based on Adversarial Decomposition , 2017, IEEE Transactions on Cybernetics.

[32]  Yuren Zhou,et al.  A Scalar Projection and Angle-Based Evolutionary Algorithm for Many-Objective Optimization Problems , 2019, IEEE Transactions on Cybernetics.

[33]  Qingfu Zhang,et al.  Multiobjective test problems with complicated Pareto fronts: Difficulties in degeneracy , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[34]  Maoguo Gong,et al.  A Clustering-Based Evolutionary Algorithm for Many-Objective Optimization Problems , 2019, IEEE Transactions on Evolutionary Computation.

[35]  Christian Fonteix,et al.  Multicriteria optimization using a genetic algorithm for determining a Pareto set , 1996, Int. J. Syst. Sci..

[36]  J. Charles,et al.  A Sino-German λ 6 cm polarization survey of the Galactic plane I . Survey strategy and results for the first survey region , 2006 .

[37]  Shengxiang Yang,et al.  Pareto or Non-Pareto: Bi-Criterion Evolution in Multiobjective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[38]  Hai-Lin Liu,et al.  A Novel Weight Design in Multi-objective Evolutionary Algorithm , 2010, 2010 International Conference on Computational Intelligence and Security.

[39]  Yiu-Ming Cheung,et al.  Self-Organizing Map-Based Weight Design for Decomposition-Based Many-Objective Evolutionary Algorithm , 2018, IEEE Transactions on Evolutionary Computation.

[40]  Xinye Cai,et al.  A two-phase many-objective evolutionary algorithm with penalty based adjustment for reference lines , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[41]  Gary G. Yen,et al.  A Multimodal Multiobjective Evolutionary Algorithm Using Two-Archive and Recombination Strategies , 2019, IEEE Transactions on Evolutionary Computation.

[42]  Xin Yao,et al.  Multiline Distance Minimization: A Visualized Many-Objective Test Problem Suite , 2018, IEEE Transactions on Evolutionary Computation.

[43]  Qingfu Zhang,et al.  Decomposition of a Multiobjective Optimization Problem Into a Number of Simple Multiobjective Subproblems , 2014, IEEE Transactions on Evolutionary Computation.

[44]  Xin Yao,et al.  What Weights Work for You? Adapting Weights for Any Pareto Front Shape in Decomposition-Based Evolutionary Multiobjective Optimisation , 2017, Evolutionary Computation.

[45]  Satoru Hiwa,et al.  Adaptive weight vector assignment method for MOEA/D , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[46]  Peter J. Fleming,et al.  Preference-inspired co-evolutionary algorithms using weight vectors , 2015, Eur. J. Oper. Res..

[47]  Xin Yao,et al.  Many-Objective Evolutionary Algorithms , 2015, ACM Comput. Surv..

[48]  Xiaoyan Sun,et al.  Many-objective evolutionary optimization based on reference points , 2017, Appl. Soft Comput..

[49]  Yaochu Jin,et al.  A Many-Objective Evolutionary Algorithm Using A One-by-One Selection Strategy , 2017, IEEE Transactions on Cybernetics.

[50]  Kuangrong Hao,et al.  A Clustering-Based Adaptive Evolutionary Algorithm for Multiobjective Optimization With Irregular Pareto Fronts , 2019, IEEE Transactions on Cybernetics.

[51]  Yaochu Jin,et al.  Adaptation of Reference Vectors for Evolutionary Many-objective Optimization of Problems with Irregular Pareto Fronts , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[52]  Lino A. Costa,et al.  Clustering-Based Selection for Evolutionary Many-Objective Optimization , 2014, PPSN.

[53]  Hisao Ishibuchi,et al.  Indicator-Based Weight Adaptation for Solving Many-Objective Optimization Problems , 2019, EMO.

[54]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[55]  Yong Wang,et al.  Scalarizing Functions in Decomposition-Based Multiobjective Evolutionary Algorithms , 2018, IEEE Transactions on Evolutionary Computation.

[56]  Tapabrata Ray,et al.  An Enhanced Decomposition-Based Evolutionary Algorithm With Adaptive Reference Vectors , 2018, IEEE Transactions on Cybernetics.

[57]  Shiu Yin Yuen,et al.  A Multiobjective Evolutionary Algorithm That Diversifies Population by Its Density , 2012, IEEE Transactions on Evolutionary Computation.

[58]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[59]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[60]  Wen Zhu,et al.  A modified PBI approach for multi-objective optimization with complex Pareto fronts , 2018, Swarm Evol. Comput..

[61]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[62]  Zexuan Zhu,et al.  A Survey of Weight Vector Adjustment Methods for Decomposition-Based Multiobjective Evolutionary Algorithms , 2020, IEEE Transactions on Evolutionary Computation.

[63]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[64]  Shengxiang Yang,et al.  An Improved Multiobjective Optimization Evolutionary Algorithm Based on Decomposition for Complex Pareto Fronts , 2016, IEEE Transactions on Cybernetics.

[65]  Xin Yao,et al.  Accelerating Large-Scale Multiobjective Optimization via Problem Reformulation , 2019, IEEE Transactions on Evolutionary Computation.

[66]  Peter J. Fleming,et al.  Towards Understanding the Cost of Adaptation in Decomposition-Based Optimization Algorithms , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[67]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[68]  Liang Sun,et al.  A Many-Objective Evolutionary Algorithm With Two Interacting Processes: Cascade Clustering and Reference Point Incremental Learning , 2018, IEEE Transactions on Evolutionary Computation.

[69]  Hisao Ishibuchi,et al.  Pareto Fronts of Many-Objective Degenerate Test Problems , 2016, IEEE Transactions on Evolutionary Computation.

[70]  Hui Li,et al.  An Adaptive Evolutionary Multi-Objective Approach Based on Simulated Annealing , 2011, Evolutionary Computation.

[71]  Tao Zhang,et al.  An enhanced MOEA/D using uniform directions and a pre-organization procedure , 2013, 2013 IEEE Congress on Evolutionary Computation.

[72]  Xiaoyan Sun,et al.  A New Surrogate-Assisted Interactive Genetic Algorithm With Weighted Semisupervised Learning , 2013, IEEE Transactions on Cybernetics.

[73]  Qingfu Zhang,et al.  Adaptively Allocating Search Effort in Challenging Many-Objective Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[74]  Yaochu Jin,et al.  An Adaptive Reference Vector-Guided Evolutionary Algorithm Using Growing Neural Gas for Many-Objective Optimization of Irregular Problems , 2020, IEEE Transactions on Cybernetics.

[75]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[76]  Ye Tian,et al.  A region division based diversity maintaining approach for many-objective optimization , 2017, Integr. Comput. Aided Eng..

[77]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[78]  Shengxiang Yang,et al.  AREA: Adaptive Reference-set Based Evolutionary Algorithm for Multiobjective Optimisation , 2020, Inf. Sci..

[79]  X. Luo,et al.  Multiobjective Production Planning Optimization Using Hybrid Evolutionary Algorithms for Mineral Processing , 2011, IEEE Transactions on Evolutionary Computation.

[80]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[81]  Aimin Zhou,et al.  A clustering based multiobjective evolutionary algorithm , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[82]  Hisao Ishibuchi,et al.  Performance of Decomposition-Based Many-Objective Algorithms Strongly Depends on Pareto Front Shapes , 2017, IEEE Transactions on Evolutionary Computation.

[83]  Yuren Zhou,et al.  A Vector Angle-Based Evolutionary Algorithm for Unconstrained Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[84]  Naheed Anjum Arafat,et al.  Evolutionary algorithm using adaptive fuzzy dominance and reference point for many-objective optimization , 2019, Swarm Evol. Comput..

[85]  Dan Guo,et al.  Data-Driven Evolutionary Optimization: An Overview and Case Studies , 2019, IEEE Transactions on Evolutionary Computation.

[86]  Yiu-ming Cheung,et al.  T-MOEA/D: MOEA/D with Objective Transform in Multi-objective Problems , 2010, 2010 International Conference of Information Science and Management Engineering.

[87]  Jing J. Liang,et al.  Multimodal multiobjective optimization with differential evolution , 2019, Swarm Evol. Comput..

[88]  Qingfu Zhang,et al.  Adaptive Epsilon dominance in decomposition-based multiobjective evolutionary algorithm , 2019, Swarm Evol. Comput..

[89]  Kay Chen Tan,et al.  Evolutionary Multi-Objective Optimization Driven by Generative Adversarial Networks (GANs) , 2020, IEEE transactions on cybernetics.

[90]  Han Liu,et al.  Dynamic reference vectors and biased crossover use for inverse model based evolutionary multi-objective optimization with irregular Pareto fronts , 2018, Applied Intelligence.

[91]  Kaname Narukawa,et al.  Adaptive Reference Vector Generation for Inverse Model Based Evolutionary Multiobjective Optimization with Degenerate and Disconnected Pareto Fronts , 2015, EMO.

[92]  Kuangrong Hao,et al.  Generating multiple reference vectors for a class of many-objective optimization problems with degenerate Pareto fronts , 2020, Complex & Intelligent Systems.

[93]  Feng Wen-Qing,et al.  Multi-objective Evolutionary Optimization With Objective Space Partition Based on Online Perception of Pareto Front , 2020 .

[94]  Liang Gao,et al.  Adjust weight vectors in MOEA/D for bi-objective optimization problems with discontinuous Pareto fronts , 2017, Soft Computing.

[95]  Carlos A. Coello Coello,et al.  Coevolutionary Multiobjective Evolutionary Algorithms: Survey of the State-of-the-Art , 2018, IEEE Transactions on Evolutionary Computation.

[96]  Xin Yao,et al.  A benchmark test suite for evolutionary many-objective optimization , 2017, Complex & Intelligent Systems.

[97]  Antonin Ponsich,et al.  Generation techniques and a novel on-line adaptation strategy for weight vectors within decomposition-based MOEAs , 2019, GECCO.

[98]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[99]  Xiaojin Zhu,et al.  Introduction to Semi-Supervised Learning , 2009, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[100]  Jun Zhang,et al.  DECAL: Decomposition-Based Coevolutionary Algorithm for Many-Objective Optimization , 2019, IEEE Transactions on Cybernetics.

[101]  Kuangrong Hao,et al.  A Bio-Inspired Self-Learning Coevolutionary Dynamic Multiobjective Optimization Algorithm for Internet of Things Services , 2019, IEEE Transactions on Evolutionary Computation.

[102]  Tao Ma,et al.  A Survey of Multiobjective Evolutionary Algorithms Based on Decomposition: Variants, Challenges and Future Directions , 2020, IEEE Access.

[103]  Yaochu Jin Effectiveness of Weighted Aggregation of Objectives for Evolutionary Multiobjective Optimization : Methods , Analysis and Applications , 2005 .

[104]  Aluizio F. R. Araújo,et al.  MOEA/D with uniformly randomly adaptive weights , 2018, GECCO.

[105]  Kalyanmoy Deb,et al.  Constrained Test Problems for Multi-objective Evolutionary Optimization , 2001, EMO.

[106]  Qingfu Zhang,et al.  A Constrained Decomposition Approach With Grids for Evolutionary Multiobjective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[107]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..