Solving Many-Objective Optimization Problems via Multistage Evolutionary Search

With the increase in the number of optimization objectives, balancing the convergence and diversity in evolutionary multiobjective optimization becomes more intractable. So far, a variety of evolutionary algorithms have been proposed to solve many-objective optimization problems (MaOPs) with more than three objectives. Most of the existing algorithms, however, find difficulties in simultaneously counterpoising convergence and diversity during the whole evolutionary process. To address the issue, this paper proposes to solve MaOPs via multistage evolutionary search. To be specific, a two-stage evolutionary algorithm is developed, where the convergence and diversity are highlighted during different search stages to avoid the interferences between them. The first stage pushes multiple subpopulations with different weight vectors to converge to different areas of the Pareto front. After that, the nondominated solutions coming from each subpopulation are selected for generating a new population for the second stage. Moreover, a new environmental selection strategy is designed for the second stage to balance the convergence and diversity close to the Pareto front. This selection strategy evenly divides each objective dimension into a number of intervals, and then one solution having the best convergence in each interval will be retained. To assess the performance of the proposed algorithm, 48 benchmark functions with 7, 10, and 15 objectives are used to make comparisons with five representative many-objective optimization algorithms.

[1]  Qingfu Zhang,et al.  Locating the boundaries of Pareto fronts: A Many-Objective Evolutionary Algorithm Based on Corner Solution Search , 2018, ArXiv.

[2]  Guangming Dai,et al.  Indicator and reference points co-guided evolutionary algorithm for many-objective optimization problems , 2018, Knowl. Based Syst..

[3]  Qingfu Zhang,et al.  Adaptive Replacement Strategies for MOEA/D , 2016, IEEE Transactions on Cybernetics.

[4]  Peter J. Fleming,et al.  On the Evolutionary Optimization of Many Conflicting Objectives , 2007, IEEE Transactions on Evolutionary Computation.

[5]  Jun Zhang,et al.  Fuzzy-Based Pareto Optimality for Many-Objective Evolutionary Algorithms , 2014, IEEE Transactions on Evolutionary Computation.

[6]  P. Fleming,et al.  Preference-Inspired CoEvolutionary Algorithm Using Weights for Many-objective Optimization , 2013 .

[7]  Ye Tian,et al.  An Indicator-Based Multiobjective Evolutionary Algorithm With Reference Point Adaptation for Better Versatility , 2018, IEEE Transactions on Evolutionary Computation.

[8]  Qingfu Zhang,et al.  Decomposition-Based Algorithms Using Pareto Adaptive Scalarizing Methods , 2016, IEEE Transactions on Evolutionary Computation.

[9]  Chiu-Hung Chen,et al.  Multiobjective Optimization of Airline Crew Roster Recovery Problems Under Disruption Conditions , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Xiao-Long Zheng,et al.  A Collaborative Multiobjective Fruit Fly Optimization Algorithm for the Resource Constrained Unrelated Parallel Machine Green Scheduling Problem , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[11]  Tao Zhang,et al.  Localized Weighted Sum Method for Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[12]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[13]  Qingfu Zhang,et al.  A Generator for Multiobjective Test Problems With Difficult-to-Approximate Pareto Front Boundaries , 2019, IEEE Transactions on Evolutionary Computation.

[14]  Qingfu Zhang,et al.  A Constrained Decomposition Approach With Grids for Evolutionary Multiobjective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[15]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[16]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[17]  Dipti Srinivasan,et al.  A Survey of Multiobjective Evolutionary Algorithms Based on Decomposition , 2017, IEEE Transactions on Evolutionary Computation.

[18]  Haifeng Li,et al.  Solving large-scale many-objective optimization problems by covariance matrix adaptation evolution strategy with scalable small subpopulations , 2020, Inf. Sci..

[19]  Xin Yao,et al.  A New Dominance Relation-Based Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[20]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[21]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[22]  Gary G. Yen,et al.  Many-Objective Evolutionary Algorithm: Objective Space Reduction and Diversity Improvement , 2016, IEEE Transactions on Evolutionary Computation.

[23]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[24]  Peter J. Fleming,et al.  Preference-inspired co-evolutionary algorithms using weight vectors , 2015, Eur. J. Oper. Res..

[25]  Shengxiang Yang,et al.  A Strength Pareto Evolutionary Algorithm Based on Reference Direction for Multiobjective and Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[26]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[27]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[28]  Shengxiang Yang,et al.  Bi-goal evolution for many-objective optimization problems , 2015, Artif. Intell..

[29]  Y. Ramu Naidu,et al.  Solving Multiobjective Optimization Problems Using Hybrid Cooperative Invasive Weed Optimization With Multiple Populations , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[30]  A. E. Eiben,et al.  Multiobjective Evolutionary Algorithms , 2015 .

[31]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[32]  Tobias Friedrich,et al.  Speeding up many-objective optimization by Monte Carlo approximations , 2013, Artif. Intell..

[33]  Fang Liu,et al.  MOEA/D with Adaptive Weight Adjustment , 2014, Evolutionary Computation.

[34]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[35]  Fang Liu,et al.  A Multiobjective Evolutionary Algorithm Based on Decision Variable Analyses for Multiobjective Optimization Problems With Large-Scale Variables , 2016, IEEE Transactions on Evolutionary Computation.

[36]  MengChu Zhou,et al.  Pareto-Optimization for Scheduling of Crude Oil Operations in Refinery via Genetic Algorithm , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[37]  Qingfu Zhang,et al.  Adaptively Allocating Search Effort in Challenging Many-Objective Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[38]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[39]  Markus Olhofer,et al.  Evolutionary Many-Objective Optimization of Hybrid Electric Vehicle Control: From General Optimization to Preference Articulation , 2017, IEEE Transactions on Emerging Topics in Computational Intelligence.

[40]  Martin J. Oates,et al.  PESA-II: region-based selection in evolutionary multiobjective optimization , 2001 .

[41]  Witold Pedrycz,et al.  An Adaptive Resource Allocation Strategy for Objective Space Partition-Based Multiobjective Optimization , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[42]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[43]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[44]  MengChu Zhou,et al.  A Collaborative Resource Allocation Strategy for Decomposition-Based Multiobjective Evolutionary Algorithms , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[45]  Mengjie Zhang,et al.  A New Two-Stage Evolutionary Algorithm for Many-Objective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[46]  Xin Yao,et al.  A benchmark test suite for evolutionary many-objective optimization , 2017, Complex & Intelligent Systems.

[47]  Dirk Thierens,et al.  The balance between proximity and diversity in multiobjective evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[48]  Hisao Ishibuchi,et al.  Behavior of Multiobjective Evolutionary Algorithms on Many-Objective Knapsack Problems , 2015, IEEE Transactions on Evolutionary Computation.

[49]  Qingfu Zhang,et al.  Decomposition-Based-Sorting and Angle-Based-Selection for Evolutionary Multiobjective and Many-Objective Optimization , 2017, IEEE Transactions on Cybernetics.

[50]  Slim Bechikh,et al.  A New Decomposition-Based NSGA-II for Many-Objective Optimization , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[51]  Yaochu Jin,et al.  A Many-Objective Evolutionary Algorithm Using A One-by-One Selection Strategy , 2017, IEEE Transactions on Cybernetics.

[52]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[53]  Lu Zhen A Bi-Objective Model on Multiperiod Green Supply Chain Network Design , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[54]  Hisao Ishibuchi,et al.  On Scalable Multiobjective Test Problems With Hardly Dominated Boundaries , 2019, IEEE Transactions on Evolutionary Computation.

[55]  Witold Pedrycz,et al.  Hyperplane Assisted Evolutionary Algorithm for Many-Objective Optimization Problems , 2020, IEEE Transactions on Cybernetics.

[56]  Qingfu Zhang,et al.  Decomposition of a Multiobjective Optimization Problem Into a Number of Simple Multiobjective Subproblems , 2014, IEEE Transactions on Evolutionary Computation.

[57]  Xin Yao,et al.  Many-Objective Evolutionary Algorithms , 2015, ACM Comput. Surv..

[58]  Witold Pedrycz,et al.  Uncertainty-Aware Online Scheduling for Real-Time Workflows in Cloud Service Environment , 2021, IEEE Transactions on Services Computing.

[59]  M. Farina,et al.  On the optimal solution definition for many-criteria optimization problems , 2002, 2002 Annual Meeting of the North American Fuzzy Information Processing Society Proceedings. NAFIPS-FLINT 2002 (Cat. No. 02TH8622).

[60]  Xin Yao,et al.  Corner Sort for Pareto-Based Many-Objective Optimization , 2014, IEEE Transactions on Cybernetics.

[61]  Hisao Ishibuchi,et al.  Performance of Decomposition-Based Many-Objective Algorithms Strongly Depends on Pareto Front Shapes , 2017, IEEE Transactions on Evolutionary Computation.

[62]  Yuren Zhou,et al.  A Vector Angle-Based Evolutionary Algorithm for Unconstrained Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[63]  Wang Hu,et al.  Many-Objective Particle Swarm Optimization Using Two-Stage Strategy and Parallel Cell Coordinate System , 2017, IEEE Transactions on Cybernetics.