Reinvestigation of evolutionary many-objective optimization: Focus on the Pareto knee front

Abstract Approximating the entire Pareto front (PF) in many-objective optimization is challenging but often unnecessary because a decision maker is usually only interested in a small portion of the PF. Assuming no preference, we argue that a more appropriate way to address many-objective optimization problems (MaOPs) is to find Pareto-optimal knee solutions—solutions where small improvements in one objective will lead to severe degradation in at least one other objective. Herein, we propose such a method, which uses a distance-based indicator to first identify knee points (knee-detection phase) and then uses a refined fitness assignment strategy to select solutions near the knee points (knee-selection phase). The proposed method is integrated into two traditional algorithms, resulting in k-NSGA-II and k-MOEA/D. We discuss the effects of the parameter that controls the width of the knee region(s) and then analyze the effects of different methods for identifying knee points in the knee-detection phase. Finally, we examine the performances of k-NSGA-II and k-MOEA/D on a set of knee benchmark problems. The experimental results show that k-NSGA-II is competitive on knee test problems with 2 and 4 objectives, while k-MOEA/D performs better than k-NSGA-II with 6 and 8 objectives.

[1]  Mengjun Ming,et al.  An efficient multi-objective model and algorithm for sizing a stand-alone hybrid renewable energy system , 2017 .

[2]  E. Hughes Multiple single objective Pareto sampling , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[3]  Tao Zhang,et al.  Multi-objective optimal design of hybrid renewable energy systems using evolutionary algorithms , 2015, 2015 11th International Conference on Natural Computation (ICNC).

[4]  Lixin Tang,et al.  A knee-guided prediction approach for dynamic multi-objective optimization , 2020, Inf. Sci..

[5]  Gilbert Laporte,et al.  Solving a multi-objective dynamic stochastic districting and routing problem with a co-evolutionary algorithm , 2016, Comput. Oper. Res..

[6]  Gaoping Wang,et al.  Fuzzy-Dominance and Its Application in Evolutionary Many Objective Optimization , 2007, 2007 International Conference on Computational Intelligence and Security Workshops (CISW 2007).

[7]  Lily Rachmawati,et al.  A multi-objective evolutionary algorithm with weighted-sum niching for convergence on knee regions , 2006, GECCO '06.

[8]  Hartmut Schmeck,et al.  Angle-Based Preference Models in Multi-objective Optimization , 2017, EMO.

[9]  Naruemon Wattanapongsakorn,et al.  A decomposition-based approach for knee solution approximation in multi-objective optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[10]  Shengxiang Yang,et al.  A knee-point-based evolutionary algorithm using weighted subpopulation for many-objective optimization , 2019, Swarm Evol. Comput..

[11]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[12]  Rui Wang,et al.  Extremized PICEA-g for Nadir Point Estimation in Many-Objective Optimization , 2018, ICIC.

[13]  Naruemon Wattanapongsakorn,et al.  A knee-based multi-objective evolutionary algorithm: an extension to network system optimization design problem , 2015, Cluster Computing.

[14]  Indraneel Das On characterizing the “knee” of the Pareto curve based on Normal-Boundary Intersection , 1999 .

[15]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[16]  Kalyanmoy Deb,et al.  Finding Knees in Multi-objective Optimization , 2004, PPSN.

[17]  Patrick M. Reed,et al.  Borg: An Auto-Adaptive Many-Objective Evolutionary Computing Framework , 2013, Evolutionary Computation.

[18]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[19]  A. Buja,et al.  Prosection Views: Dimensional Inference through Sections and Projections , 1994 .

[20]  Peter J. Fleming,et al.  An analysis of parameter sensitivities of preference-inspired co-evolutionary algorithms , 2015, Int. J. Syst. Sci..

[21]  Haifeng Li,et al.  Ensemble of differential evolution variants , 2018, Inf. Sci..

[22]  Ye Tian,et al.  PlatEMO: A MATLAB Platform for Evolutionary Multi-Objective Optimization [Educational Forum] , 2017, IEEE Computational Intelligence Magazine.

[23]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[24]  Tao Zhang,et al.  On the effect of reference point in MOEA/D for multi-objective optimization , 2017, Appl. Soft Comput..

[25]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[26]  Tapabrata Ray,et al.  Bridging the Gap: Many-Objective Optimization and Informed Decision-Making , 2017, IEEE Transactions on Evolutionary Computation.

[27]  Ayesha Sohail,et al.  The Lattice Boltzmann method and computational analysis of bone dynamics-I , 2017, Complex Adapt. Syst. Model..

[28]  Naruemon Wattanapongsakorn,et al.  Adaptive geometric angle-based algorithm with independent objective biasing for pruning Pareto-optimal solutions , 2013, 2013 Science and Information Conference.

[29]  Tomoyuki Hiroyasu,et al.  SPEA2+: Improving the Performance of the Strength Pareto Evolutionary Algorithm 2 , 2004, PPSN.

[30]  Lily Rachmawati,et al.  Multiobjective Evolutionary Algorithm With Controllable Focus on the Knees of the Pareto Front , 2009, IEEE Transactions on Evolutionary Computation.

[31]  Ye Tian,et al.  A Knee Point-Driven Evolutionary Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[32]  Peter J. Fleming,et al.  Preference-inspired co-evolutionary algorithms using weight vectors , 2015, Eur. J. Oper. Res..

[33]  Tao Zhang,et al.  Localized Weighted Sum Method for Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[34]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[35]  D.A. Van Veldhuizen,et al.  On measuring multiobjective evolutionary algorithm performance , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[36]  Lei Zhang,et al.  A multi-level knee point based multi-objective evolutionary algorithm for AUC maximization , 2019, Memetic Comput..

[37]  Markus Olhofer,et al.  Benchmark Problems and Performance Indicators for Search of Knee Points in Multiobjective Optimization , 2020, IEEE Transactions on Cybernetics.

[38]  Tao Zhang,et al.  Evolutionary Many-Objective Optimization: A Comparative Study of the State-of-the-Art , 2018, IEEE Access.

[39]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[40]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[41]  K. Deb,et al.  Understanding knee points in bicriteria problems and their implications as preferred solution principles , 2011 .

[42]  Qingfu Zhang,et al.  Comparison between MOEA/D and NSGA-III on a set of novel many and multi-objective benchmark problems with challenging difficulties , 2019, Swarm Evol. Comput..

[43]  Tao Zhang,et al.  A multi-objective co-evolutionary algorithm for energy-efficient scheduling on a green data center , 2016, Comput. Oper. Res..

[44]  Soon-Thiam Khu,et al.  An Investigation on Preference Order Ranking Scheme for Multiobjective Evolutionary Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[45]  Markus Olhofer,et al.  A Method for a Posteriori Identification of Knee Points Based on Solution Density , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).