Objective Extraction for Many-Objective Optimization Problems: Algorithm and Test Problems

For many-objective optimization problems (MaOPs), in which the number of objectives is greater than three, the performance of most existing evolutionary multi-objective optimization algorithms generally deteriorates over the number of objectives. As some MaOPs may have redundant or correlated objectives, it is desirable to reduce the number of the objectives in such circumstances. However, the Pareto solution of the reduced MaOP obtained by most of the existing objective reduction methods, based on objective selection, may not be the Pareto solution of the original MaOP. In this paper, we propose an objective extraction method (OEM) for MaOPs. It formulates the reduced objective as a linear combination of the original objectives to maximize the conflict between the reduced objectives. Subsequently, the Pareto solution of the reduced MaOP obtained by the proposed algorithm is that of the original MaOP, and the proposed algorithm can thus preserve the dominance structure as much as possible. Moreover, we propose a novel framework that features both simple and complicated Pareto set shapes for many-objective test problems with an arbitrary number of essential objectives. Within this framework, we can control the importance of essential objectives. As there is no direct performance metric for the objective reduction algorithms on the benchmarks, we present a new metric that features simplicity and usability for the objective reduction algorithms. We compare the proposed OEM with three objective reduction methods, i.e., REDGA, L-PCA, and NL-MVU-PCA, on the proposed test problems and benchmark DTLZ5 with different numbers of objectives and essential objectives. Our numerical studies show the effectiveness and robustness of the proposed approach.

[1]  Lishan Kang,et al.  A New Evolutionary Algorithm for Solving Many-Objective Optimization Problems , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Qingfu Zhang,et al.  Decomposition of a Multiobjective Optimization Problem Into a Number of Simple Multiobjective Subproblems , 2014, IEEE Transactions on Evolutionary Computation.

[3]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[4]  Kiyoshi Tanaka,et al.  Objective space partitioning using conflict information for solving many-objective problems , 2014, Inf. Sci..

[5]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization , 2008, 2008 3rd International Workshop on Genetic and Evolving Systems.

[6]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[7]  Paul H. Calamai,et al.  Projected gradient methods for linearly constrained problems , 1987, Math. Program..

[8]  Mario Köppen,et al.  Substitute Distance Assignments in NSGA-II for Handling Many-objective Optimization Problems , 2007, EMO.

[9]  Shengli Xie,et al.  On Solving WCDMA Network Planning Using Iterative Power Control Scheme and Evolutionary Multiobjective Algorithm [Application Notes] , 2014, IEEE Computational Intelligence Magazine.

[10]  Tapabrata Ray,et al.  Six-Sigma Robust Design Optimization Using a Many-Objective Decomposition-Based Evolutionary Algorithm , 2015, IEEE Transactions on Evolutionary Computation.

[11]  Yuping Wang,et al.  An improved $${\alpha }$$α-dominance strategy for many-objective optimization problems , 2016, Soft Comput..

[12]  Jonathan E. Fieldsend,et al.  Visualizing Mutually Nondominating Solution Sets in Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[13]  Xin Yao,et al.  Corner Sort for Pareto-Based Many-Objective Optimization , 2014, IEEE Transactions on Cybernetics.

[14]  Qingfu Zhang,et al.  Framework for Many-Objective Test Problems with Both Simple and Complicated Pareto-Set Shapes , 2011, EMO.

[15]  Xiaodong Li,et al.  A Distance Metric for Evolutionary Many-Objective Optimization Algorithms Using User-Preferences , 2009, Australasian Conference on Artificial Intelligence.

[16]  Carlos A. Coello Coello,et al.  Study of preference relations in many-objective optimization , 2009, GECCO.

[17]  Marco Farina,et al.  A fuzzy definition of "optimality" for many-criteria optimization problems , 2004, IEEE Trans. Syst. Man Cybern. Part A.

[18]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[19]  Eckart Zitzler,et al.  Are All Objectives Necessary? On Dimensionality Reduction in Evolutionary Multiobjective Optimization , 2006, PPSN.

[20]  Eckart Zitzler,et al.  Objective Reduction in Evolutionary Multiobjective Optimization: Theory and Applications , 2009, Evolutionary Computation.

[21]  Tapabrata Ray,et al.  A Pareto Corner Search Evolutionary Algorithm and Dimensionality Reduction in Many-Objective Optimization Problems , 2011, IEEE Transactions on Evolutionary Computation.

[22]  Qingfu Zhang,et al.  Objective Reduction in Many-Objective Optimization: Linear and Nonlinear Algorithms , 2013, IEEE Transactions on Evolutionary Computation.

[23]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[24]  Tapabrata Ray,et al.  A Study on the Performance of Substitute Distance Based Approaches for Evolutionary Many Objective Optimization , 2008, SEAL.

[25]  Carlos A. Coello Coello,et al.  Objective reduction using a feature selection technique , 2008, GECCO '08.

[26]  DebK.,et al.  A fast and elitist multiobjective genetic algorithm , 2002 .

[27]  Mark Johnston,et al.  Automatic Design of Scheduling Policies for Dynamic Multi-objective Job Shop Scheduling via Cooperative Coevolution Genetic Programming , 2014, IEEE Transactions on Evolutionary Computation.

[28]  Carlos A. Coello Coello,et al.  On the Influence of the Number of Objectives on the Hardness of a Multiobjective Optimization Problem , 2011, IEEE Transactions on Evolutionary Computation.

[29]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[30]  Peter J. Fleming,et al.  An Adaptive Divide-and-ConquerMethodology forEvolutionary Multi-criterion Optimisation , 2003, EMO.

[31]  Patrick M. Reed,et al.  Borg: An Auto-Adaptive Many-Objective Evolutionary Computing Framework , 2013, Evolutionary Computation.

[32]  Hisao Ishibuchi,et al.  Difficulties in specifying reference points to calculate the inverted generational distance for many-objective optimization problems , 2014, 2014 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making (MCDM).

[33]  Sanghamitra Bandyopadhyay,et al.  An Algorithm for Many-Objective Optimization With Reduced Objective Computations: A Study in Differential Evolution , 2015, IEEE Transactions on Evolutionary Computation.

[34]  Hisao Ishibuchi,et al.  Behavior of Multiobjective Evolutionary Algorithms on Many-Objective Knapsack Problems , 2015, IEEE Transactions on Evolutionary Computation.

[35]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[36]  Yiu-ming Cheung,et al.  On Solving Complex Optimization Problems with Objective Decomposition , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[37]  Tapabrata Ray,et al.  A Decomposition-Based Evolutionary Algorithm for Many Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[38]  Kazuyuki Murase,et al.  Evolutionary Path Control Strategy for Solving Many-Objective Optimization Problem , 2015, IEEE Transactions on Cybernetics.

[39]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[40]  Yiu-ming Cheung,et al.  Online objective reduction for many-objective optimization problems , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[41]  Tomas Gal,et al.  Redundant objective functions in linear vector maximum problems and their determination , 1977 .

[42]  Hua Xu,et al.  An improved NSGA-III procedure for evolutionary many-objective optimization , 2014, GECCO.

[43]  Frederico G. Guimarães,et al.  A comparison of dominance criteria in many-objective optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[44]  Kalyanmoy Deb,et al.  Reference point based multi-objective optimization using evolutionary algorithms , 2006, GECCO.

[45]  Carlos A. Coello Coello,et al.  Online Objective Reduction to Deal with Many-Objective Problems , 2009, EMO.

[46]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[47]  Ujjwal Maulik,et al.  A Survey of Multiobjective Evolutionary Algorithms for Data Mining: Part I , 2014, IEEE Transactions on Evolutionary Computation.

[48]  Gary G. Yen,et al.  Diversity improvement in Decomposition-Based Multi-Objective Evolutionary Algorithm for many-objective optimization problems , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[49]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[50]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[51]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..