Simultaneous use of two normalization methods in decomposition-based multi-objective evolutionary algorithms

Abstract In real-world applications, the order of magnitude in each objective varies, whereas most of fitness evaluation methods in many-objective solvers are scaling dependent. Objective space normalization has a large effect on the performance of each algorithm (i.e., on the practical applicability of each algorithm to real-world problems). In order to put equal emphasis on each objective, a normalization mechanism is always encouraged to be employed in the framework of the algorithm. Decomposition-based algorithms have become more and more popular in many-objective optimization. MOEA/D is a representative decomposition-based algorithm. Recently, some negative effects of normalization have been reported, which may deteriorate the practical applicability of MOEA/D to real-world problems. In this paper, to remedy the performance deterioration introduced by normalization in MOEA/D, we propose an idea of using two types of normalization methods in MOEA/D simultaneously (denoted as MOEA/D-2N). The proposed idea is compared with the standard MOEA/D and MOEA/D with normalization (denoted as MOEA/D-N) via two widely-used test suites (as well as their variants) and a real-world optimization problem. Experimental results show that MOEA/D-2N can effectively evolve a more diverse set of solutions and achieve robust and comparable performance compared with the standard MOEA/D and MOEA/D-N.

[1]  Jeremy E. Oakley,et al.  Component-level study of a decomposition-based multi-objective optimizer on a limited evaluation budget , 2018, GECCO.

[2]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[3]  Slim Bechikh,et al.  A New Decomposition-Based NSGA-II for Many-Objective Optimization , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[4]  Kalyanmoy Deb,et al.  NSGA-NET: A Multi-Objective Genetic Algorithm for Neural Architecture Search , 2018, ArXiv.

[5]  Dipti Srinivasan,et al.  A MOEA/D with Non-uniform Weight Vector Distribution Strategy for Solving the Unit Commitment Problem in Uncertain Environment , 2017, ACALCI.

[6]  Xin Yao,et al.  A New Dominance Relation-Based Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[7]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[8]  Dipti Srinivasan,et al.  A Survey of Multiobjective Evolutionary Algorithms Based on Decomposition , 2017, IEEE Transactions on Evolutionary Computation.

[9]  Hisao Ishibuchi,et al.  Hypervolume Subset Selection for Triangular and Inverted Triangular Pareto Fronts of Three-Objective Problems , 2017, FOGA '17.

[10]  Hisao Ishibuchi,et al.  Performance of Decomposition-Based Many-Objective Algorithms Strongly Depends on Pareto Front Shapes , 2017, IEEE Transactions on Evolutionary Computation.

[11]  Hisao Ishibuchi,et al.  How to Specify a Reference Point in Hypervolume Calculation for Fair Performance Comparison , 2018, Evolutionary Computation.

[12]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[13]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[14]  Hisao Ishibuchi,et al.  Reference point specification in hypervolume calculation for fair comparison and efficient search , 2017, GECCO.

[15]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[16]  Joseph J. Talavage,et al.  A Tradeoff Cut Approach to Multiple Objective Optimization , 1980, Oper. Res..

[17]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[18]  Kalyanmoy Deb,et al.  NSGA-Net: neural architecture search using multi-objective genetic algorithm , 2018, GECCO.

[19]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[20]  H. Ishibuchi,et al.  On the effect of normalization in MOEA/D for multi-objective and many-objective optimization , 2017 .

[21]  Tapabrata Ray,et al.  Adaptive Sorting-Based Evolutionary Algorithm for Many-Objective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[22]  Tao Zhang,et al.  Evolutionary Many-Objective Optimization: A Comparative Study of the State-of-the-Art , 2018, IEEE Access.

[23]  Tapabrata Ray,et al.  An Enhanced Decomposition-Based Evolutionary Algorithm With Adaptive Reference Vectors , 2018, IEEE Transactions on Cybernetics.

[24]  Fang Liu,et al.  MOEA/D with Adaptive Weight Adjustment , 2014, Evolutionary Computation.

[25]  Ye Tian,et al.  PlatEMO: A MATLAB Platform for Evolutionary Multi-Objective Optimization [Educational Forum] , 2017, IEEE Computational Intelligence Magazine.

[26]  Lucas Bradstreet,et al.  A Fast Way of Calculating Exact Hypervolumes , 2012, IEEE Transactions on Evolutionary Computation.

[27]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[28]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[29]  Qingfu Zhang,et al.  Adaptively Allocating Search Effort in Challenging Many-Objective Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[30]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[31]  Xin Yao,et al.  What Weights Work for You? Adapting Weights for Any Pareto Front Shape in Decomposition-Based Evolutionary Multiobjective Optimisation , 2017, Evolutionary Computation.

[32]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization: A short review , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).