A hyper-heuristic of scalarizing functions

Scalarizing functions have been successfully used by Multi-Objective Evolutionary Algorithms (MOEAs) for the fitness assignment process. Their popularity has to do with their low computational cost, their capability to generate (weakly) Pareto optimal solutions, and their effectiveness in solving many-objective optimization problems. Nevertheless, recent studies indicate that the search behavior of MOEAs strongly depends on the choice of the scalarizing function. Besides, this specification varies according to the Pareto-front geometry of the problem at hand. In this work, we present a novel hyper-heuristic for continuous search spaces, which combines the strengths and compensates for the weaknesses of different scalarizing functions. These heuristics have been proposed within the evolutionary multi-objective optimization and mathematical programming communities. Furthermore, the selection of heuristics is conducted through the s-energy, which measures the even distribution of a set of points in k-dimensional manifolds. Experimental results indicate that our proposed approach outperforms the use of a single heuristic as well as other state-of-the-art algorithms in the majority of the ZDT, DTLZ and WFG test problems.

[1]  Carolina P. de Almeida,et al.  MOEA/D-HH: A Hyper-Heuristic for Multi-objective Problems , 2015, EMO.

[2]  Shengxiang Yang,et al.  Improving the multiobjective evolutionary algorithm based on decomposition with new penalty schemes , 2017, Soft Comput..

[3]  Xin Yao,et al.  Many-Objective Evolutionary Algorithms , 2015, ACM Comput. Surv..

[4]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[5]  David J. Walker,et al.  Towards Many-Objective Optimisation with Hyper-heuristics: Identifying Good Heuristics with Indicators , 2016, PPSN.

[6]  E. Hughes Multiple single objective Pareto sampling , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[7]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[8]  Gabriele Eichfelder,et al.  An Adaptive Scalarization Method in Multiobjective Optimization , 2008, SIAM J. Optim..

[9]  Hisao Ishibuchi,et al.  Adaptation of Scalarizing Functions in MOEA/D: An Adaptive Scalarizing Function-Based Multiobjective Evolutionary Algorithm , 2009, EMO.

[10]  Carlos A. Coello Coello,et al.  An Overview of Weighted and Unconstrained Scalarizing Functions , 2017, EMO.

[11]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[12]  A. Messac,et al.  Aggregate Objective Functions and Pareto Frontiers: Required Relationships and Practical Implications , 2000 .

[13]  Tong Heng Lee,et al.  Multiobjective Evolutionary Algorithms and Applications , 2005, Advanced Information and Knowledge Processing.

[14]  Michael T. M. Emmerich,et al.  On Quality Indicators for Black-Box Level Set Approximation , 2013, EVOLVE.

[15]  Carlos A. Brizuela,et al.  A survey on multi-objective evolutionary algorithms for many-objective problems , 2014, Computational Optimization and Applications.

[16]  David J. Walker,et al.  Multi-objective Optimisation with a Sequence-based Selection Hyper-heuristic , 2016, GECCO.

[17]  Carlos A. Coello Coello,et al.  Improved Metaheuristic Based on the R2 Indicator for Many-Objective Optimization , 2015, GECCO.

[18]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[19]  E. Saff,et al.  Discretizing Manifolds via Minimum Energy Points , 2004 .

[20]  Tong Heng Lee,et al.  Multiobjective Evolutionary Algorithms and Applications (Advanced Information and Knowledge Processing) , 2005 .

[21]  Eckart Zitzler,et al.  Evolutionary algorithms for multiobjective optimization: methods and applications , 1999 .

[22]  Qingfu Zhang,et al.  Decomposition-Based Algorithms Using Pareto Adaptive Scalarizing Methods , 2016, IEEE Transactions on Evolutionary Computation.

[23]  Kalyanmoy Deb,et al.  Multiobjective Problem Solving from Nature: From Concepts to Applications , 2008, Natural Computing Series.

[24]  Hisao Ishibuchi,et al.  A multi-objective genetic local search algorithm and its application to flowshop scheduling , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[25]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[26]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[27]  Hisao Ishibuchi,et al.  Behavior of Multiobjective Evolutionary Algorithms on Many-Objective Knapsack Problems , 2015, IEEE Transactions on Evolutionary Computation.

[28]  Kalyanmoy Deb,et al.  Multiobjective Problem Solving from Nature: From Concepts to Applications (Natural Computing Series) , 2008 .

[29]  Michel Gendreau,et al.  Hyper-heuristics: a survey of the state of the art , 2013, J. Oper. Res. Soc..

[30]  Hisao Ishibuchi,et al.  Simultaneous use of different scalarizing functions in MOEA/D , 2010, GECCO '10.

[31]  J. Dennis,et al.  A closer look at drawbacks of minimizing weighted sums of objectives for Pareto set generation in multicriteria optimization problems , 1997 .