Investigating the equivalence between PBI and AASF scalarization for multi-objective optimization

Abstract Scalarization refers to a generic class of methods to combine multiple conflicting objectives into one in order to find a Pareto optimal solution to the original problem. Augmented achievement scalarizing function (AASF) is one such method used popularly in the multi-criterion decision-making (MCDM) field. In evolutionary multi-objective optimization (EMO) literature, scalarization methods such as penalty boundary intersection (PBI) are commonly used to compare similar solutions within a population. Both AASF and PBI methods require a reference point and a reference direction for their calculation. In this paper, we aim to analytically derive and understand the commonalities between these two metrics and gain insights into the limitations of their standard parametric forms. We show that it is possible to find an equivalent modified AASF formulation for a given PBI parameter and vice versa for bi-objective problems. Numerical experiments are presented to validate the theory developed. We further discuss the challenges in extending this to higher objectives and show that it is still possible to achieve limited equivalence along symmetric reference vectors. The study connects the two philosophies of solving multi-objective optimization problems, provides a means to gain a deeper understanding of both these measures, and expands their parametric range to provide more flexibility of controlling the search behavior of the EMO algorithms.

[1]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[2]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[3]  Dipti Srinivasan,et al.  A Survey of Multiobjective Evolutionary Algorithms Based on Decomposition , 2017, IEEE Transactions on Evolutionary Computation.

[4]  Andrzej P. Wierzbicki,et al.  The Use of Reference Objectives in Multiobjective Optimization , 1979 .

[5]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[6]  Hisao Ishibuchi,et al.  Indicator-based evolutionary algorithm with hypervolume approximation by achievement scalarizing functions , 2010, GECCO '10.

[7]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[8]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[9]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[10]  Kaisa Miettinen,et al.  On scalarizing functions in multiobjective optimization , 2002, OR Spectr..

[11]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[12]  Kaisa Miettinen,et al.  A two-slope achievement scalarizing function for interactive multiobjective optimization , 2012, Comput. Oper. Res..

[13]  Kalyanmoy Deb,et al.  An Optimality Theory-Based Proximity Measure for Set-Based Multiobjective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[14]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[15]  Gabriele Eichfelder,et al.  Adaptive Scalarization Methods in Multiobjective Optimization , 2008, Vector Optimization.

[16]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[17]  Hisao Ishibuchi,et al.  Reference Point Specification in Inverted Generational Distance for Triangular Linear Pareto Front , 2018, IEEE Transactions on Evolutionary Computation.

[18]  Junichi Suzuki,et al.  R2-IBEA: R2 indicator based evolutionary algorithm for multiobjective optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[19]  Heike Trautmann,et al.  R2-EMOA: Focused Multiobjective Search Using R2-Indicator-Based Selection , 2013, LION.

[20]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization: A short review , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[21]  Shengxiang Yang,et al.  Improving the multiobjective evolutionary algorithm based on decomposition with new penalty schemes , 2017, Soft Comput..

[22]  Tapabrata Ray,et al.  A Decomposition-Based Evolutionary Algorithm for Many Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[23]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[24]  P. Siarry,et al.  Multiobjective Optimization: Principles and Case Studies , 2004 .

[25]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[26]  Y. Xie,et al.  Multicriterion Evolutionary Structural Optimization Using the Weighting and the Global Criterion Methods , 2001 .

[27]  Lothar Thiele,et al.  The Hypervolume Indicator Revisited: On the Design of Pareto-compliant Indicators Via Weighted Integration , 2007, EMO.

[28]  Ye Tian,et al.  PlatEMO: A MATLAB Platform for Evolutionary Multi-Objective Optimization [Educational Forum] , 2017, IEEE Computational Intelligence Magazine.

[29]  T. L. Saaty,et al.  The computational algorithm for the parametric objective function , 1955 .

[30]  Martina Gorges-Schleuter,et al.  Application of Genetic Algorithms to Task Planning and Learning , 1992, Parallel Problem Solving from Nature.

[31]  Kaisa Miettinen,et al.  A new achievement scalarizing function based on parameterization in multiobjective optimization , 2010, OR Spectrum.

[32]  Tapabrata Ray,et al.  Multiple Surrogate-Assisted Many-Objective Optimization for Computationally Expensive Engineering Design , 2018 .

[33]  Johannes Jahn,et al.  Scalarization in Multi Objective Optimization , 1985 .

[34]  Xin Yao,et al.  A New Dominance Relation-Based Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[35]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[36]  Hisao Ishibuchi,et al.  A Study on the Specification of a Scalarizing Function in MOEA/D for Many-Objective Knapsack Problems , 2013, LION.

[37]  Kalyanmoy Deb,et al.  An Interactive Evolutionary Multiobjective Optimization Method Based on Progressively Approximated Value Functions , 2010, IEEE Transactions on Evolutionary Computation.

[38]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[39]  Yong Wang,et al.  Scalarizing Functions in Decomposition-Based Multiobjective Evolutionary Algorithms , 2018, IEEE Transactions on Evolutionary Computation.

[40]  Tao Zhang,et al.  Localized Weighted Sum Method for Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[41]  Mohamed Abouhawwash,et al.  KKT Proximity Measure Versus Augmented Achievement Scalarization Function , 2018 .

[42]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.