Reference point based evolutionary multi-objective optimization algorithms with convergence properties using KKTPM and ASF metrics

In a preference-based multi-objective optimization task, the goal is to find a subset of the Pareto-optimal set close to a supplied set of aspiration points. The reference point based non-dominated sorting genetic algorithm (R-NSGA-II) was proposed for such problem-solving tasks. R-NSGA-II aims to finding Pareto-optimal points close, in the sense of Euclidean distance in the objective space, to the supplied aspiration points, instead of finding the entire Pareto-optimal set. In this paper, R-NSGA-II method is modified using recently proposed Karush–Kuhn–Tucker proximity measure (KKTPM) and achievement scalarization function (ASF) metrics, instead of Euclidean distance metric. While a distance measure may not produce desired solutions, KKTPM-based distance measure allows a theoretically-convergent local or global Pareto solutions satisfying KKT optimality conditions and the ASF measure allows Pareto-compliant solutions to be found. A new technique for calculating KKTPM measure of a solution in the presence of an aspiration point is developed in this paper. The proposed modified R-NSGA-II methods are able to solve as many as 10-objective problems as effectively or better than the existing R-NSGA-II algorithm.

[1]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[2]  Qingfu Zhang,et al.  Adaptive Replacement Strategies for MOEA/D , 2016, IEEE Transactions on Cybernetics.

[3]  Xin Yao,et al.  A benchmark test suite for evolutionary many-objective optimization , 2017, Complex & Intelligent Systems.

[4]  Kalyanmoy Deb,et al.  An Optimality Theory Based Proximity Measure for Evolutionary Multi-Objective and Many-Objective Optimization , 2015, EMO.

[5]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[6]  Xin Yao,et al.  Integration of Preferences in Decomposition Multiobjective Optimization , 2017, IEEE Transactions on Cybernetics.

[7]  Andrzej P. Wierzbicki,et al.  The Use of Reference Objectives in Multiobjective Optimization , 1979 .

[8]  J. Branke,et al.  Guidance in evolutionary multi-objective optimization , 2001 .

[9]  Licheng Jiao,et al.  Interactive Reference Region Based Multi-Objective Evolutionary Algorithm Through Decomposition , 2016, IEEE Access.

[10]  Kalyanmoy Deb,et al.  An Optimality Theory-Based Proximity Measure for Set-Based Multiobjective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[11]  Xiaodong Li,et al.  Integrating user preferences and decomposition methods for many-objective optimization , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[12]  Shengxiang Yang,et al.  An adaptation reference-point-based multiobjective evolutionary algorithm , 2019, Inf. Sci..

[13]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[14]  Kuangrong Hao,et al.  A Clustering-Based Adaptive Evolutionary Algorithm for Multiobjective Optimization With Irregular Pareto Fronts , 2019, IEEE Transactions on Cybernetics.

[15]  K. Deb Solving goal programming problems using multi-objective genetic algorithms , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[16]  Milosz Kadzinski,et al.  Robust indicator-based algorithm for interactive evolutionary multiple objective optimization , 2019, GECCO.

[17]  Yuren Zhou,et al.  Evolutionary Many-Objective Optimization Based on Dynamical Decomposition , 2019, IEEE Transactions on Evolutionary Computation.

[18]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[19]  Xin Yao,et al.  Interactive Decomposition Multiobjective Optimization Via Progressively Learned Value Functions , 2018, IEEE Transactions on Fuzzy Systems.

[20]  Carlos A. Coello Coello,et al.  g-dominance: Reference point based dominance for multiobjective metaheuristics , 2009, Eur. J. Oper. Res..

[21]  Hisao Ishibuchi,et al.  A multi-objective genetic local search algorithm and its application to flowshop scheduling , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[22]  Licheng Jiao,et al.  Multi-layer interaction preference based multi-objective evolutionary algorithm through decomposition , 2020, Inf. Sci..

[23]  Kalyanmoy Deb,et al.  Reference point based multi-objective optimization using evolutionary algorithms , 2006, GECCO.

[24]  Qingfu Zhang,et al.  Decomposition of a Multiobjective Optimization Problem Into a Number of Simple Multiobjective Subproblems , 2014, IEEE Transactions on Evolutionary Computation.

[25]  Yuanyuan Jia,et al.  An improved reference point based multi-objective optimization by decomposition , 2016, Int. J. Mach. Learn. Cybern..

[26]  Peter J. Fleming,et al.  The iPICEA-g: a new hybrid evolutionary multi-criteria decision making approach using the brushing technique , 2015, Eur. J. Oper. Res..

[27]  Kalyanmoy Deb,et al.  On finding multiple Pareto-optimal solutions using classical and evolutionary generating methods , 2007, Eur. J. Oper. Res..

[28]  Liang Sun,et al.  A Many-Objective Evolutionary Algorithm With Two Interacting Processes: Cascade Clustering and Reference Point Incremental Learning , 2018, IEEE Transactions on Evolutionary Computation.

[29]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[30]  Fang Liu,et al.  MOEA/D with biased weight adjustment inspired by user preference and its application on multi-objective reservoir flood control problem , 2016, Soft Comput..

[31]  Yiu-Ming Cheung,et al.  Self-Organizing Map-Based Weight Design for Decomposition-Based Many-Objective Evolutionary Algorithm , 2018, IEEE Transactions on Evolutionary Computation.

[32]  Kalyanmoy Deb,et al.  Multiphase Balance of Diversity and Convergence in Multiobjective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[33]  Wen Zhu,et al.  A modified PBI approach for multi-objective optimization with complex Pareto fronts , 2018, Swarm Evol. Comput..

[34]  Qingfu Zhang,et al.  Learning to Decompose: A Paradigm for Decomposition-Based Multiobjective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[35]  Andrzej Jaszkiewicz,et al.  On the performance of multiple-objective genetic local search on the 0/1 knapsack problem - a comparative experiment , 2002, IEEE Trans. Evol. Comput..

[36]  Qingfu Zhang,et al.  Enhancing MOEA/D with guided mutation and priority update for multi-objective optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[37]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[38]  Hisao Ishibuchi,et al.  Adapting Reference Vectors and Scalarizing Functions by Growing Neural Gas to Handle Irregular Pareto Fronts , 2020, IEEE Transactions on Evolutionary Computation.

[39]  Xin Yao,et al.  Does Preference Always Help? A Holistic Study on Preference-Based Evolutionary Multiobjective Optimization Using Reference Points , 2019, IEEE Transactions on Evolutionary Computation.

[40]  Fang Liu,et al.  MOEA/D with Adaptive Weight Adjustment , 2014, Evolutionary Computation.

[41]  Kalyanmoy Deb,et al.  Towards faster convergence of evolutionary multi-criterion optimization algorithms using Karush Kuhn Tucker optimality based local search , 2017, Comput. Oper. Res..

[42]  Kalyanmoy Deb,et al.  Approximate KKT points and a proximity measure for termination , 2013, J. Glob. Optim..

[43]  Kalyanmoy Deb,et al.  A smooth proximity measure for optimality in multi-objective optimization using Benson's method , 2020, Comput. Oper. Res..

[44]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[45]  Khaled Ghédira,et al.  The r-Dominance: A New Dominance Relation for Interactive Evolutionary Multicriteria Decision Making , 2010, IEEE Transactions on Evolutionary Computation.

[46]  Jinhua Zheng,et al.  Decomposing the user-preference in multiobjective optimization , 2016, Soft Comput..

[47]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[48]  Qingfu Zhang,et al.  On the use of random weights in MOEA/D , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[49]  Michał K. Tomczyk,et al.  Decomposition-Based Interactive Evolutionary Algorithm for Multiple Objective Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[50]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[51]  Kalyanmoy Deb,et al.  Distributed Computing of Pareto-Optimal Solutions with Evolutionary Algorithms , 2003, EMO.

[52]  Tapabrata Ray,et al.  An Enhanced Decomposition-Based Evolutionary Algorithm With Adaptive Reference Vectors , 2018, IEEE Transactions on Cybernetics.

[53]  Kalyanmoy Deb,et al.  Reference Point Based NSGA-III for Preferred Solutions , 2018, 2018 IEEE Symposium Series on Computational Intelligence (SSCI).

[54]  Mohamed Abouhawwash,et al.  Evolutionary Multi-objective Optimization Using Benson's Karush-Kuhn-Tucker Proximity Measure , 2019, EMO.

[55]  Xin Yao,et al.  R-Metric: Evaluating the Performance of Preference-Based Evolutionary Multiobjective Optimization Using Reference Points , 2018, IEEE Transactions on Evolutionary Computation.

[56]  Kalyanmoy Deb,et al.  A Computationally Fast Convergence Measure and Implementation for Single-, Multiple-, and Many-Objective Optimization , 2017, IEEE Transactions on Emerging Topics in Computational Intelligence.

[57]  Heike Trautmann,et al.  Preference Articulation by Means of the R2 Indicator , 2013, EMO.

[58]  Xiaodong Li,et al.  Using a distance metric to guide PSO algorithms for many-objective optimization , 2009, GECCO.

[59]  Ye Tian,et al.  An Indicator-Based Multiobjective Evolutionary Algorithm With Reference Point Adaptation for Better Versatility , 2018, IEEE Transactions on Evolutionary Computation.

[60]  Qingfu Zhang,et al.  Decomposition-Based Algorithms Using Pareto Adaptive Scalarizing Methods , 2016, IEEE Transactions on Evolutionary Computation.

[61]  Bernhard Sendhoff,et al.  Adapting Weighted Aggregation for Multiobjective Evolution Strategies , 2001, EMO.

[62]  Xinye Cai,et al.  A Decomposition-Based Many-Objective Evolutionary Algorithm With Two Types of Adjustments for Direction Vectors , 2018, IEEE Transactions on Cybernetics.

[63]  Peter J. Fleming,et al.  On the Performance Assessment and Comparison of Stochastic Multiobjective Optimizers , 1996, PPSN.

[64]  Xiaodong Li,et al.  Reference point based multi-objective optimization through decomposition , 2012, 2012 IEEE Congress on Evolutionary Computation.

[65]  Gang Chen,et al.  A PSO-Based Reference Point Adaption Method for Genetic Programming Hyper-Heuristic in Many-Objective Job Shop Scheduling , 2017, ACALCI.

[66]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[67]  Roger M. Y. Ho,et al.  Goal programming and extensions , 1976 .

[68]  Yutao Qi,et al.  User-preference based decomposition in MOEA/D without using an ideal point , 2019, Swarm Evol. Comput..

[69]  Tapabrata Ray,et al.  A Decomposition-Based Evolutionary Algorithm for Many Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[70]  Qingfu Zhang,et al.  Stable Matching-Based Selection in Evolutionary Multiobjective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[71]  Hisao Ishibuchi,et al.  Difficulties in specifying reference points to calculate the inverted generational distance for many-objective optimization problems , 2014, 2014 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making (MCDM).

[72]  Kalyanmoy Deb,et al.  Light beam search based multi-objective optimization using evolutionary algorithms , 2007, 2007 IEEE Congress on Evolutionary Computation.

[73]  E. Zitzler,et al.  Directed Multiobjective Optimization Based on the Weighted Hypervolume Indicator , 2013 .

[74]  Qingfu Zhang,et al.  Adaptively Allocating Search Effort in Challenging Many-Objective Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[75]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[76]  Qingwei Chen,et al.  A multi-objective optimization evolutionary algorithm incorporating preference information based on fuzzy logic , 2010, Comput. Optim. Appl..

[77]  Carlos A. Brizuela,et al.  A survey on multi-objective evolutionary algorithms for many-objective problems , 2014, Computational Optimization and Applications.

[78]  Hai-Lin Liu,et al.  A Novel Weight Design in Multi-objective Evolutionary Algorithm , 2010, 2010 International Conference on Computational Intelligence and Security.

[79]  Witold Pedrycz,et al.  Recent Advances on Hybrid Approaches for Designing Intelligent Systems , 2014, Recent Advances on Hybrid Approaches for Designing Intelligent Systems.

[80]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[81]  Peter J. Fleming,et al.  Preference-inspired co-evolutionary algorithms using weight vectors , 2015, Eur. J. Oper. Res..

[82]  Kalyanmoy Deb,et al.  Multi-objective evolutionary algorithms: introducing bias among Pareto-optimal solutions , 2003 .

[83]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[84]  Yuren Zhou,et al.  A Vector Angle-Based Evolutionary Algorithm for Unconstrained Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[85]  Bin Zhang,et al.  Decomposition-based sub-problem optimal solution updating direction-guided evolutionary many-objective algorithm , 2018, Inf. Sci..

[86]  Hisao Ishibuchi,et al.  Adaptation of Scalarizing Functions in MOEA/D: An Adaptive Scalarizing Function-Based Multiobjective Evolutionary Algorithm , 2009, EMO.

[87]  Ke Ma,et al.  Entropy based evolutionary algorithm with adaptive reference points for many-objective optimization problems , 2018, Inf. Sci..

[88]  Qingfu Zhang,et al.  Interactive MOEA/D for multi-objective decision making , 2011, GECCO '11.

[89]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[90]  Bo Zhang,et al.  Balancing Convergence and Diversity in Decomposition-Based Many-Objective Optimizers , 2016, IEEE Transactions on Evolutionary Computation.

[91]  Kalyanmoy Deb,et al.  Interactive evolutionary multi-objective optimization and decision-making using reference direction method , 2007, GECCO '07.