Knee based multimodal multi-objective evolutionary algorithm for decision making

Abstract Recently, many advanced multimodal multi-objective evolutionary algorithms (MMOEAs) have been presented to solve multimodal multi-objective optimization problems (MMOPs). However, most of these approaches struggle not only to find the entire Pareto sets and Pareto front, but also ignoring the problem of Multi-Criteria Decision Making (MCDM) to be handled at a later stage. As a matter of fact, it is a very eclectic and challenging burden for decision makers to choose some trade-off optimal solutions from an enormous collection of non-dominated Pareto-optimal individuals. In this paper, we propose a knee based evolutionary algorithm, named MMO-EvoKnee, which incorporates MCDM strategy into solving MMOPs. The proposed algorithm is designed to search for a complete set of global knee solutions instead of an entire Pareto front and Pareto sets. Firstly, the EvoKnee Selection is adopted to find target global knee solutions and boundary individuals. Secondly, the Knee Multimodal Solutions Selection focuses on decision space exploitation to obtain well-converged multiple Pareto-optimal knee solutions. Thirdly, the Maximum Spanning Subset Selection is designed to accurately identify a complete number of knee solutions from overcrowded Pareto regions. Fourthly, the Boundary Multimodal Solutions Selection can find and maintain well-diversified and well-converged boundary solutions. As a result, MMO-EvoKnee can consistently find all knee solutions of interest quickly, and it relieves the burden for decision makers. Finally, the performance of the proposed algorithm is evaluated on thirteen benchmark MMOPs. The experiment results clearly show that the proposed MMO-EvoKnee provides a competitive edge over the chosen state-of-the-art MMOEAs.

[1]  Taho Yang,et al.  The use of grey relational analysis in solving multiple attribute decision-making problems , 2008, Comput. Ind. Eng..

[2]  Tapabrata Ray,et al.  A Study on Performance Metrics to Identify Solutions of Interest from a Trade-Off Set , 2016, ACALCI.

[3]  Ye Tian,et al.  A Knee Point-Driven Evolutionary Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[4]  Qingfu Zhang,et al.  Approximating the Set of Pareto-Optimal Solutions in Both the Decision and Objective Spaces by an Estimation of Distribution Algorithm , 2009, IEEE Transactions on Evolutionary Computation.

[5]  Kalyanmoy Deb,et al.  Omni-optimizer: A generic evolutionary algorithm for single and multi-objective optimization , 2008, Eur. J. Oper. Res..

[6]  Hisao Ishibuchi,et al.  A Review of Evolutionary Multi-modal Multi-objective Optimization , 2020, arXiv.org.

[7]  Kai Zhang,et al.  Evolution Strategy-Based Many-Objective Evolutionary Algorithm Through Vector Equilibrium , 2020, IEEE Transactions on Cybernetics.

[8]  David E. Goldberg,et al.  Genetic Algorithms, Tournament Selection, and the Effects of Noise , 1995, Complex Syst..

[9]  Luca Martino,et al.  Parallel Metropolis–Hastings Coupler , 2019, IEEE Signal Processing Letters.

[10]  Hisao Ishibuchi,et al.  Handling Imbalance Between Convergence and Diversity in the Decision Space in Evolutionary Multimodal Multiobjective Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[11]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[12]  Jing J. Liang,et al.  A Multiobjective Particle Swarm Optimizer Using Ring Topology for Solving Multimodal Multiobjective Problems , 2018, IEEE Transactions on Evolutionary Computation.

[13]  Hisao Ishibuchi,et al.  A niching indicator-based multi-modal many-objective optimizer , 2019, Swarm Evol. Comput..

[14]  Marco Laumanns,et al.  Approximating the Knee of an MOP with Stochastic Search Algorithms , 2008, PPSN.

[15]  Hisao Ishibuchi,et al.  A Double-Niched Evolutionary Algorithm and Its Behavior on Polygon-Based Problems , 2018, PPSN.

[16]  Indraneel Das On characterizing the “knee” of the Pareto curve based on Normal-Boundary Intersection , 1999 .

[17]  Anne Auger,et al.  Theory of the hypervolume indicator: optimal μ-distributions and the choice of the reference point , 2009, FOGA '09.

[18]  R. Prim Shortest connection networks and some generalizations , 1957 .

[19]  Tapabrata Ray,et al.  Bridging the Gap: Many-Objective Optimization and Informed Decision-Making , 2017, IEEE Transactions on Evolutionary Computation.

[20]  Gary G. Yen,et al.  Minimum Manhattan Distance Approach to Multiple Criteria Decision Making in Multiobjective Optimization Problems , 2016, IEEE Transactions on Evolutionary Computation.

[21]  Jing J. Liang,et al.  Multimodal multiobjective optimization with differential evolution , 2019, Swarm Evol. Comput..

[22]  M. Ehsan Shafiee,et al.  An evolutionary algorithm approach to generate distinct sets of non-dominated solutions for wicked problems , 2013, Eng. Appl. Artif. Intell..

[23]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[24]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[25]  J. Jacoby,et al.  Brand Choice Behavior as a Function of Information Load , 1974 .

[26]  Kai Zhang,et al.  Evolutionary Algorithm for Knee-Based Multiple Criteria Decision Making , 2019, IEEE Transactions on Cybernetics.

[27]  Jukka Corander,et al.  Orthogonal parallel MCMC methods for sampling and optimization , 2015, Digit. Signal Process..

[28]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[29]  Xiaodong Li,et al.  Seeking Multiple Solutions: An Updated Survey on Niching Methods and Their Applications , 2017, IEEE Transactions on Evolutionary Computation.

[30]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[31]  Xin Yao,et al.  Many-Objective Evolutionary Algorithms , 2015, ACM Comput. Surv..

[32]  Fernando José Von Zuben,et al.  A Concentration-Based Artificial Immune Network for Multi-objective Optimization , 2011, EMO.

[33]  Gary G. Yen,et al.  A Multimodal Multiobjective Evolutionary Algorithm Using Two-Archive and Recombination Strategies , 2019, IEEE Transactions on Evolutionary Computation.

[34]  K. Steiglitz,et al.  Adaptive step size random search , 1968 .

[35]  Ernesto Benini,et al.  Genetic Diversity as an Objective in Multi-Objective Evolutionary Algorithms , 2003, Evolutionary Computation.

[36]  Ofer M. Shir,et al.  Enhancing Decision Space Diversity in Evolutionary Multiobjective Algorithms , 2009, EMO.

[37]  K. Deb,et al.  Understanding knee points in bicriteria problems and their implications as preferred solution principles , 2011 .

[38]  Hisao Ishibuchi,et al.  A Review of Evolutionary Multimodal Multiobjective Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[39]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[40]  C. Geyer Markov Chain Monte Carlo Maximum Likelihood , 1991 .

[41]  Morteza Yazdani,et al.  A state-of the-art survey of TOPSIS applications , 2012, Expert Syst. Appl..