Evolutionary multi and many-objective optimization via clustering for environmental selection

Abstract Recently, multi and many-objective evolutionary algorithms (MOEAs) embedded with clustering techniques to enhance their environmental selection show promising performance for tackling multi and many-objective optimization problems (MOPs) with irregular Pareto fronts (PFs). However, the similarity metric used for clustering cannot reflect the diversity of solutions fairly when it is measured based on the direction distances of solutions to an ideal point. Consequently, it may mislead the environmental selection when solving MOPs with convex PFs. To alleviate this issue, this paper suggests an MOEA using clustering with a flexible similarity metric to run the environmental selection. In our approach, we first use a simple yet effective method to roughly predict the concavity or convexity of the target problem. Then, a flexible reference point is set to define the direction distances of solutions, which can properly measure the similarity between solutions and fairly show their diversity for solving MOPs with various PF shapes. After that, we use a hierarchical clustering method with this flexible similarity metric to run the environmental selection on all solutions, which will properly classify them into N clusters (N is the population size). Finally, in each cluster, one solution with the best convergence value will survive to compose the new population. When compared to twenty-seven competitive MOEAs in solving nineteen benchmark MOPs and sixteen real-world engineering MOPs with various PF shapes, the experimental results demonstrate that the proposed algorithm has significant advantages.

[1]  Bernhard Sendhoff,et al.  A Multiobjective Evolutionary Algorithm Using Gaussian Process-Based Inverse Modeling , 2015, IEEE Transactions on Evolutionary Computation.

[2]  Witold Pedrycz,et al.  Hyperplane Assisted Evolutionary Algorithm for Many-Objective Optimization Problems , 2020, IEEE Transactions on Cybernetics.

[3]  Xin Yao,et al.  A benchmark test suite for evolutionary many-objective optimization , 2017, Complex & Intelligent Systems.

[4]  Shengxiang Yang,et al.  Shift-Based Density Estimation for Pareto-Based Algorithms in Many-Objective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[5]  Ye Tian,et al.  A Decision Variable Clustering-Based Evolutionary Algorithm for Large-Scale Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[6]  Yuren Zhou,et al.  A Many-Objective Evolutionary Algorithm With Pareto-Adaptive Reference Points , 2020, IEEE Transactions on Evolutionary Computation.

[7]  Ye Tian,et al.  Guiding Evolutionary Multiobjective Optimization With Generic Front Modeling , 2020, IEEE Transactions on Cybernetics.

[8]  Qingfu Zhang,et al.  Balancing exploration and exploitation in multiobjective evolutionary optimization , 2019, Inf. Sci..

[9]  Qingfu Zhang,et al.  Investigating the Properties of Indicators and an Evolutionary Many-Objective Algorithm Using Promising Regions , 2021, IEEE Transactions on Evolutionary Computation.

[10]  Bo Zhang,et al.  Balancing Convergence and Diversity in Decomposition-Based Many-Objective Optimizers , 2016, IEEE Transactions on Evolutionary Computation.

[11]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[12]  Shengxiang Yang,et al.  Pareto or Non-Pareto: Bi-Criterion Evolution in Multiobjective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[13]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[14]  Slim Bechikh,et al.  A New Decomposition-Based NSGA-II for Many-Objective Optimization , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[15]  Yaochu Jin,et al.  A Many-Objective Evolutionary Algorithm Using A One-by-One Selection Strategy , 2017, IEEE Transactions on Cybernetics.

[16]  Maoguo Gong,et al.  Multi-objective optimization for location-based and preferences-aware recommendation , 2020, Inf. Sci..

[17]  Xin Yao,et al.  Two_Arch2: An Improved Two-Archive Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[18]  Yong Wang,et al.  A Many-Objective Evolutionary Algorithm with Angle-Based Selection and Shift-Based Density Estimation , 2017, ArXiv.

[19]  Gary G. Yen,et al.  Many-Objective Evolutionary Algorithm: Objective Space Reduction and Diversity Improvement , 2016, IEEE Transactions on Evolutionary Computation.

[20]  Maoguo Gong,et al.  A Clustering-Based Evolutionary Algorithm for Many-Objective Optimization Problems , 2019, IEEE Transactions on Evolutionary Computation.

[21]  Ka-Chun Wong,et al.  A novel multi-objective evolutionary algorithm with dynamic decomposition strategy , 2019, Swarm Evol. Comput..

[22]  Liang Sun,et al.  A Many-Objective Evolutionary Algorithm With Two Interacting Processes: Cascade Clustering and Reference Point Incremental Learning , 2018, IEEE Transactions on Evolutionary Computation.

[23]  Gexiang Zhang,et al.  A Many-Objective Evolutionary Algorithm With Enhanced Mating and Environmental Selections , 2015, IEEE Transactions on Evolutionary Computation.

[24]  Ye Tian,et al.  Diversity Assessment of Multi-Objective Evolutionary Algorithms: Performance Metric and Benchmark Problems [Research Frontier] , 2019, IEEE Computational Intelligence Magazine.

[25]  Kuangrong Hao,et al.  A Clustering-Based Adaptive Evolutionary Algorithm for Multiobjective Optimization With Irregular Pareto Fronts , 2019, IEEE Transactions on Cybernetics.

[26]  Ye Tian,et al.  A Knee Point-Driven Evolutionary Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[27]  Xin Yao,et al.  A New Dominance Relation-Based Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[28]  Shengxiang Yang,et al.  A Strength Pareto Evolutionary Algorithm Based on Reference Direction for Multiobjective and Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[29]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[30]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[31]  Zhang Yi,et al.  IGD Indicator-Based Evolutionary Algorithm for Many-Objective Optimization Problems , 2018, IEEE Transactions on Evolutionary Computation.

[32]  Peter J. Fleming,et al.  Preference-inspired co-evolutionary algorithms using weight vectors , 2015, Eur. J. Oper. Res..

[33]  Zheng Tang,et al.  Incorporating a multiobjective knowledge-based energy function into differential evolution for protein structure prediction , 2020, Inf. Sci..

[34]  Kangshun Li,et al.  An improved MOEA/D algorithm with an adaptive evolutionary strategy , 2020, Inf. Sci..

[35]  Qingfu Zhang,et al.  Decomposition-Based Algorithms Using Pareto Adaptive Scalarizing Methods , 2016, IEEE Transactions on Evolutionary Computation.

[36]  Kay Chen Tan,et al.  Fast hypervolume approximation scheme based on a segmentation strategy , 2020, Inf. Sci..

[37]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[38]  Xin Yao,et al.  Stochastic Ranking Algorithm for Many-Objective Optimization Based on Multiple Indicators , 2016, IEEE Transactions on Evolutionary Computation.

[39]  Xuesong Yan,et al.  Modified NSGA-III for sensor placement in water distribution system , 2020, Inf. Sci..

[40]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[41]  Yu Zhou,et al.  A problem-specific non-dominated sorting genetic algorithm for supervised feature selection , 2021, Inf. Sci..

[42]  Hisao Ishibuchi,et al.  Performance of Decomposition-Based Many-Objective Algorithms Strongly Depends on Pareto Front Shapes , 2017, IEEE Transactions on Evolutionary Computation.

[43]  Yuren Zhou,et al.  A Vector Angle-Based Evolutionary Algorithm for Unconstrained Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[44]  Kay Chen Tan,et al.  An adaptive clustering-based evolutionary algorithm for many-objective optimization problems , 2020, Inf. Sci..

[45]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[46]  Kenli Li,et al.  An angle dominance criterion for evolutionary many-objective optimization , 2020, Inf. Sci..