Entropy based evolutionary algorithm with adaptive reference points for many-objective optimization problems

Abstract Many-objective optimization problems (MaOPs) have attracted more and more attention due to its challenges for multi-objective evolutionary algorithms. Reference points or weight vectors based evolutionary algorithms have been developed successfully for solving MaOPs. However, these algorithms do not solve efficiently the MaOPs with irregular Pareto fronts, such as disconnected, degenerate, and inverted. Although some algorithms with adaptive weight vectors or reference points are designed to handle the problems with irregular shapes of Pareto fronts, they still exist some drawbacks. These adaptive algorithms do not obtain good performance in solving regular problem. For solving regular and irregular Pareto fronts of the problems, a novel entropy based evolutionary algorithm with adaptive reference points, named EARPEA, is proposed to solve regular and irregular many-objective optimization problems. Entropy computed based on reference points and a learning period are employed to control adaptation of the reference points. In addition, in order to maintain diversity of the reference points, a reference point adaptation method based on cosine similarity is designed in the adjusting reference point phase. The proposed algorithm is empirically compared with eight state-of-the-art many-objective evolutionary algorithms on 72 instances of 18 benchmark problems. The comparative results demonstrate that the overall performance of the proposed algorithm is superior to the counterparts on MaOPs with regular and irregular Pareto fronts.

[1]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[2]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[3]  Shang Gao,et al.  An improved scheme for minimum cross entropy threshold selection based on genetic algorithm , 2011, Knowl. Based Syst..

[4]  Ricardo H. C. Takahashi,et al.  On the Performance Degradation of Dominance-Based Evolutionary Algorithms in Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[5]  Yaochu Jin,et al.  A Many-Objective Evolutionary Algorithm Using A One-by-One Selection Strategy , 2017, IEEE Transactions on Cybernetics.

[6]  Xin Yao,et al.  Stochastic Ranking Algorithm for Many-Objective Optimization Based on Multiple Indicators , 2016, IEEE Transactions on Evolutionary Computation.

[7]  Peter J. Fleming,et al.  Preference-inspired co-evolutionary algorithms using weight vectors , 2015, Eur. J. Oper. Res..

[8]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[9]  Qingfu Zhang,et al.  Entropy-Based Termination Criterion for Multiobjective Evolutionary Algorithms , 2016, IEEE Transactions on Evolutionary Computation.

[10]  Ye Tian,et al.  An Indicator-Based Multiobjective Evolutionary Algorithm With Reference Point Adaptation for Better Versatility , 2018, IEEE Transactions on Evolutionary Computation.

[11]  Xin Yao,et al.  Two_Arch2: An Improved Two-Archive Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[12]  Tapabrata Ray,et al.  A Decomposition-Based Evolutionary Algorithm for Many Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[13]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[14]  Kalyanmoy Deb,et al.  A Unified Evolutionary Optimization Procedure for Single, Multiple, and Many Objectives , 2016, IEEE Transactions on Evolutionary Computation.

[15]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[16]  Charles F. Hockett,et al.  A mathematical theory of communication , 1948, MOCO.

[17]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[18]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[19]  Hisao Ishibuchi,et al.  Pareto Fronts of Many-Objective Degenerate Test Problems , 2016, IEEE Transactions on Evolutionary Computation.

[20]  Gonzalo Pajares,et al.  Cross entropy based thresholding for magnetic resonance brain images using Crow Search Algorithm , 2017, Expert Syst. Appl..

[21]  R. Lyndon While,et al.  A faster algorithm for calculating hypervolume , 2006, IEEE Transactions on Evolutionary Computation.

[22]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[23]  Tapabrata Ray,et al.  An Enhanced Decomposition-Based Evolutionary Algorithm With Adaptive Reference Vectors , 2018, IEEE Transactions on Cybernetics.

[24]  Xin Yao,et al.  Many-Objective Evolutionary Algorithms , 2015, ACM Comput. Surv..

[25]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[26]  Fang Liu,et al.  MOEA/D with Adaptive Weight Adjustment , 2014, Evolutionary Computation.

[27]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[28]  Kalyanmoy Deb,et al.  A combined genetic adaptive search (GeneAS) for engineering design , 1996 .

[29]  G. Thamaraiselvi,et al.  Data Mining: Concepts and Techniques , 2004 .

[30]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[31]  Marco Laumanns,et al.  Combining Convergence and Diversity in Evolutionary Multiobjective Optimization , 2002, Evolutionary Computation.

[32]  Xin Yao,et al.  A New Dominance Relation-Based Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[33]  Teresa Bernarda Ludermir,et al.  Many Objective Particle Swarm Optimization , 2016, Inf. Sci..

[34]  Hisao Ishibuchi,et al.  Performance of Decomposition-Based Many-Objective Algorithms Strongly Depends on Pareto Front Shapes , 2017, IEEE Transactions on Evolutionary Computation.

[35]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[36]  Ye Tian,et al.  A Knee Point-Driven Evolutionary Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[37]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[38]  Hui Li,et al.  An Adaptive Evolutionary Multi-Objective Approach Based on Simulated Annealing , 2011, Evolutionary Computation.