Pareto or Non-Pareto: Bi-Criterion Evolution in Multiobjective Optimization

It is known that Pareto dominance has its own weaknesses as the selection criterion in evolutionary multiobjective optimization. Algorithms based on Pareto criterion (PC) can suffer from problems such as slow convergence to the optimal front and inferior performance on problems with many objectives. Non-Pareto criterion (NPC), such as decomposition-based criterion and indicator-based criterion, has already shown promising results in this regard, but its high selection pressure may lead to the algorithm to prefer some specific areas of the problem's Pareto front, especially when the front is highly irregular. In this paper, we propose a bi-criterion evolution (BCE) framework of the PC and NPC, which attempts to make use of their strengths and compensates for each other's weaknesses. The proposed framework consists of two parts: PC evolution and NPC evolution. The two parts work collaboratively, with an abundant exchange of information to facilitate each other's evolution. Specifically, the NPC evolution leads the PC evolution forward and the PC evolution compensates the possible diversity loss of the NPC evolution. The proposed framework keeps the freedom on the implementation of the NPC evolution part, thus making it applicable for any non-Pareto-based algorithm. In the PC evolution, two operations, population maintenance and individual exploration, are presented. The former is to maintain a set of representative nondominated individuals and the latter is to explore some promising areas that are undeveloped (or not well-developed) in the NPC evolution. Experimental results have shown the effectiveness of the proposed framework. The BCE works well on seven groups of 42 test problems with various characteristics, including those in which Pareto-based algorithms or non-Pareto-based algorithms struggle.

[1]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[2]  Frank Neumann,et al.  Multiplicative approximations and the hypervolume indicator , 2009, GECCO.

[3]  Jun Zhang,et al.  Fuzzy-Based Pareto Optimality for Many-Objective Evolutionary Algorithms , 2014, IEEE Transactions on Evolutionary Computation.

[4]  Kiyoshi Tanaka,et al.  Controlling Dominance Area of Solutions and Its Impact on the Performance of MOEAs , 2007, EMO.

[5]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[6]  Peter J. Fleming,et al.  On the Evolutionary Optimization of Many Conflicting Objectives , 2007, IEEE Transactions on Evolutionary Computation.

[7]  H. Kita,et al.  Failure of Pareto-based MOEAs: does non-dominated really mean near to optimal? , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[8]  Edwin Lughofer,et al.  DECMO2: a robust hybrid and adaptive multi-objective evolutionary algorithm , 2014, Soft Computing.

[9]  Carlos A. Coello Coello,et al.  A ranking method based on the R2 indicator for many-objective optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[10]  Kay Chen Tan,et al.  A Novel Diversity Maintenance Scheme for Evolutionary Multi-objective Optimization , 2013, IDEAL.

[11]  Xiaodong Li,et al.  Using a distance metric to guide PSO algorithms for many-objective optimization , 2009, GECCO.

[12]  Lothar Thiele,et al.  Quality Assessment of Pareto Set Approximations , 2008, Multiobjective Optimization.

[13]  Kay Chen Tan,et al.  Online Diversity Assessment in Evolutionary Multiobjective Optimization: A Geometrical Perspective , 2015, IEEE Transactions on Evolutionary Computation.

[14]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[15]  Shengxiang Yang,et al.  A Comparative Study on Evolutionary Algorithms for Many-Objective Optimization , 2013, EMO.

[16]  Shengxiang Yang,et al.  A test problem for visual investigation of high-dimensional multi-objective search , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[17]  Jouni Lampinen,et al.  GDE3: the third evolution step of generalized differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[18]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[19]  Hui Li,et al.  An Elitist GRASP Metaheuristic for the Multi-objective Quadratic Assignment Problem , 2009, EMO.

[20]  Qingfu Zhang,et al.  An External Archive Guided Multiobjective Evolutionary Algorithm Based on Decomposition for Combinatorial Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[21]  Stefan Roth,et al.  Covariance Matrix Adaptation for Multi-objective Optimization , 2007, Evolutionary Computation.

[22]  John A. W. McCall,et al.  D2MOPSO: MOPSO Based on Decomposition and Dominance with Archiving Using Crowding Distance in Objective and Solution Spaces , 2014, Evolutionary Computation.

[23]  Shengxiang Yang,et al.  A Performance Comparison Indicator for Pareto Front Approximations in Many-Objective Optimization , 2015, GECCO.

[24]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[25]  Gary G. Yen,et al.  Ranking many-objective Evolutionary Algorithms using performance metrics ensemble , 2013, 2013 IEEE Congress on Evolutionary Computation.

[26]  Shengxiang Yang,et al.  Shift-Based Density Estimation for Pareto-Based Algorithms in Many-Objective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[27]  Shengxiang Yang,et al.  Evolutionary Algorithms With Segment-Based Search for Multiobjective Optimization Problems , 2014, IEEE Transactions on Cybernetics.

[28]  Bo Zhang,et al.  Balancing Convergence and Diversity in Decomposition-Based Many-Objective Optimizers , 2016, IEEE Transactions on Evolutionary Computation.

[29]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[30]  DebKalyanmoy,et al.  Evaluating the -Domination Based Multi-Objective Evolutionary Algorithm for a Quick Computation of Pareto-Optimal Solutions , 2005 .

[31]  Kalyanmoy Deb,et al.  Evaluating the -Domination Based Multi-Objective Evolutionary Algorithm for a Quick Computation of Pareto-Optimal Solutions , 2005, Evolutionary Computation.

[32]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[33]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[34]  Enrique Alba,et al.  AbYSS: Adapting Scatter Search to Multiobjective Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[35]  Carlos A. Coello Coello,et al.  Evolutionary multiobjective optimization , 2011, WIREs Data Mining Knowl. Discov..

[36]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[37]  Jie Zhang,et al.  Multiobjective optimization by decomposition with Pareto-adaptive weight vectors , 2011, ICNC.

[38]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization: A short review , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[39]  DebK.,et al.  A fast and elitist multiobjective genetic algorithm , 2002 .

[40]  Kalyanmoy Deb,et al.  A Hybrid Framework for Evolutionary Multi-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[41]  Marco Laumanns,et al.  Combining Convergence and Diversity in Evolutionary Multiobjective Optimization , 2002, Evolutionary Computation.

[42]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[43]  Qingfu Zhang,et al.  The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances , 2009, 2009 IEEE Congress on Evolutionary Computation.

[44]  Carlos A. Coello Coello,et al.  Ranking Methods in Many-Objective Evolutionary Algorithms , 2009, Nature-Inspired Algorithms for Optimisation.

[45]  Heike Trautmann,et al.  On the properties of the R2 indicator , 2012, GECCO '12.

[46]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[47]  Carlos A. Coello Coello,et al.  Pareto-adaptive -dominance , 2007, Evolutionary Computation.

[48]  Nicola Beume,et al.  Pareto-, Aggregation-, and Indicator-Based Methods in Many-Objective Optimization , 2007, EMO.

[49]  Kalyanmoy Deb,et al.  A Fast and Effective Method for Pruning of Non-dominated Solutions in Many-Objective Problems , 2006, PPSN.

[50]  Chun Chen,et al.  Multiple trajectory search for unconstrained/constrained multi-objective optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[51]  Edmund K. Burke,et al.  Indicator-based multi-objective local search , 2007, 2007 IEEE Congress on Evolutionary Computation.

[52]  Ricardo P. Beausoleil,et al.  "MOSS" multiobjective scatter search applied to non-linear multiple criteria optimization , 2006, Eur. J. Oper. Res..

[53]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[54]  Tapabrata Ray,et al.  A Pareto Corner Search Evolutionary Algorithm and Dimensionality Reduction in Many-Objective Optimization Problems , 2011, IEEE Transactions on Evolutionary Computation.

[55]  Qingfu Zhang,et al.  Objective Reduction in Many-Objective Optimization: Linear and Nonlinear Algorithms , 2013, IEEE Transactions on Evolutionary Computation.

[56]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[57]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[58]  Jie Zhang,et al.  Consistencies and Contradictions of Performance Metrics in Multiobjective Optimization , 2014, IEEE Transactions on Cybernetics.

[59]  Jiang Siwei,et al.  Multiobjective optimization by decomposition with Pareto-adaptive weight vectors , 2011, 2011 Seventh International Conference on Natural Computation.

[60]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[61]  Kay Chen Tan,et al.  A multiobjective evolutionary algorithm using dynamic weight design method , 2012 .

[62]  Anne Auger,et al.  Theory of the hypervolume indicator: optimal μ-distributions and the choice of the reference point , 2009, FOGA '09.

[63]  Markus Wagner,et al.  A fast approximation-guided evolutionary multi-objective algorithm , 2013, GECCO '13.

[64]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[65]  Mitsuo Gen,et al.  Specification of Genetic Search Directions in Cellular Multi-objective Genetic Algorithms , 2001, EMO.

[66]  Shengxiang Yang,et al.  ETEA: A Euclidean Minimum Spanning Tree-Based Evolutionary Algorithm for Multi-Objective Optimization , 2014, Evolutionary Computation.

[67]  Günter Rudolph,et al.  Evenly Spaced Pareto Front Approximations for Tricriteria Problems Based on Triangulation , 2013, EMO.

[68]  Qingfu Zhang,et al.  Stable Matching-Based Selection in Evolutionary Multiobjective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[69]  Qingfu Zhang,et al.  Framework for Many-Objective Test Problems with Both Simple and Complicated Pareto-Set Shapes , 2011, EMO.

[70]  Hisao Ishibuchi,et al.  Many-Objective Test Problems to Visually Examine the Behavior of Multiobjective Evolution in a Decision Space , 2010, PPSN.

[71]  Jie Zhang,et al.  A Simple and Fast Hypervolume Indicator-Based Multiobjective Evolutionary Algorithm , 2015, IEEE Transactions on Cybernetics.

[72]  Tapabrata Ray,et al.  A Decomposition-Based Evolutionary Algorithm for Many Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[73]  Fang Liu,et al.  MOEA/D with Adaptive Weight Adjustment , 2014, Evolutionary Computation.

[74]  Sanaz Mostaghim,et al.  Distance Based Ranking in Many-Objective Particle Swarm Optimization , 2008, PPSN.

[75]  Chun Chen,et al.  An improved version of the multiple trajectory search for real value multi-objective optimization problems , 2014 .

[76]  David W. Corne,et al.  Techniques for highly multiobjective optimisation: some nondominated points are better than others , 2007, GECCO '07.

[77]  Xin Yao,et al.  Two_Arch2: An Improved Two-Archive Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[78]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[79]  Hisao Ishibuchi,et al.  Incorporation of Scalarizing Fitness Functions into Evolutionary Multiobjective Optimization Algorithms , 2006, PPSN.

[80]  Shengxiang Yang,et al.  Bi-goal evolution for many-objective optimization problems , 2015, Artif. Intell..

[81]  Jianhua Zheng,et al.  Multi-objective Scatter Search with External Archive for Portfolio Optimization , 2013, IJCCI.

[82]  Markus Wagner,et al.  Approximation-Guided Evolutionary Multi-Objective Optimization , 2011, IJCAI.

[83]  Eckart Zitzler,et al.  Evolutionary multi-objective optimization , 2007, Eur. J. Oper. Res..

[84]  Hisao Ishibuchi,et al.  Behavior of Multiobjective Evolutionary Algorithms on Many-Objective Knapsack Problems , 2015, IEEE Transactions on Evolutionary Computation.

[85]  Peter J. Fleming,et al.  Generalized Decomposition , 2013, EMO.