On the effect of reference point in MOEA/D for multi-objective optimization

Abstract Multi-objective evolutionary algorithm based on decomposition (MOEA/D) has continuously proven effective for multi-objective optimization. So far, the effect of weight vectors and scalarizing methods in MOEA/D has been intensively studied. However, the reference point which serves as the starting point of reference lines (determined by weight vectors) is yet to be well studied. This study aims to fill in this research gap. Ideally, the ideal point of a multi-objective problem could serve as the reference point, however, since the ideal point is often unknown beforehand, the reference point has to be estimated (or specified). In this study, the effect of the reference point specified in three representative manners, i.e., pessimistic, optimistic and dynamic (from optimistic to pessimistic), is examined on three sets of benchmark problems. Each set of the problems has different degrees of difficulty in convergence and spread. Experimental results show that (i) the reference point implicitly impacts the convergence and spread performance of MOEA/D; (ii) the pessimistic specification emphasizes more of exploiting existing regions and the optimistic specification emphasizes more of exploring new regions; (iii) the dynamic specification can strike a good balance between exploitation and exploration, exhibiting good performance for most of the test problems, and thus, is commended to use for new problems.

[1]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[2]  Hisao Ishibuchi,et al.  Simultaneous use of different scalarizing functions in MOEA/D , 2010, GECCO '10.

[3]  J. Dennis,et al.  A closer look at drawbacks of minimizing weighted sums of objectives for Pareto set generation in multicriteria optimization problems , 1997 .

[4]  Tao Zhang,et al.  Multi-objective optimal design of hybrid renewable energy systems using preference-inspired coevolutionary approach , 2015 .

[5]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[6]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[7]  Tao Zhang,et al.  An enhanced MOEA/D using uniform directions and a pre-organization procedure , 2013, 2013 IEEE Congress on Evolutionary Computation.

[8]  Tapabrata Ray,et al.  A Decomposition-Based Evolutionary Algorithm for Many Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[9]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[10]  Kalyanmoy Deb,et al.  An Improved Adaptive Approach for Elitist Nondominated Sorting Genetic Algorithm for Many-Objective Optimization , 2013, EMO.

[11]  Hisao Ishibuchi,et al.  Relation Between Weight Vectors and Solutions in MOEA/D , 2015, 2015 IEEE Symposium Series on Computational Intelligence.

[12]  Peter J. Fleming,et al.  Methods for multi-objective optimization: An analysis , 2015, Inf. Sci..

[13]  Qingfu Zhang,et al.  Are All the Subproblems Equally Important? Resource Allocation in Decomposition-Based Multiobjective Evolutionary Algorithms , 2016, IEEE Transactions on Evolutionary Computation.

[14]  Peter J. Fleming,et al.  An analysis of parameter sensitivities of preference-inspired co-evolutionary algorithms , 2015, Int. J. Syst. Sci..

[15]  Peter J. Fleming,et al.  Preference-inspired co-evolutionary algorithm using weights for many-objective optimization , 2013, GECCO '13 Companion.

[16]  Gilbert Laporte,et al.  Solving a multi-objective dynamic stochastic districting and routing problem with a co-evolutionary algorithm , 2016, Comput. Oper. Res..

[17]  Rubén Saborido,et al.  Global WASF-GA: An Evolutionary Algorithm in Multiobjective Optimization to Approximate the Whole Pareto Optimal Front , 2017, Evolutionary Computation.

[18]  Qingfu Zhang,et al.  On the use of two reference points in decomposition based multiobjective evolutionary algorithms , 2017, Swarm Evol. Comput..

[19]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[20]  Jiang Siwei,et al.  Multiobjective optimization by decomposition with Pareto-adaptive weight vectors , 2011, 2011 Seventh International Conference on Natural Computation.

[21]  Joshua D. Knowles,et al.  On metrics for comparing nondominated sets , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[22]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[23]  Kay Chen Tan,et al.  A multiobjective evolutionary algorithm using dynamic weight design method , 2012 .

[24]  Tao Zhang,et al.  Localized Weighted Sum Method for Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[25]  Hisao Ishibuchi,et al.  Reference point specification in MOEA/D for multi-objective and many-objective problems , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[26]  Bo Zhang,et al.  Balancing Convergence and Diversity in Decomposition-Based Many-Objective Optimizers , 2016, IEEE Transactions on Evolutionary Computation.

[27]  Bernhard Sendhoff,et al.  Adapting Weighted Aggregation for Multiobjective Evolution Strategies , 2001, EMO.

[28]  Bo Guo,et al.  An enhanced preference-inspired co-evolutionary algorithm using orthogonal design and an ε-dominance archiving strategy , 2016 .

[29]  Hui Li,et al.  An Adaptive Evolutionary Multi-Objective Approach Based on Simulated Annealing , 2011, Evolutionary Computation.

[30]  Hisao Ishibuchi,et al.  Behavior of Multiobjective Evolutionary Algorithms on Many-Objective Knapsack Problems , 2015, IEEE Transactions on Evolutionary Computation.

[31]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[32]  Hisao Ishibuchi,et al.  Characteristics of many-objective test problems and penalty parameter specification in MOEA/D , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[33]  Tao Zhang,et al.  A multi-objective co-evolutionary algorithm for energy-efficient scheduling on a green data center , 2016, Comput. Oper. Res..

[34]  Peter J. Fleming,et al.  The iPICEA-g: a new hybrid evolutionary multi-criteria decision making approach using the brushing technique , 2015, Eur. J. Oper. Res..

[35]  Hisao Ishibuchi,et al.  Adaptation of Scalarizing Functions in MOEA/D: An Adaptive Scalarizing Function-Based Multiobjective Evolutionary Algorithm , 2009, EMO.

[36]  Fang Liu,et al.  MOEA/D with Adaptive Weight Adjustment , 2014, Evolutionary Computation.

[37]  Peter J. Fleming,et al.  Preference-inspired co-evolutionary algorithms using weight vectors , 2015, Eur. J. Oper. Res..

[38]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[39]  Xin Yao,et al.  A New Dominance Relation-Based Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[40]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[41]  Peter J. Fleming,et al.  On the Evolutionary Optimization of Many Conflicting Objectives , 2007, IEEE Transactions on Evolutionary Computation.

[42]  Tao Zhang,et al.  On the effect of localized PBI method in MOEA/D for multi-objective optimization , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[43]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[44]  Ye Tian,et al.  A Decision Variable Clustering-Based Evolutionary Algorithm for Large-Scale Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[45]  Carlos M. Fonseca,et al.  An Improved Dimension-Sweep Algorithm for the Hypervolume Indicator , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[46]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[47]  Qingfu Zhang,et al.  Decomposition-Based Algorithms Using Pareto Adaptive Scalarizing Methods , 2016, IEEE Transactions on Evolutionary Computation.

[48]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[49]  Peter J. Fleming,et al.  On the Performance Assessment and Comparison of Stochastic Multiobjective Optimizers , 1996, PPSN.

[50]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[51]  Hiroyuki Sato,et al.  Inverted PBI in MOEA/D and its impact on the search performance on multi and many-objective optimization , 2014, GECCO.

[52]  Qingfu Zhang,et al.  The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances , 2009, 2009 IEEE Congress on Evolutionary Computation.

[53]  I. Y. Kim,et al.  Adaptive weighted-sum method for bi-objective optimization: Pareto front generation , 2005 .

[54]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[55]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[56]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[57]  Anne Auger,et al.  Theory of the hypervolume indicator: optimal μ-distributions and the choice of the reference point , 2009, FOGA '09.

[58]  Tao Zhang,et al.  Pareto Adaptive Scalarising Functions for Decomposition Based Algorithms , 2015, EMO.

[59]  Mitsuo Gen,et al.  Specification of Genetic Search Directions in Cellular Multi-objective Genetic Algorithms , 2001, EMO.