Sensitivity analysis of Penalty-based Boundary Intersection on aggregation-based EMO algorithms

MOEA/D is an evolutionary multi-objective optimization algorithm, which relies on decomposition methods such as, weighted-sum, Tchebycheff and Penalty-based Boundary Intersection (PBI) to convert a multi-objective problem into a set of single-objective problems. It is known that PBI can generate a more uniform set of solutions than the other decomposition methods. The drawback of PBI is that it has a penalty parameter (θ) that has to be specified by the user. This penalty parameter can affect the convergence rate of MOEA/D as well as the uniformity of solutions. Unfortunately, there are very limited studies on sensitivity analysis of MOEA/D on the penalty parameter of PBI. This paper is dedicated to a comprehensive analysis of PBI's penalty parameter, and its effect on a user-preference algorithm (R-MEAD2) and a non-user-preference algorithm (MOEA/D). Unlike the previous studies that only rely on Hypervolume as their performance measure, we study the effect of θ on convergence, uniformity, and the combination of convergence and uniformity independently. The experimental results suggest that user-preference algorithms consistently perform better with a relatively larger θ value as compared to their non-user-preference counterparts. The results also suggest that on some problems, such as multi-modal functions, convergence is the dominant factor on the overall performance, where a smaller θ is preferable. Conversely, on some other problems, a larger θ is suggested where uniformity is the dominant factor. Finally, we briefly investigate the relationship between θ and the number of objectives.

[1]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[2]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[3]  Dennis K. J. Lin,et al.  Ch. 4. Uniform experimental designs and their applications in industry , 2003 .

[4]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[5]  W. Cleveland Robust Locally Weighted Regression and Smoothing Scatterplots , 1979 .

[6]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[7]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .

[8]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[9]  Hiroyuki Sato,et al.  Inverted PBI in MOEA/D and its impact on the search performance on multi and many-objective optimization , 2014, GECCO.

[10]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[11]  Hisao Ishibuchi,et al.  A Study on the Specification of a Scalarizing Function in MOEA/D for Many-Objective Knapsack Problems , 2013, LION.

[12]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[13]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[14]  Xiaodong Li,et al.  Reference point based multi-objective optimization through decomposition , 2012, 2012 IEEE Congress on Evolutionary Computation.

[15]  Beat Kleiner,et al.  Graphical Methods for Data Analysis , 1983 .

[16]  Xiaodong Li,et al.  Integrating user preferences and decomposition methods for many-objective optimization , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[17]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[18]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[19]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.