Relation between Neighborhood Size and MOEA/D Performance on Many-Objective Problems

MOEA/D is a simple but powerful scalarizing function-based EMO algorithm. Its high search ability has been demonstrated for a wide variety of multiobjective problems. MOEA/D can be viewed as a cellular algorithm. Each cell has a different weight vector and a single solution. A certain number of the nearest cells are defined for each cell as its neighbors based on the Euclidean distance between weight vectors. A new solution is generated for each cell from current solutions in its neighboring cells. The generated solution is compared with the current solutions in the neighboring cells for solution replacement. In this paper, we examine the relation between the neighborhood size and the performance of MOEA/D. In order to examine the effect of local mating and local replacement separately, we use a variant of MOEA/D with two different neighborhoods: One is for local mating and the other is for local replacement. The performance of MOEA/D with various combinations of two neighborhoods is examined using the hypervolume in the objective space and a diversity measure in the decision space for many-objective problems. Experimental results show that MOEA/D with a large replacement neighborhood has high search ability in the objective space. However, it is also shown that small replacement and mating neighborhoods are beneficial for diversity maintenance in the decision space. It is also shown that the appropriate specification of two neighborhoods strongly depends on the problem.

[1]  Peter J. Fleming,et al.  On the Evolutionary Optimization of Many Conflicting Objectives , 2007, IEEE Transactions on Evolutionary Computation.

[2]  Hisao Ishibuchi,et al.  Recombination of Similar Parents in SMS-EMOA on Many-Objective 0/1 Knapsack Problems , 2012, PPSN.

[3]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[4]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[5]  Lothar Thiele,et al.  Maximizing population diversity in single-objective optimization , 2011, GECCO '11.

[6]  Vincenzo Cutello,et al.  Parallel Problem Solving from Nature - PPSN XII , 2012, Lecture Notes in Computer Science.

[7]  Salvatore Greco,et al.  Evolutionary Multi-Criterion Optimization , 2011, Lecture Notes in Computer Science.

[8]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[9]  Eckart Zitzler,et al.  Integrating decision space diversity into hypervolume-based multiobjective search , 2010, GECCO '10.

[10]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization by NSGA-II and MOEA/D with large populations , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[11]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[12]  Robert Schaefer Parallel Problem Solving from Nature - PPSN XI, 11th International Conference, Kraków, Poland, September 11-15, 2010. Proceedings, Part II , 2010, PPSN.

[13]  Hisao Ishibuchi,et al.  Diversity Improvement by Non-Geometric Binary Crossover in Evolutionary Multiobjective Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[14]  Hisao Ishibuchi,et al.  Many-Objective Test Problems to Visually Examine the Behavior of Multiobjective Evolution in a Decision Space , 2010, PPSN.

[15]  Hisao Ishibuchi,et al.  Behavior of Evolutionary Many-Objective Optimization , 2008, Tenth International Conference on Computer Modeling and Simulation (uksim 2008).

[16]  Lothar Thiele,et al.  Defining and Optimizing Indicator-Based Diversity Measures in Multiobjective Search , 2010, PPSN.

[17]  A. Solow,et al.  Measuring biological diversity , 2006, Environmental and Ecological Statistics.

[18]  Kiyoshi Tanaka,et al.  Analysis on Population Size and Neighborhood Recombination on Many-Objective Optimization , 2012, PPSN.

[19]  Xin Yao,et al.  Performance Scaling of Multi-objective Evolutionary Algorithms , 2003, EMO.

[20]  Peter J. Fleming,et al.  Diversity Management in Evolutionary Many-Objective Optimization , 2011, IEEE Transactions on Evolutionary Computation.

[21]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[22]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[23]  Hisao Ishibuchi,et al.  Effects of the Existence of Highly Correlated Objectives on the Behavior of MOEA/D , 2011, EMO.

[24]  Qingfu Zhang,et al.  The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances , 2009, 2009 IEEE Congress on Evolutionary Computation.

[25]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[26]  Evan J. Hughes,et al.  Evolutionary many-objective optimisation: many once or one many? , 2005, 2005 IEEE Congress on Evolutionary Computation.

[27]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[28]  Kalyanmoy Deb,et al.  Omni-optimizer: A generic evolutionary algorithm for single and multi-objective optimization , 2008, Eur. J. Oper. Res..

[29]  Hisao Ishibuchi,et al.  A many-objective test problem for visually examining diversity maintenance behavior in a decision space , 2011, GECCO '11.

[30]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[31]  Carlos A. Coello Coello,et al.  On the Influence of the Number of Objectives on the Hardness of a Multiobjective Optimization Problem , 2011, IEEE Transactions on Evolutionary Computation.

[32]  Lishan Kang,et al.  A New Evolutionary Algorithm for Solving Many-Objective Optimization Problems , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[33]  Hisao Ishibuchi,et al.  Adaptation of Scalarizing Functions in MOEA/D: An Adaptive Scalarizing Function-Based Multiobjective Evolutionary Algorithm , 2009, EMO.

[34]  Hisao Ishibuchi,et al.  Effectiveness of scalability improvement attempts on the performance of NSGA-II for many-objective problems , 2008, GECCO '08.

[35]  Tong Heng Lee,et al.  Multiobjective Evolutionary Algorithms and Applications , 2005, Advanced Information and Knowledge Processing.

[36]  Kiyoshi Tanaka,et al.  Local dominance and local recombination in MOEAs on 0/1 multiobjective knapsack problems , 2007, Eur. J. Oper. Res..

[37]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization: A short review , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[38]  Hisao Ishibuchi,et al.  Simultaneous use of different scalarizing functions in MOEA/D , 2010, GECCO '10.