Distance-Based Analysis of Crossover Operators for Many-Objective Knapsack Problems

It has been reported for multi-objective knapsack problems that the recombination of similar parents often improves the performance of evolutionary multi-objective optimization (EMO) algorithms. Recently performance improvement was also reported by exchanging only a small number of genes between two parents (i.e., crossover with a very small gene exchange probability) without choosing similar parents. In this paper, we examine these performance improvement schemes through computational experiments where NSGA-II is applied to 500-item knapsack problems with 2-10 objectives. We measure the parent-parent distance and the parent-offspring distance in computational experiments. Clear performance improvement is observed when the parent-offspring distance is small. To further examine this observation, we implement a distance-based crossover operator where the parent-offspring distance is specified as a user-defined parameter. Performance of NSGA-II is examined for various parameter values. Experimental results show that an appropriate parameter value (parent-offspring distance) is surprisingly small. It is also shown that a very small parameter value is beneficial for diversity maintenance.

[1]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[2]  Vincenzo Cutello,et al.  Parallel Problem Solving from Nature - PPSN XII , 2012, Lecture Notes in Computer Science.

[3]  Riccardo Poli,et al.  Topological Interpretation of Crossover , 2004, GECCO.

[4]  Lucas Bradstreet,et al.  A Fast Way of Calculating Exact Hypervolumes , 2012, IEEE Transactions on Evolutionary Computation.

[5]  Hisao Ishibuchi,et al.  Behavior of Evolutionary Many-Objective Optimization , 2008, Tenth International Conference on Computer Modeling and Simulation (uksim 2008).

[6]  Riccardo Poli,et al.  Genetic and Evolutionary Computation – GECCO 2004 , 2004, Lecture Notes in Computer Science.

[7]  Hisao Ishibuchi,et al.  Behavior of Multiobjective Evolutionary Algorithms on Many-Objective Knapsack Problems , 2015, IEEE Transactions on Evolutionary Computation.

[8]  Salvatore Greco,et al.  Evolutionary Multi-Criterion Optimization , 2011, Lecture Notes in Computer Science.

[9]  Hisao Ishibuchi,et al.  An empirical study on similarity-based mating for evolutionary multiobjective combinatorial optimization , 2008, Eur. J. Oper. Res..

[10]  Riccardo Poli,et al.  Inbreeding properties of geometric crossover and non-geometric recombinations , 2007, FOGA'07.

[11]  Riccardo Poli,et al.  Product Geometric Crossover , 2006, PPSN.

[12]  Kiyoshi Tanaka,et al.  Local dominance and local recombination in MOEAs on 0/1 multiobjective knapsack problems , 2007, Eur. J. Oper. Res..

[13]  Andrzej Jaszkiewicz,et al.  On the computational efficiency of multiple objective metaheuristics. The knapsack problem case study , 2004, Eur. J. Oper. Res..

[14]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[15]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[16]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[17]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization: A short review , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[18]  Hisao Ishibuchi,et al.  Relation between Neighborhood Size and MOEA/D Performance on Many-Objective Problems , 2013, EMO.

[19]  Hisao Ishibuchi,et al.  Recombination of Similar Parents in SMS-EMOA on Many-Objective 0/1 Knapsack Problems , 2012, PPSN.

[20]  Hisao Ishibuchi,et al.  Diversity Improvement by Non-Geometric Binary Crossover in Evolutionary Multiobjective Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[21]  Kiyoshi Tanaka,et al.  Variable space diversity, crossover and mutation in MOEA solving many-objective knapsack problems , 2012, Annals of Mathematics and Artificial Intelligence.