Rotated Problems and Rotationally Invariant Crossover in Evolutionary Multi-Objective Optimization

Problems that are not aligned with the coordinate system can present difficulties to many optimization algorithms, including evolutionary algorithms, by trapping the search on a ridge. The ridge problem in single-objective optimization is understood, but until now little work has been done on understanding this issue in the multi-objective domain. Multi-objective problems with parameter interactions present difficulties to an optimization algorithm, which are not present in the single-objective domain. In this work, we have explained the nature of these difficulties, and investigated the behavior of the NSGA-II, which has difficulties with problems not aligned with the principle coordinate system. This study has investigated Simplex Crossover (SPX), Unimodal Normally Distributed Crossover (UNDX), Parent-Centric Crossover (PCX), and Differential Evolution (DE), as possible alternatives to the Simulated Binary Crossover (SBX) operator within the NSGA-II, on problems exhibiting parameter interactions through a rotation of the coordinate system. An analysis of these operators on three rotated bi-objective test problems, and a four-and eight-objective problem is provided. New observations on the behavior of rotationally invariant crossover operators in the multi-objective problem domain have been reported.

[1]  Kalyanmoy Deb,et al.  Multi-objective Genetic Algorithms: Problem Difficulties and Construction of Test Problems , 1999, Evolutionary Computation.

[2]  K. Deb,et al.  Real-coded evolutionary algorithms with parent-centric recombination , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[3]  S. Kobayashi,et al.  Optimal lens design by real-coded genetic algorithms using UNDX , 2000 .

[4]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[5]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[6]  Pedro J. Ballester,et al.  Real-Parameter Genetic Algorithms for Finding Multiple Optimal Solutions in Multi-modal Optimization , 2003, GECCO.

[7]  H. Abbass.  The self-adaptive Pareto differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[8]  Xin Yao,et al.  How well do multi-objective evolutionary algorithms scale to large problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[9]  C. S. Chang,et al.  Differential evolution based tuning of fuzzy automatic train operation for mass rapid transit system , 2000 .

[10]  S. Kobayashi,et al.  Multi-parental extension of the unimodal normal distribution crossover for real-coded genetic algorithms , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[11]  Hussein A. Abbass,et al.  The Pareto Differential Evolution Algorithm , 2002, Int. J. Artif. Intell. Tools.

[12]  Xiaodong Li,et al.  Rotationally Invariant Crossover Operators in Evolutionary Multi-objective Optimization , 2006, SEAL.

[13]  Kalyanmoy Deb,et al.  A combined genetic adaptive search (GeneAS) for engineering design , 1996 .

[14]  M. Yamamura,et al.  Multi-parent recombination with simplex crossover in real coded genetic algorithms , 1999 .

[15]  Shigenobu Kobayashi,et al.  A real-coded genetic algorithm using the unimodal normal distribution crossover , 2003 .

[16]  Hajime Kita,et al.  A Comparison Study of Self-Adaptation in Evolution Strategies and Real-Coded Genetic Algorithms , 2001, Evolutionary Computation.

[17]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[18]  K. V. Price,et al.  Differential evolution: a fast and simple numerical optimizer , 1996, Proceedings of North American Fuzzy Information Processing.

[19]  Xiaodong Li,et al.  Rotated test problems for assessing the performance of multi-objective optimization algorithms , 2006, GECCO.

[20]  H. Abbass,et al.  PDE: a Pareto-frontier differential evolution approach for multi-objective optimization problems , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[21]  R. Salomon.  Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. A survey of some theoretical and practical aspects of genetic algorithms. , 1996, Bio Systems.

[22]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..