On the Performance Degradation of Dominance-Based Evolutionary Algorithms in Many-Objective Optimization

In the last decade, it has become apparent that the performance of Pareto-dominance-based evolutionary multiobjective optimization algorithms degrades as the number of objective functions of the problem, given by <inline-formula> <tex-math notation="LaTeX">${n}$ </tex-math></inline-formula>, grows. This performance degradation has been the subject of several studies in the last years, but the exact mechanism behind this phenomenon has not been fully understood yet. This paper presents an analytical study of this phenomenon under problems with continuous variables, by a simple setup of quadratic objective functions with spherical contour curves and a symmetrical arrangement of the function minima location. Within such a setup, some analytical formulas are derived to describe the probability of the optimization progress as a function of the distance <inline-formula> <tex-math notation="LaTeX">${\lambda }$ </tex-math></inline-formula> to the exact Pareto-set. A main conclusion is stated about the nature and structure of the performance degradation phenomenon in many-objective problems: when a current solution reaches a <inline-formula> <tex-math notation="LaTeX">${\lambda }$ </tex-math></inline-formula> that is an order of magnitude smaller than the length of the Pareto-set, the probability of finding a new point that dominates the current one is given by a power law function of <inline-formula> <tex-math notation="LaTeX">${\lambda }$ </tex-math></inline-formula> with exponent <inline-formula> <tex-math notation="LaTeX">${(n-1)}$ </tex-math></inline-formula>. The dimension of the space of decision variables has no influence on that exponent. Those results give support to a discussion about some general directions that are currently under consideration within the research community.

[1]  Xin Yao,et al.  Many-Objective Evolutionary Algorithms , 2015, ACM Comput. Surv..

[2]  Elizabeth F. Wanner,et al.  On a Stochastic Differential Equation Approach for Multiobjective Optimization up to Pareto-Criticality , 2011, EMO.

[3]  H. Kita,et al.  Failure of Pareto-based MOEAs: does non-dominated really mean near to optimal? , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[4]  Carlos A. Coello Coello,et al.  An updated survey of GA-based multiobjective optimization techniques , 2000, CSUR.

[5]  Hisao Ishibuchi,et al.  Effects of the Existence of Highly Correlated Objectives on the Behavior of MOEA/D , 2011, EMO.

[6]  Leon M. Hall,et al.  Special Functions , 1998 .

[7]  S. Li Concise Formulas for the Area and Volume of a Hyperspherical Cap , 2011 .

[8]  Tapabrata Ray,et al.  A Decomposition-Based Evolutionary Algorithm for Many Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[9]  Concha Bielza,et al.  Multiobjective Estimation of Distribution Algorithm Based on Joint Modeling of Objectives and Variables , 2014, IEEE Transactions on Evolutionary Computation.

[10]  Kalyanmoy Deb,et al.  Hybridization of SBX based NSGA-II and sequential quadratic programming for solving multi-objective optimization problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[11]  Kalyanmoy Deb,et al.  An Improved Adaptive Approach for Elitist Nondominated Sorting Genetic Algorithm for Many-Objective Optimization , 2013, EMO.

[12]  Xin Yao,et al.  Performance Scaling of Multi-objective Evolutionary Algorithms , 2003, EMO.

[13]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[14]  Carlos A. Brizuela,et al.  A survey on multi-objective evolutionary algorithms for many-objective problems , 2014, Computational Optimization and Applications.

[15]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[16]  Peter J. Fleming,et al.  Generalized Decomposition , 2013, EMO.

[17]  Carlos A. Coello Coello,et al.  On the Influence of the Number of Objectives on the Hardness of a Multiobjective Optimization Problem , 2011, IEEE Transactions on Evolutionary Computation.

[18]  Kiyoshi Tanaka,et al.  A Hybrid Scalarization and Adaptive epsilon-Ranking Strategy for Many-Objective Optimization , 2010, PPSN.

[19]  G. Andrews,et al.  Encyclopedia of Mathematics and its Applications , 1990 .

[20]  Norman C. Beaulieu,et al.  On monotonicity of the hypersphere volume and area , 2007 .

[21]  Tapabrata Ray,et al.  A Pareto Corner Search Evolutionary Algorithm and Dimensionality Reduction in Many-Objective Optimization Problems , 2011, IEEE Transactions on Evolutionary Computation.

[22]  Hisao Ishibuchi,et al.  Behavior of Multiobjective Evolutionary Algorithms on Many-Objective Knapsack Problems , 2015, IEEE Transactions on Evolutionary Computation.

[23]  Peter J. Fleming,et al.  An Overview of Evolutionary Algorithms in Multiobjective Optimization , 1995, Evolutionary Computation.

[24]  Thomas Hanne,et al.  Global Multiobjective Optimization with Evolutionary Algorithms: Selection Mechanisms and Mutation Control , 2001, EMO.

[25]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[26]  Peter J. Fleming,et al.  On the Evolutionary Optimization of Many Conflicting Objectives , 2007, IEEE Transactions on Evolutionary Computation.

[27]  A. Tits,et al.  Avoiding the Maratos effect by means of a nonmonotone line search I. general constrained problems , 1991 .

[28]  Frederico G. Guimarães,et al.  Local Search with Quadratic Approximations into Memetic Algorithms for Optimization with Multiple Criteria , 2008, Evolutionary Computation.

[29]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[30]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[31]  Yacov Y. Haimes,et al.  Multiobjective Decision Making: Theory and Methodology , 1983 .