Ensemble of many-objective evolutionary algorithms for many-objective problems

The performance of most existing multiobjective evolutionary algorithms deteriorates severely in the face of many-objective problems. Many-objective optimization has been gaining increasing attention, and many new many-objective evolutionary algorithms (MaOEA) have recently been proposed. On the one hand, solution sets with totally different characteristics are obtained by different MaOEAs, since different MaOEAs have different convergence-diversity tradeoff relations. This may suggest the potential usefulness of ensemble approaches of different MaOEAs. On the other hand, the performance of MaOEAs may vary greatly from one problem to another, so that choosing the most appropriate MaOEA is often a non-trivial task. Hence, an MaOEA that performs generally well on a set of problems is often desirable. This study proposes an ensemble of MaOEAs (EMaOEA) for many-objective problems. When solving a single problem, EMaOEA invests its computational budget to its constituent MaOEAs, runs them in parallel and maintains interactions between them by a simple information sharing scheme. Experimental results on 80 benchmark problems have shown that, by integrating the advantages of different MaOEAs into one framework, EMaOEA not only provides practitioners a unified framework for solving their problem set, but also may lead to better performance than a single MaOEA.

[1]  Kazuyuki Murase,et al.  Evolutionary Path Control Strategy for Solving Many-Objective Optimization Problem , 2015, IEEE Transactions on Cybernetics.

[2]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[3]  Shengxiang Yang,et al.  Shift-Based Density Estimation for Pareto-Based Algorithms in Many-Objective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[4]  Qingfu Zhang,et al.  Distributed evolutionary algorithms and their models: A survey of the state-of-the-art , 2015, Appl. Soft Comput..

[5]  Kiyoshi Tanaka,et al.  Variable space diversity, crossover and mutation in MOEA solving many-objective knapsack problems , 2012, Annals of Mathematics and Artificial Intelligence.

[6]  P. N. Suganthan,et al.  Ensemble of Constraint Handling Techniques , 2010, IEEE Transactions on Evolutionary Computation.

[7]  Zibin Zheng,et al.  Multiobjective Vehicle Routing Problems With Simultaneous Delivery and Pickup and Time Windows: Formulation, Instances, and Algorithms , 2016, IEEE Transactions on Cybernetics.

[8]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[9]  Yalan Zhou,et al.  Multiobjective optimization algorithm with objective-wise learning for continuous multiobjective problems , 2014, Journal of Ambient Intelligence and Humanized Computing.

[10]  Xiaoyan Sun,et al.  A set-based genetic algorithm for solving the many-objective optimization problem , 2015, Soft Comput..

[11]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[12]  Patrick M. Reed,et al.  Borg: An Auto-Adaptive Many-Objective Evolutionary Computing Framework , 2013, Evolutionary Computation.

[13]  Peter J. Fleming,et al.  Diversity Management in Evolutionary Many-Objective Optimization , 2011, IEEE Transactions on Evolutionary Computation.

[14]  Bo Zhang,et al.  Balancing Convergence and Diversity in Decomposition-Based Many-Objective Optimizers , 2016, IEEE Transactions on Evolutionary Computation.

[15]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[16]  R. Everson,et al.  Visualising Mutually Non-dominating Solution Sets in Many-objective Optimisation , 2012 .

[17]  Jonathan E. Fieldsend,et al.  Visualizing Mutually Nondominating Solution Sets in Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[18]  Peter J. Fleming,et al.  A Real-World Application of a Many-Objective Optimisation Complexity Reduction Process , 2013, EMO.

[19]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[20]  Kalyanmoy Deb,et al.  Evaluating the -Domination Based Multi-Objective Evolutionary Algorithm for a Quick Computation of Pareto-Optimal Solutions , 2005, Evolutionary Computation.

[21]  Xin Yao,et al.  A New Dominance Relation-Based Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[22]  Sanghamitra Bandyopadhyay,et al.  An Algorithm for Many-Objective Optimization With Reduced Objective Computations: A Study in Differential Evolution , 2015, IEEE Transactions on Evolutionary Computation.

[23]  Xin Yao,et al.  Population-based Algorithm Portfolios with automated constituent algorithms selection , 2014, Inf. Sci..

[24]  Gexiang Zhang,et al.  A Many-Objective Evolutionary Algorithm With Enhanced Mating and Environmental Selections , 2015, IEEE Transactions on Evolutionary Computation.

[25]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[26]  Carlos A. Brizuela,et al.  A survey on multi-objective evolutionary algorithms for many-objective problems , 2014, Computational Optimization and Applications.

[27]  Habibollah Haron,et al.  The review of multiple evolutionary searches and multi-objective evolutionary algorithms , 2013, Artificial Intelligence Review.

[28]  Erik D. Goodman,et al.  Generalization of Pareto-Optimality for Many-Objective Evolutionary Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[29]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[30]  Yuping Wang,et al.  An improved $${\alpha }$$α-dominance strategy for many-objective optimization problems , 2016, Soft Comput..

[31]  Evan J. Hughes Fitness Assignment Methods for Many-Objective Problems , 2008, Multiobjective Problem Solving from Nature.

[32]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[33]  Tapabrata Ray,et al.  A Pareto Corner Search Evolutionary Algorithm and Dimensionality Reduction in Many-Objective Optimization Problems , 2011, IEEE Transactions on Evolutionary Computation.

[34]  Eckart Zitzler,et al.  Objective Reduction in Evolutionary Multiobjective Optimization: Theory and Applications , 2009, Evolutionary Computation.

[35]  Qingfu Zhang,et al.  Objective Reduction in Many-Objective Optimization: Linear and Nonlinear Algorithms , 2013, IEEE Transactions on Evolutionary Computation.

[36]  Hisao Ishibuchi,et al.  Distance-Based Analysis of Crossover Operators for Many-Objective Knapsack Problems , 2014, PPSN.

[37]  Luca Viganò,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2015, IWSEC 2015.

[38]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[39]  Enrique Alba,et al.  Multi-objective optimization using metaheuristics: non-standard algorithms , 2012, Int. Trans. Oper. Res..

[40]  Fei Peng,et al.  Population-Based Algorithm Portfolios for Numerical Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[41]  Jie Zhang,et al.  A Simple and Fast Hypervolume Indicator-Based Multiobjective Evolutionary Algorithm , 2015, IEEE Transactions on Cybernetics.

[42]  Tapabrata Ray,et al.  A Decomposition-Based Evolutionary Algorithm for Many Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[43]  Fang Liu,et al.  MOEA/D with uniform decomposition measurement for many-objective problems , 2014, Soft Computing.

[44]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[45]  Shengxiang Yang,et al.  A Comparative Study on Evolutionary Algorithms for Many-Objective Optimization , 2013, EMO.

[46]  Kalyanmoy Deb,et al.  Approximating a multi-dimensional Pareto front for a land use management problem: A modified MOEA with an epigenetic silencing metaphor , 2012, 2012 IEEE Congress on Evolutionary Computation.

[47]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[48]  Gary G. Yen,et al.  Many-Objective Evolutionary Algorithms Based on Coordinated Selection Strategy , 2017, IEEE Transactions on Evolutionary Computation.

[49]  Jun Zhang,et al.  Fuzzy-Based Pareto Optimality for Many-Objective Evolutionary Algorithms , 2014, IEEE Transactions on Evolutionary Computation.

[50]  Gary G. Yen,et al.  Many-Objective Evolutionary Algorithm: Objective Space Reduction and Diversity Improvement , 2016, IEEE Transactions on Evolutionary Computation.

[51]  Jasper A Vrugt,et al.  Improved evolutionary optimization from genetically adaptive multimethod search , 2007, Proceedings of the National Academy of Sciences.

[52]  Joseph R. Kasprzyk,et al.  Optimal Design of Water Distribution Systems Using Many-Objective Visual Analytics , 2013 .

[53]  Hisao Ishibuchi,et al.  Behavior of Multiobjective Evolutionary Algorithms on Many-Objective Knapsack Problems , 2015, IEEE Transactions on Evolutionary Computation.

[54]  Jiahai Wang,et al.  A Local Search-Based Multiobjective Optimization Algorithm for Multiobjective Vehicle Routing Problem With Time Windows , 2015, IEEE Systems Journal.

[55]  Tea Tusar,et al.  Visualization of Pareto Front Approximations in Evolutionary Multiobjective Optimization: A Critical Review and the Prosection Method , 2015, IEEE Transactions on Evolutionary Computation.

[56]  Shengxiang Yang,et al.  Bi-goal evolution for many-objective optimization problems , 2015, Artif. Intell..

[57]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[58]  Xiaoyan Sun,et al.  Indicator-based set evolution particle swarm optimization for many-objective problems , 2016, Soft Comput..

[59]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[60]  Ye Tian,et al.  A Knee Point-Driven Evolutionary Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[61]  Xin Yao,et al.  Two_Arch2: An Improved Two-Archive Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[62]  Bart Selman,et al.  Algorithm portfolios , 2001, Artif. Intell..

[63]  Qingfu Zhang,et al.  Decomposition-Based Multiobjective Evolutionary Algorithm With an Ensemble of Neighborhood Sizes , 2012, IEEE Transactions on Evolutionary Computation.

[64]  Xin Yao,et al.  Corner Sort for Pareto-Based Many-Objective Optimization , 2014, IEEE Transactions on Cybernetics.