An easy-to-use real-world multi-objective optimization problem suite

Abstract Although synthetic test problems are widely used for the performance assessment of evolutionary multi-objective optimization algorithms, they are likely to include unrealistic properties which may lead to overestimation/underestimation. To address this issue, we present a multi-objective optimization problem suite consisting of 16 bound-constrained real-world problems. The problem suite includes various problems in terms of the number of objectives, the shape of the Pareto front, and the type of design variables. 4 out of the 16 problems are multi-objective mixed-integer optimization problems. We provide Java, C, and Matlab source codes of the 16 problems so that they are available in an off-the-shelf manner. We examine an approximated Pareto front of each test problem. We also analyze the performance of six representative evolutionary multi-objective optimization algorithms on the 16 problems. In addition to the 16 problems, we present 8 constrained multi-objective real-world problems.

[1]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[2]  Jonathan A. Wright,et al.  Constrained, mixed-integer and multi-objective optimisation of building designs by NSGA-II with fitness approximation , 2015, Appl. Soft Comput..

[3]  H. Amir,et al.  Nonlinear Mixed-Discrete Structural Optimization , 1989 .

[4]  Hisao Ishibuchi,et al.  Use of Piecewise Linear and Nonlinear Scalarizing Functions in MOEA/D , 2016, PPSN.

[5]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[6]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[7]  Lothar Thiele,et al.  The Hypervolume Indicator Revisited: On the Design of Pareto-compliant Indicators Via Weighted Integration , 2007, EMO.

[8]  S. N. Kramer,et al.  An Augmented Lagrange Multiplier Based Method for Mixed Integer Discrete Continuous Optimization and Its Applications to Mechanical Design , 1994 .

[9]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[10]  Evan J. Hughes,et al.  Radar Waveform Optimisation as a Many-Objective Application Benchmark , 2007, EMO.

[11]  Marco Laumanns,et al.  Scalable test problems for evolutionary multi-objective optimization , 2001 .

[12]  Hisao Ishibuchi,et al.  Regular Pareto Front Shape is not Realistic , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[13]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[14]  Carlos A. Coello Coello,et al.  Constraint-handling in nature-inspired numerical optimization: Past, present and future , 2011, Swarm Evol. Comput..

[15]  Jonathan E. Fieldsend,et al.  A Suite of Computationally Expensive Shape Optimisation Problems Using Computational Fluid Dynamics , 2018, PPSN.

[16]  F. Cheng,et al.  GENERALIZED CENTER METHOD FOR MULTIOBJECTIVE ENGINEERING OPTIMIZATION , 1999 .

[17]  Antonin Ponsich,et al.  A Survey on Multiobjective Evolutionary Algorithms for the Solution of the Portfolio Optimization Problem and Other Finance and Economics Applications , 2013, IEEE Transactions on Evolutionary Computation.

[18]  Yuren Zhou,et al.  A Vector Angle-Based Evolutionary Algorithm for Unconstrained Many-Objective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[19]  Antonio J. Nebro,et al.  jMetal: A Java framework for multi-objective optimization , 2011, Adv. Eng. Softw..

[20]  Antonio J. Nebro,et al.  Redesigning the jMetal Multi-Objective Optimization Framework , 2015, GECCO.

[21]  Yun Li,et al.  Optimization and robustness for crashworthiness of side impact , 2001 .

[22]  Shengxiang Yang,et al.  An Improved Multiobjective Optimization Evolutionary Algorithm Based on Decomposition for Complex Pareto Fronts , 2016, IEEE Transactions on Cybernetics.

[23]  Kevin Tucker,et al.  Response surface approximation of pareto optimal front in multi-objective optimization , 2004 .

[24]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[25]  Hisao Ishibuchi,et al.  An analysis of control parameters of MOEA/D under two different optimization scenarios , 2018, Appl. Soft Comput..

[26]  Hisao Ishibuchi,et al.  Performance of Decomposition-Based Many-Objective Algorithms Strongly Depends on Pareto Front Shapes , 2017, IEEE Transactions on Evolutionary Computation.

[27]  Carlos A. Coello Coello,et al.  A Study of the Parallelization of a Coevolutionary Multi-objective Evolutionary Algorithm , 2004, MICAI.

[28]  Hisao Ishibuchi,et al.  Benchmarking Multi- and Many-Objective Evolutionary Algorithms Under Two Optimization Scenarios , 2017, IEEE Access.

[29]  Shengxiang Yang,et al.  Improving the multiobjective evolutionary algorithm based on decomposition with new penalty schemes , 2017, Soft Comput..

[30]  Kalyanmoy Deb,et al.  Reliability-Based Optimization Using Evolutionary Algorithms , 2009, IEEE Transactions on Evolutionary Computation.

[31]  Qing Li,et al.  Multiobjective optimization for crash safety design of vehicles using stepwise regression model , 2008 .

[32]  Kiyoshi Tanaka,et al.  A Review of Features and Limitations of Existing Scalable Multiobjective Test Suites , 2019, IEEE Transactions on Evolutionary Computation.

[33]  Akira Oyama,et al.  Proposal of benchmark problem based on real-world car structure design optimization , 2018, GECCO.

[34]  Qingfu Zhang,et al.  Comparison between MOEA/D and NSGA-III on a set of novel many and multi-objective benchmark problems with challenging difficulties , 2019, Swarm Evol. Comput..

[35]  Michael G. Parsons,et al.  Formulation of Multicriterion Design Optimization Problems for Solution With Scalar Numerical Optimization Methods , 2004 .

[36]  Dipti Srinivasan,et al.  A Survey of Multiobjective Evolutionary Algorithms Based on Decomposition , 2017, IEEE Transactions on Evolutionary Computation.

[37]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[38]  Hisao Ishibuchi,et al.  Performance comparison of NSGA-II and NSGA-III on various many-objective test problems , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[39]  Markus Olhofer,et al.  Evolutionary Many-Objective Optimization of Hybrid Electric Vehicle Control: From General Optimization to Preference Articulation , 2017, IEEE Transactions on Emerging Topics in Computational Intelligence.

[40]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[41]  Kuangrong Hao,et al.  A Clustering-Based Adaptive Evolutionary Algorithm for Multiobjective Optimization With Irregular Pareto Fronts , 2019, IEEE Transactions on Cybernetics.

[42]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[43]  Xin Yao,et al.  How to Read Many-Objective Solution Sets in Parallel Coordinates [Educational Forum] , 2017, IEEE Computational Intelligence Magazine.

[44]  Ivan Zelinka,et al.  MIXED INTEGER-DISCRETE-CONTINUOUS OPTIMIZATION BY DIFFERENTIAL EVOLUTION Part 2 : a practical example , 1999 .

[45]  Tapabrata Ray,et al.  Optimum Oil Production Planning Using Infeasibility Driven Evolutionary Algorithm , 2013, Evolutionary Computation.

[46]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[47]  João C. N. Clímaco,et al.  A review of interactive methods for multiobjective integer and mixed-integer programming , 2007, Eur. J. Oper. Res..

[48]  Kevin Tucker,et al.  CFD-Based Design Optimization for Single Element Rocket Injector , 2003 .

[49]  Tea Tusar,et al.  Visualization of Pareto Front Approximations in Evolutionary Multiobjective Optimization: A Critical Review and the Prosection Method , 2015, IEEE Transactions on Evolutionary Computation.

[50]  Dimo Brockhoff,et al.  Mixed-integer benchmark problems for single- and bi-objective optimization , 2019, GECCO.

[51]  Pascal Kerschke,et al.  Single- and multi-objective game-benchmark for evolutionary algorithms , 2019, GECCO.

[52]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[53]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[54]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[55]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[56]  Hisao Ishibuchi,et al.  A Review of Evolutionary Multi-modal Multi-objective Optimization , 2020, arXiv.org.

[57]  K. C. Seow,et al.  MULTIOBJECTIVE DESIGN OPTIMIZATION BY AN EVOLUTIONARY ALGORITHM , 2001 .

[58]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[59]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[60]  Hisao Ishibuchi,et al.  A Review of Evolutionary Multimodal Multiobjective Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[61]  Aravind Srinivasan,et al.  Innovization: innovating design principles through optimization , 2006, GECCO.

[62]  Xin Yao,et al.  A New Dominance Relation-Based Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[63]  Saúl Zapotecas Martínez,et al.  LIBEA: A Lebesgue Indicator-Based Evolutionary Algorithm for multi-objective optimization , 2019, Swarm Evol. Comput..

[64]  Miqing Li,et al.  Benchmark Functions for the CEC'2017 Competition on Many-Objective Optimization , 2017 .

[65]  Shengxiang Yang,et al.  Evolutionary dynamic optimization: A survey of the state of the art , 2012, Swarm Evol. Comput..

[66]  Tapabrata Ray,et al.  A Swarm Metaphor for Multiobjective Design Optimization , 2002 .

[67]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[68]  C. A. Coello Coello,et al.  Multiobjective structural optimization using a microgenetic algorithm , 2005 .

[69]  Daisuke Sasaki,et al.  Multiobjective evolutionary computation for supersonic wing-shape optimization , 2000, IEEE Trans. Evol. Comput..

[70]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[71]  Nickolas Vlahopoulos,et al.  An integrated multidisciplinary particle swarm optimization approach to conceptual ship design , 2010 .

[72]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[73]  A. Farhang-Mehr,et al.  Entropy-based multi-objective genetic algorithm for design optimization , 2002 .