A Taxonomy for Metamodeling Frameworks for Evolutionary Multiobjective Optimization

One of the main difficulties in applying an optimization algorithm to a practical problem is that evaluation of objectives and constraints often involve computationally expensive procedures. To handle such problems, a metamodel is first formed from a few exact (high-fidelity) solution evaluations and then optimized by an algorithm in a progressive manner. However, in solving multiobjective or many-objective optimization problems involving multiple constraints, a simple extension of the idea to form one metamodel for each objective and constraint function may not constitute the most efficient approach. The cumulative effect of errors from each metamodel may turn out to be detrimental for the accuracy of the overall optimization procedure. In this paper, we propose a taxonomy of different plausible metamodeling frameworks for multiobjective and many-objective optimization and provide a comparative study by discussing advantages and disadvantages of each framework. The results presented in this paper are obtained using the well-known Kriging metamodeling approach. Based on our extensive simulation studies on proposed frameworks, we report intriguing observations about the behavior of each framework, which may provide salient guidelines for further studies in this emerging area within evolutionary multiobjective optimization.

[1]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[2]  Tapabrata Ray,et al.  Surrogate assisted Simulated Annealing (SASA) for constrained multi-objective optimization , 2010, IEEE Congress on Evolutionary Computation.

[3]  Khaled Rasheed,et al.  A Survey of Fitness Approximation Methods Applied in Evolutionary Algorithms , 2010 .

[4]  Kalyanmoy Deb,et al.  An Optimality Theory Based Proximity Measure for Evolutionary Multi-Objective and Many-Objective Optimization , 2015, EMO.

[5]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[6]  K. Deb.  An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[7]  Carlos A. Coello Coello,et al.  Multi-objective airfoil shape optimization using a multiple-surrogate approach , 2012, 2012 IEEE Congress on Evolutionary Computation.

[8]  Saúl Zapotecas Martínez,et al.  MOEA/D assisted by rbf networks for expensive multi-objective optimization problems , 2013, GECCO '13.

[9]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[10]  Bernd Bischl,et al.  Model-Based Multi-objective Optimization: Taxonomy, Multi-Point Proposal, Toolbox and Benchmark , 2015, EMO.

[11]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[12]  Bernd Bischl,et al.  MOI-MBO: Multiobjective Infill for Parallel Model-Based Optimization , 2014, LION.

[13]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[14]  Fabio Schoen,et al.  Global optimization of expensive black box problems with a known lower bound , 2013, J. Glob. Optim..

[15]  Edgar Tello-Leal,et al.  A Review of Surrogate Assisted Multiobjective Evolutionary Algorithms , 2016, Comput. Intell. Neurosci..

[16]  Kalyanmoy Deb,et al.  Hybrid evolutionary multi-objective optimization and analysis of machining operations , 2012 .

[17]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[18]  Carlos A. Coello Coello,et al.  A Review of Techniques for Handling Expensive Functions in Evolutionary Multi-Objective Optimization , 2010 .

[19]  Yu Zhang,et al.  Multi-objective optimization of double suction centrifugal pump using Kriging metamodels , 2014, Adv. Eng. Softw..

[20]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[21]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[22]  Kalyanmoy Deb,et al.  A Multimodal Approach for Evolutionary Multi-objective Optimization (MEMO): Proof-of-Principle Results , 2015, EMO.

[23]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[24]  Wolfgang Ponweiser,et al.  Multiobjective Optimization on a Limited Budget of Evaluations Using Model-Assisted -Metric Selection , 2008, PPSN.

[25]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[26]  Bernhard Sendhoff,et al.  Multi co-objective evolutionary optimization: Cross surrogate augmentation for computationally expensive problems , 2012, 2012 IEEE Congress on Evolutionary Computation.

[27]  Andrzej P. Wierzbicki,et al.  The Use of Reference Objectives in Multiobjective Optimization , 1979 .

[28]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[29]  Kalyanmoy Deb,et al.  A Generative Kriging Surrogate Model for Constrained and Unconstrained Multi-objective Optimization , 2016, GECCO.