Robust optimization: a kriging-based multi-objective optimization approach

In the robust shape optimization context, the evaluation cost of numerical models is reduced by the use of a response surface. Multi-objective methodologies for robust optimization that consist in simultaneously minimizing the expectation and variance of a function have already been developed to answer to this question. However, efficient estimation in the framework of time-consuming simulation has not been completely explored. In this paper, a robust optimization procedure based on Taylor expansion, kriging prediction and a genetic NSGA-II algorithm is proposed. The two objectives are the Taylor expansion of expectation and variance. The kriging technique is chosen to surrogate the function and its derivatives. Afterwards, NSGA-II is performed on kriging response surfaces or kriging expected improvements to construct a Pareto front. One point or a batch of points is chosen carefully to enrich the learning set of the model. When the budget is reached the non-dominated points provide designs that make compromises between optimization and robustness. Seven relevant strategies based on this main procedure are detailed and compared in two test functions (2D and 6D). In each case, the results are compared when the derivatives are observed and when they are not. The procedure is also applied to an industrial case study where the objective is to optimize the shape of a motor fan.

[1]  Nicolas Gayton,et al.  On the consideration of uncertainty in design: optimization - reliability - robustness , 2016, Structural and Multidisciplinary Optimization.

[2]  Rae. Z.H. Aliyev,et al.  Interpolation of Spatial Data , 2018, Biomedical Journal of Scientific & Technical Research.

[3]  Qingfu Zhang,et al.  On the Performance of Metamodel Assisted MOEA/D , 2007, ISICA.

[4]  Simon Moritz Göhler,et al.  Robustness Metrics: Consolidating the multiple approaches to quantify Robustness , 2016 .

[5]  Christopher K. I. Williams,et al.  Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning) , 2005 .

[6]  Daniel W. Apley,et al.  Understanding the effects of model uncertainty in robust design with computer experiments , 2006, DAC 2006.

[7]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[8]  Frederic Gillot,et al.  Methodology for the Design of the Geometry of a Cavity and Its Absorption Coefficients as Random Design Variables Under Vibroacoustic Criteria , 2016 .

[9]  Rodolphe Le Riche,et al.  Simultaneous kriging-based estimation and optimization of mean response , 2013, J. Glob. Optim..

[10]  Shigeru Obayashi,et al.  Efficient global optimization (EGO) for multi-objective problem and data mining , 2005, 2005 IEEE Congress on Evolutionary Computation.

[11]  Julien Marzat,et al.  Worst-case global optimization of black-box functions through Kriging and relaxation , 2012, Journal of Global Optimization.

[12]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[13]  Michael T. M. Emmerich,et al.  Hypervolume-based expected improvement: Monotonicity properties and exact computation , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[14]  Thomas J. Santner,et al.  Multiobjective optimization of expensive-to-evaluate deterministic computer simulator models , 2016, Comput. Stat. Data Anal..

[15]  M. Binois.  Uncertainty quantification on pareto fronts and high-dimensional strategies in bayesian optimization, with applications in multi-objective automotive design , 2015 .

[16]  Céline Helbert,et al.  DiceDesign and DiceEval: Two R Packages for Design and Analysis of Computer Experiments , 2015 .

[17]  Joachim Kunert,et al.  An Efficient Sequential Optimization Approach Based on the Multivariate Expected Improvement Criterion , 2007 .

[18]  Cécile Murat,et al.  Recent advances in robust optimization: An overview , 2014, Eur. J. Oper. Res..

[19]  Luc Pronzato,et al.  Robust design with nonparametric models: prediction of second-order characteristics of process variability by kriging 1 , 2003 .

[20]  Carlos A. Coello Coello,et al.  A Study of the Parallelization of a Coevolutionary Multi-objective Evolutionary Algorithm , 2004, MICAI.

[21]  Wolfgang Ponweiser,et al.  On Expected-Improvement Criteria for Model-based Multi-objective Optimization , 2010, PPSN.

[22]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[23]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[24]  Carlos M. Fonseca,et al.  An Improved Dimension-Sweep Algorithm for the Hypervolume Indicator , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[25]  D. Ginsbourger,et al.  Kriging is well-suited to parallelize optimization , 2010 .

[26]  Victor Picheny,et al.  Multiobjective optimization using Gaussian process emulators via stepwise uncertainty reduction , 2013, Statistics and Computing.

[27]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[28]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[29]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[30]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[31]  Berç Rustem,et al.  An algorithm for constrained nonlinear optimization under uncertainty , 1999, Autom..

[32]  Daniel W. Apley,et al.  Understanding the Effects of Model Uncertainty in Robust Design With Computer Experiments , 2006 .

[33]  Jason R. Schott.  Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimization. , 1995 .

[34]  Fred van Keulen,et al.  Efficient Kriging-based robust optimization of unconstrained problems , 2014, J. Comput. Sci..

[35]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[36]  R JonesDonald,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998 .

[37]  Loic Le Gratiet,et al.  Multi-fidelity Gaussian process regression for computer experiments , 2013 .

[38]  Wolfgang Ponweiser,et al.  Multiobjective Optimization on a Limited Budget of Evaluations Using Model-Assisted -Metric Selection , 2008, PPSN.