A Critical Review of Surrogate Assisted Robust Design Optimization

Robust design optimization (RDO) has been eminent, ascertaining optimal configuration of engineering systems in presence of uncertainties. However, computational aspect of conventional RDO can often get computationally intensive as neighborhood assessments of every solution are required to compute the performance variance and ensure feasibility. Surrogate assisted optimization is one of the efficient approaches in order to mitigate this issue of computational expense. However, the performance of a surrogate model plays a key factor in determining the optima in multi-modal and highly non-linear landscapes, in presence of uncertainties. In other words, the approximation accuracy of the model is principal in yielding the actual optima and thus, avoiding any misguide to the decision maker on the basis of false or, local optimum points. Therefore, an extensive survey has been carried out by employing most of the well-known surrogate models in the framework of RDO. It is worth mentioning that the numerical study has revealed consistent performance of a model out of all the surrogates utilized. Finally, the best performing model has been utilized in solving a large-scale practical RDO problem. All the results have been compared with that of Monte Carlo simulation results.

[1]  Bruno Sudret,et al.  Global sensitivity analysis using polynomial chaos expansions , 2008, Reliab. Eng. Syst. Saf..

[2]  D. Krige A statistical approach to some basic mine valuation problems on the Witwatersrand, by D.G. Krige, published in the Journal, December 1951 : introduction by the author , 1951 .

[3]  H. Rabitz,et al.  Reproducing kernel Hilbert space interpolation methods as a paradigm of high dimensional model representations: Application to multidimensional potential energy surface construction , 2003 .

[4]  R. M. Hicks,et al.  Wing Design by Numerical Optimization , 1977 .

[5]  Ying Hung,et al.  PENALIZED BLIND KRIGING IN COMPUTER EXPERIMENTS , 2011 .

[6]  E. Zio,et al.  A study of the bootstrap method for estimating the accuracy of artificial neural networks in predicting nuclear transient processes , 2006, IEEE Transactions on Nuclear Science.

[7]  Daniele Peri,et al.  Robust optimization for ship conceptual design , 2010 .

[8]  John E. Mottershead,et al.  A review of robust optimal design and its application in dynamics , 2005 .

[9]  Tae Hee Lee,et al.  Metamodel-Based Shape Optimization of Connecting Rod Considering Fatigue Life , 2006 .

[10]  J. J. Warnes,et al.  A sensitivity analysis for universal kriging , 1986 .

[11]  B. Sudret,et al.  An adaptive algorithm to build up sparse polynomial chaos expansions for stochastic finite element analysis , 2010 .

[12]  Kevin N. Gurney,et al.  An introduction to neural networks , 2018 .

[13]  Martin D. Buhmann,et al.  Radial Basis Functions , 2021, Encyclopedia of Mathematical Geosciences.

[14]  Enrico Zio,et al.  Parameters Tuning in Support Vector Regression for Reliability Forecasting , 2013 .

[15]  Wei Chen,et al.  Towards a Better Understanding of Modeling Feasibility Robustness in Engineering Design , 2000 .

[16]  A. Meher Prasad,et al.  High dimensional model representation for piece‐wise continuous function approximation , 2007 .

[17]  Michael G. Parsons,et al.  Formulation of Multicriterion Design Optimization Problems for Solution With Scalar Numerical Optimization Methods , 2004 .

[18]  Sondipon Adhikari,et al.  Combined parametric-nonparametric uncertainty quantification using random matrix theory and polynomial chaos expansion , 2012 .

[19]  Hao Zhang,et al.  A Multiwavelet Neural Network‐Based Response Surface Method for Structural Reliability Analysis , 2015, Comput. Aided Civ. Infrastructure Eng..

[20]  Subrata Chakraborty,et al.  Robust optimum design of base isolation system in seismic vibration control of structures under random system parameters , 2015 .

[21]  Manolis Papadrakakis,et al.  Reliability based robust design optimization of steel structures , 2007 .

[22]  Enrico Zio,et al.  A Novel Dynamic-Weighted Probabilistic Support Vector Regression-Based Ensemble for Prognostics of Time Series Data , 2015, IEEE Transactions on Reliability.

[23]  R. L. Hardy Multiquadric equations of topography and other irregular surfaces , 1971 .

[24]  T. Gasser,et al.  Fast Algorithms for Nonparametric Curve Estimation , 1994 .

[25]  Timothy M. Mauery,et al.  COMPARISON OF RESPONSE SURFACE AND KRIGING MODELS FOR MULTIDISCIPLINARY DESIGN OPTIMIZATION , 1998 .

[26]  N. Wiener The Homogeneous Chaos , 1938 .

[27]  Rommel G. Regis,et al.  Evolutionary Programming for High-Dimensional Constrained Expensive Black-Box Optimization Using Radial Basis Functions , 2014, IEEE Transactions on Evolutionary Computation.

[28]  Seong-Hee Kim,et al.  Guest Editors' Introduction to Special Issue on the 2012 NSF workshop , 2014, TOMC.

[29]  T. Coen,et al.  Optimizing the tuning parameters of least squares support vector machines regression for NIR spectra , 2006 .

[30]  Sondipon Adhikari,et al.  Polynomial Chaos Expansion and Steady-State Response of a Class of Random Dynamical Systems , 2015 .

[31]  M. McDonald,et al.  Robust shape optimization of notches for fatigue-life extension , 2004 .

[32]  Hein Putter,et al.  On the effect of covariance function estimation on the accuracy of kriging predictors , 2001 .

[33]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[34]  Alireza Doostan,et al.  Coherence motivated sampling and convergence analysis of least squares polynomial Chaos regression , 2014, 1410.1931.

[35]  I. Doltsinis,et al.  ROBUST DESIGN OF STRUCTURES USING OPTIMIZATION METHODS , 2004 .

[36]  Bruno Sudret,et al.  Meta-models for structural reliability and uncertainty quantification , 2012, 1203.2062.

[37]  Jianqing Fan,et al.  Adaptive Order Polynomial Fitting: Bandwidth Robustification and Bias Reduction , 1995 .

[38]  Luca Daniel,et al.  Calculation of Generalized Polynomial-Chaos Basis Functions and Gauss Quadrature Rules in Hierarchical Uncertainty Quantification , 2014, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[39]  Jianqing Fan,et al.  On automatic boundary corrections , 1997 .

[40]  Sang-Hoon Lee,et al.  Robust design with arbitrary distributions using Gauss-type quadrature formula , 2009 .

[41]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[42]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[43]  K. K. Choi,et al.  Development and validation of a dynamic metamodel based on stochastic radial basis functions and uncertainty quantification , 2014, Structural and Multidisciplinary Optimization.

[44]  Jianqing Fan,et al.  Fast Implementations of Nonparametric Curve Estimators , 1994 .

[45]  Matt P. Wand,et al.  On the Accuracy of Binned Kernel Density Estimators , 1994 .

[46]  T. W. Layne,et al.  A Comparison of Approximation Modeling Techniques: Polynomial Versus Interpolating Models , 1998 .

[47]  Ming-Yen Cheng,et al.  A bandwidth selector for local linear density estimators , 1997 .

[48]  R. Olea Optimal contour mapping using universal kriging , 1974 .

[49]  W. Cleveland Robust Locally Weighted Regression and Smoothing Scatterplots , 1979 .

[50]  Jian Deng,et al.  Structural reliability analysis for implicit performance function using radial basis function network , 2006 .

[51]  Soo-Chang Kang,et al.  An efficient response surface method using moving least squares approximation for structural reliability analysis , 2010 .

[52]  Ilya M. Sobol,et al.  Sensitivity Estimates for Nonlinear Mathematical Models , 1993 .

[53]  Liming Zhou,et al.  Robust optimization design for fatigue life , 2011 .

[54]  Madhan Shridhar Phadke,et al.  Quality Engineering Using Robust Design , 1989 .

[55]  Yunkai Gao,et al.  Multiobjective reliability-based optimization for design of a vehicledoor , 2013 .

[56]  Jianqing Fan Local Linear Regression Smoothers and Their Minimax Efficiencies , 1993 .

[57]  R. Walters,et al.  Point-Collocation Nonintrusive Polynomial Chaos Method for Stochastic Computational Fluid Dynamics , 2010 .

[58]  Sang Hyo Kim,et al.  Response surface method using vector projected sampling points , 1997 .

[59]  Singiresu S Rao,et al.  A GENERAL LOSS FUNCTION BASED OPTIMIZATION PROCEDURE FOR ROBUST DESIGN , 1996 .

[60]  Hyun-Han Kwon,et al.  Locally weighted polynomial regression: Parameter choice and application to forecasts of the Great Salt Lake , 2006 .

[61]  Agus Sudjianto,et al.  Computer Aided Reliability and Robustness Assessment , 1998 .

[62]  Xu Han,et al.  An efficient PMA-based reliability analysis technique using radial basis function , 2014 .

[63]  Peter Craven,et al.  Smoothing noisy data with spline functions , 1978 .

[64]  T. Simpson,et al.  Comparative studies of metamodelling techniques under multiple modelling criteria , 2001 .

[65]  Irfan Kaymaz,et al.  Application Of Kriging Method To Structural Reliability Problems , 2005 .

[66]  Kalyanmoy Deb,et al.  Reliability-Based Optimization Using Evolutionary Algorithms , 2009, IEEE Transactions on Evolutionary Computation.

[67]  Thiagarajan Krishnamurthy,et al.  Response Surface Approximation with Augmented and Compactly Supported Radial Basis Functions , 2003 .

[68]  Tomáš Mareš,et al.  Artificial neural networks in the calibration of nonlinear mechanical models , 2016, Adv. Eng. Softw..

[69]  Jianqing Fan,et al.  Local Polynomial Regression: Optimal Kernels and Asymptotic Minimax Efficiency , 1997 .

[70]  Genichi Taguchi,et al.  Quality Engineering through Design Optimization , 1989 .

[71]  Su-xun Shu,et al.  An artificial neural network-based response surface method for reliability analyses of c-φ slopes with spatially variable soil , 2016 .

[72]  Martin T. Hagan,et al.  Neural network design , 1995 .

[73]  Wei Wang,et al.  An improved radial basis function network for structural reliability analysis , 2011 .

[74]  Huashuai Qu,et al.  Gradient Extrapolated Stochastic Kriging , 2014, TOMC.

[75]  H. Rabitz,et al.  General foundations of high‐dimensional model representations , 1999 .

[76]  Dongbin Xiu,et al.  The Wiener-Askey Polynomial Chaos for Stochastic Differential Equations , 2002, SIAM J. Sci. Comput..

[77]  Martine Rivest,et al.  Kriging groundwater solute concentrations using flow coordinates and nonstationary covariance functions , 2012 .

[78]  T. Simpson,et al.  Comparative studies of metamodeling techniques under multiple modeling criteria , 2000 .

[79]  C. Prieur,et al.  Generalized Hoeffding-Sobol Decomposition for Dependent Variables -Application to Sensitivity Analysis , 2011, 1112.1788.

[80]  Nickolas Vlahopoulos,et al.  An integrated multidisciplinary particle swarm optimization approach to conceptual ship design , 2010 .

[81]  Fuqiong Zhao Gear Remaining Useful Life Prediction Using Generalized Polynomial Chaos Collocation Method , 2012 .

[82]  Zhiwei Guo,et al.  Application of Least Squares Support Vector Machine for Regression to Reliability Analysis , 2009 .

[83]  Guangyao Li,et al.  Crashworthiness design of vehicle by using multiobjective robust optimization , 2011 .

[84]  Hae Chang Gea,et al.  Stochastic Kriging for Random Simulation Metamodeling With Finite Sampling , 2013, DAC 2013.

[85]  P. Bouillard,et al.  Hierarchical stochastic metamodels based on moving least squares and polynomial chaos expansion , 2011 .

[86]  Tapabrata Ray,et al.  A surrogate assisted parallel multiobjective evolutionary algorithm for robust engineering design , 2006 .

[87]  Bernhard Sendhoff,et al.  Robust Optimization - A Comprehensive Survey , 2007 .

[88]  Enrico Zio,et al.  A Novel Hybrid Method of Parameters Tuning in Support Vector Regression for Reliability Prediction: Particle Swarm Optimization Combined With Analytical Selection , 2016, IEEE Transactions on Reliability.

[89]  Jianqing Fan,et al.  Variable Bandwidth and Local Linear Regression Smoothers , 1992 .

[90]  Jean-Michel Loubes,et al.  Estimation of covariance functions by a fully data-driven model selection procedure and its application to Kriging spatial interpolation of real rainfall data , 2014, Stat. Methods Appl..

[91]  Farrokh Mistree,et al.  A procedure for robust design: Minimizing variations caused by noise factors and control factors , 1996 .

[92]  Jianguo Zhang,et al.  The hybrid uncertain neural network method for mechanical reliability analysis , 2015 .

[93]  T Haftka Raphael,et al.  Multidisciplinary aerospace design optimization: survey of recent developments , 1996 .

[94]  J. Kleijnen Statistical tools for simulation practitioners , 1986 .

[95]  Genichi Taguchi System Of Experimental Design: Engineering Methods To Optimize Quality And Minimize Costs , 1987 .

[96]  Xiaoping Du,et al.  Analytical robustness assessment for robust design , 2007 .

[97]  G. Wahba Smoothing noisy data with spline functions , 1975 .

[98]  Qi Li,et al.  Multivariate local polynomial regression for estimating average derivatives , 2003 .

[99]  Kyung K. Choi,et al.  Dimension reduction method for reliability-based robust design optimization , 2006 .

[100]  Xiaoping Du,et al.  The use of metamodeling techniques for optimization under uncertainty , 2001 .

[101]  Filip De Turck,et al.  Blind Kriging: Implementation and performance analysis , 2012, Adv. Eng. Softw..

[102]  S. Adhikari,et al.  A reduced polynomial chaos expansion method for the stochastic finite element analysis , 2012 .

[103]  Puneet Singla,et al.  Polynomial Chaos Quadrature-based Minimum Variance Approach for Source Parameters Estimation , 2012, ICCS.

[104]  Benjamin Richard,et al.  A response surface method based on support vector machines trained with an adaptive experimental design , 2012 .

[105]  Natalia Alexandrov,et al.  Analytical and Computational Aspects of Collaborative Optimization for Multidisciplinary Design , 2002 .

[106]  Bogumil Kaminski,et al.  A method for the updating of stochastic kriging metamodels , 2015, Eur. J. Oper. Res..

[107]  Bruno Sudret,et al.  Adaptive sparse polynomial chaos expansion based on least angle regression , 2011, J. Comput. Phys..

[108]  J. Friedman Multivariate adaptive regression splines , 1990 .

[109]  Theo Gasser,et al.  Data Adaptive Ridging in Local Polynomial Regression , 2000 .

[110]  Enrico Zio,et al.  Computing confidence and prediction intervals of industrial equipment degradation by bootstrapped support vector regression , 2015, Reliab. Eng. Syst. Saf..

[111]  W. R. Schucany,et al.  Adaptive Bandwidth Choice for Kernel Regression , 1995 .

[112]  Runze Li,et al.  Local composite quantile regression smoothing: an efficient and safe alternative to local polynomial regression , 2010 .

[113]  W. Cleveland,et al.  Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting , 1988 .

[114]  Biswarup Bhattacharyya,et al.  A Critical Appraisal of Design of Experiments for Uncertainty Quantification , 2018 .

[115]  Agus Sudjianto,et al.  Blind Kriging: A New Method for Developing Metamodels , 2008 .

[116]  Gyung-Jin Park,et al.  Robust optimization of an automobile rearview mirror for vibration reduction , 2001 .

[117]  D. Xiu,et al.  Modeling Uncertainty in Steady State Diffusion Problems via Generalized Polynomial Chaos , 2002 .

[118]  Jianrong Tan,et al.  Robust optimization of structural dynamic characteristics based on adaptive Kriging model and CNSGA , 2015 .

[119]  Herschel Rabitz,et al.  Efficient Implementation of High Dimensional Model Representations , 2001 .

[120]  D. Xiu,et al.  Modeling uncertainty in flow simulations via generalized polynomial chaos , 2003 .

[121]  A. Meher Prasad,et al.  High‐dimensional model representation for structural reliability analysis , 2009 .

[122]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[123]  W. Cleveland,et al.  Regression by local fitting: Methods, properties, and computational algorithms , 1988 .

[124]  J. W. Humberston Classical mechanics , 1980, Nature.

[125]  A. O'Hagan,et al.  Predicting the output from a complex computer code when fast approximations are available , 2000 .

[126]  Gerhart I. Schuëller,et al.  Computational methods in optimization considering uncertainties – An overview , 2008 .

[127]  Liang Gao,et al.  An efficient method for reliability analysis under epistemic uncertainty based on evidence theory and support vector regression , 2015 .

[128]  T. Hastie,et al.  Local Regression: Automatic Kernel Carpentry , 1993 .

[129]  Xu Han,et al.  A Structural Reliability Analysis Method Based on Radial Basis Function , 2012 .