An effective method for quantifying and incorporating uncertainty in metamodel selection

In complex engineering systems, metamodels are extensively used to replace the computationally expensive simulation and analysis process. Different metamodels can be constructed by using different metamodeling techniques. Uncertainty exists in selecting the best metamodel among a set of alternatives. This study introduces an effective method based on Bayes’ theorem and additive adjustment factor for quantifying and incorporating this uncertainty in metamodel selection. In this method, the posterior probability of each metamodel evaluated by Bayes’ theorem is employed to quantify the uncertainty. The metamodel with the largest posterior probability is considered as the best. Then, the uncertainty in metamodel selection is accounted for by an additive adjustment factor and incorporated into the prediction of the best metamodel. Mathematical examples and the resistance and volume prediction example of a submersible are presented to showcase the introduced method. In these examples, metamodels are constructed by different metamodeling techniques, such as polynomial response surface (PRS), locally weighted regression (LWP), k-nearest neighbors (KNN), radial basis functions (RBF), multivariate adaptive regression splines (MARS) and Kriging. Results indicate that the introduced method can effectively quantify the uncertainty in metamodel selection and incorporate it into the prediction of a system output, hence achieving a prediction with good accuracy and small uncertainty.

[1]  T. Simpson,et al.  Analysis of support vector regression for approximation of complex engineering analyses , 2005, DAC 2003.

[2]  Daniel W. Apley,et al.  Understanding the effects of model uncertainty in robust design with computer experiments , 2006, DAC 2006.

[3]  Nong Zhang,et al.  A new sequential sampling method for constructing the high-order polynomial surrogate models , 2018 .

[4]  Yunkai Gao,et al.  Fatigue optimization with combined ensembles of surrogate modeling for a truck cab , 2014 .

[5]  Byeongdo Kim,et al.  Comparison study on the accuracy of metamodeling technique for non-convex functions , 2009 .

[6]  Terje Aven,et al.  Models and model uncertainty in the context of risk analysis , 2003, Reliab. Eng. Syst. Saf..

[7]  Ramana V. Grandhi,et al.  Quantification of model-form and predictive uncertainty for multi-physics simulation , 2011 .

[8]  Jack P. C. Kleijnen,et al.  Response surface methodology for constrained simulation optimization: An overview , 2008, Simul. Model. Pract. Theory.

[9]  Tae Hee Lee,et al.  A sampling technique enhancing accuracy and efficiency of metamodel-based RBDO: Constraint boundary sampling , 2008 .

[10]  G. Gary Wang,et al.  Review of Metamodeling Techniques in Support of Engineering Design Optimization , 2007 .

[11]  Wei Chen,et al.  A New Variable-Fidelity Optimization Framework Based on Model Fusion and Objective-Oriented Sequential Sampling , 2007, DAC 2007.

[12]  Dong-Hoon Choi,et al.  Robust estimation of support vector regression via residual bootstrap adoption , 2015 .

[13]  Daniel W. Apley,et al.  Understanding the Effects of Model Uncertainty in Robust Design With Computer Experiments , 2006 .

[14]  Alexander I. J. Forrester,et al.  Multi-fidelity optimization via surrogate modelling , 2007, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[15]  Heng Xiao,et al.  Quantifying and reducing model-form uncertainties in Reynolds-averaged Navier-Stokes simulations: A data-driven, physics-informed Bayesian approach , 2015, J. Comput. Phys..

[16]  Dong-Heon Kang,et al.  A robust optimization using the statistics based on kriging metamodel , 2006 .

[17]  Ramana V. Grandhi,et al.  A Method for the Quantification of Model-Form and Parametric Uncertainties in Physics-Based Simulations , 2011 .

[18]  Wei Chen,et al.  A non‐stationary covariance‐based Kriging method for metamodelling in engineering design , 2007 .

[19]  Jianguang Fang,et al.  On design optimization for structural crashworthiness and its state of the art , 2017 .

[20]  Zhen Luo,et al.  Incremental modeling of a new high-order polynomial surrogate model , 2016 .

[21]  Jong-Su Choi,et al.  Statistical surrogate model based sampling criterion for stochastic global optimization of problems with constraints , 2015 .

[22]  Hirotaka Nakayama,et al.  Simulation-Based Optimization Using Computational Intelligence , 2002 .

[23]  Enrique López Droguett,et al.  Bayesian Methodology for Model Uncertainty Using Model Performance Data , 2008, Risk analysis : an official publication of the Society for Risk Analysis.

[24]  Dong-Hoon Choi,et al.  Metamodel-based design optimization of injection molding process variables and gates of an automotive glove box for enhancing its quality , 2016 .

[25]  Jack P. C. Kleijnen,et al.  Kriging Metamodeling in Simulation: A Review , 2007, Eur. J. Oper. Res..

[26]  Ping Zhu,et al.  Lightweight design of vehicle front–end structure: contributions of multiple surrogates , 2011 .

[27]  Timothy W. Simpson,et al.  Metamodeling in Multidisciplinary Design Optimization: How Far Have We Really Come? , 2014 .

[28]  Ren-Jye Yang,et al.  An Adaptive Response Surface Method Using Bayesian Metric and Model Bias Correction Function , 2014 .

[29]  Pingfeng Wang,et al.  A Maximum Confidence Enhancement Based Sequential Sampling Scheme for Simulation-Based Design , 2013, DAC 2013.

[30]  Joo-Ho Choi,et al.  Efficient reliability analysis based on Bayesian framework under input variable and metamodel uncertainties , 2012 .

[31]  Ramana V. Grandhi,et al.  A Bayesian approach for quantification of model uncertainty , 2010, Reliab. Eng. Syst. Saf..

[32]  Wei Chen,et al.  Concurrent treatment of parametric uncertainty and metamodeling uncertainty in robust design , 2013 .

[33]  A. OHagan,et al.  Bayesian analysis of computer code outputs: A tutorial , 2006, Reliab. Eng. Syst. Saf..