Bayesian Metamodeling for Computer Experiments Using the Gaussian Kriging Models

In the past two decades, more and more quality and reliability activities have been moving into the design of product and process. The design and analysis of computer experiments, as a new frontier of the design of experiments, has become increasingly popular among modern companies for optimizing product and process conditions and producing high-quality yet low-cost products and processes. This article mainly focuses on the issue of constructing cheap metamodels as alternatives to the expensive computer simulators and proposes a new metamodeling method on the basis of the Gaussian stochastic process model or Gaussian Kriging. Rather than a constant mean as in ordinary Kriging or a fixed mean function as in universal Kriging, the new method captures the overall trend of the performance characteristics of products and processes through a more accurate mean, by efficiently incorporating a scheme of sparseness prior–based Bayesian inference into Kriging. Meanwhile, the mean model is able to adaptively exclude the unimportant effects that deteriorate the prediction performance. The results of an experiment on empirical applications demonstrate that, compared with several benchmark methods in the literature, the proposed Bayesian method is not only much more effective in approximation but also very efficient in implementation, hence more appropriate than the widely used ordinary Kriging to empirical applications in the real world. Copyright © 2011 John Wiley & Sons, Ltd.

[1]  T. Simpson,et al.  Analysis of support vector regression for approximation of complex engineering analyses , 2005, DAC 2003.

[2]  Jack P. C. Kleijnen,et al.  Kriging for interpolation in random simulation , 2003, J. Oper. Res. Soc..

[3]  N. Yi,et al.  Bayesian LASSO for Quantitative Trait Loci Mapping , 2008, Genetics.

[4]  Runze Li,et al.  MODEL SELECTION FOR ANALYSIS OF UNIFORM DESIGN AND COMPUTER EXPERIMENT , 2002 .

[5]  T. Simpson,et al.  Comparative studies of metamodelling techniques under multiple modelling criteria , 2001 .

[6]  D. Gianola,et al.  A whole-genome analysis using robust asymmetric distributions. , 2006, Genetical research.

[7]  Urmila M. Diwekar,et al.  An efficient sampling technique for off-line quality control , 1997 .

[8]  G. Casella,et al.  The Bayesian Lasso , 2008 .

[9]  Yong Zhang,et al.  Uniform Design: Theory and Application , 2000, Technometrics.

[10]  Søren Nymand Lophaven,et al.  DACE - A Matlab Kriging Toolbox , 2002 .

[11]  Manolis Papadrakakis,et al.  Structural optimization using evolution strategies and neural networks , 1998 .

[12]  Mohammed Yusuf Ali,et al.  Effect of a Deformable Roller on Residual Stress Distribution for Elastic-Plastic Flat Plate Rolling under Plane Strain Conditions , 2012 .

[13]  Ron S. Kenett,et al.  Achieving Robust Design from Computer Simulations , 2006 .

[14]  Runze Li,et al.  Analysis of Computer Experiments Using Penalized Likelihood in Gaussian Kriging Models , 2005, Technometrics.

[15]  Jianqing Fan,et al.  Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties , 2001 .

[16]  Ronald L. Iman,et al.  Statistical Aspects of Forecasting and Planning for Hurricanes , 2006 .

[17]  Dennis K. J. Lin,et al.  Ch. 4. Uniform experimental designs and their applications in industry , 2003 .

[18]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[19]  Jerome Sacks,et al.  Designs for Computer Experiments , 1989 .

[20]  Stefan H. Thomke,et al.  THE CRASH IN THE MACHINE , 1999 .

[21]  Kenny Q. Ye,et al.  Algorithmic construction of optimal symmetric Latin hypercube designs , 2000 .

[22]  Mário A. T. Figueiredo Adaptive Sparseness for Supervised Learning , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  David P. Wipf,et al.  Bayesian methods for finding sparse representations , 2006 .

[24]  Aggelos K. Katsaggelos,et al.  Bayesian Compressive Sensing Using Laplace Priors , 2010, IEEE Transactions on Image Processing.

[25]  Jeong‐Soo Park Optimal Latin-hypercube designs for computer experiments , 1994 .

[26]  Wei Chen,et al.  ROBUST CONCEPT EXPLORATION OF PROPULSION SYSTEMS WITH ENHANCED MODEL APPROXIMATION CAPABILITIES , 2000 .

[27]  T. J. Mitchell,et al.  Bayesian Prediction of Deterministic Functions, with Applications to the Design and Analysis of Computer Experiments , 1991 .

[28]  J. Friedman Multivariate adaptive regression splines , 1990 .

[29]  Farrokh Mistree,et al.  Kriging Models for Global Approximation in Simulation-Based Multidisciplinary Design Optimization , 2001 .

[30]  Hassan Hassan,et al.  Variable Turbulent Schmidt Number Formulation for Scramjet Applications , 2006 .

[31]  Kenny Q. Ye,et al.  Variable Selection for Gaussian Process Models in Computer Experiments , 2006, Technometrics.

[32]  H. Fang,et al.  Global response approximation with radial basis functions , 2006 .

[33]  T. Simpson,et al.  Use of Kriging Models to Approximate Deterministic Computer Models , 2005 .

[34]  Achille Messac,et al.  Extended Radial Basis Functions: More Flexible and Effective Metamodeling , 2004 .

[35]  Rachel T. Johnson,et al.  Design and analysis for the Gaussian process model , 2009, Qual. Reliab. Eng. Int..

[36]  Joseph L. Stout,et al.  Robust Piston Design and Optimization Using Piston Secondary Motion Analysis , 2003 .

[37]  T. Simpson,et al.  Computationally Inexpensive Metamodel Assessment Strategies , 2002 .

[38]  Henry P. Wynn,et al.  Screening, predicting, and computer experiments , 1992 .

[39]  Agus Sudjianto,et al.  Blind Kriging: A New Method for Developing Metamodels , 2008 .