Design and analysis for the Gaussian process model

In an effort to speed the development of new products and processes, many companies are turning to computer simulations to avoid the time and expense of building prototypes. These computer simulations are often complex, taking hours to complete one run. If there are many variables affecting the results of the simulation, then it makes sense to design an experiment to gain the most information possible from a limited number of computer simulation runs. The researcher can use the results of these runs to build a surrogate model of the computer simulation model. The absence of noise is the key difference between computer simulation experiments and experiments in the real world. Since there is no variability in the results of computer experiments, optimal designs, which are based on reducing the variance of some statistic, have questionable utility. Replication, usually a "good thing", is clearly undesirable in computer experiments. Thus, a new approach to experimentation is necessary.

[1]  C. Currin,et al.  A Bayesian Approach to the Design and Analysis of Computer Experiments , 1988 .

[2]  Theodore T. Allen,et al.  Constructing Meta-Models for Computer Experiments , 2003 .

[3]  T. J. Mitchell,et al.  Bayesian Prediction of Deterministic Functions, with Applications to the Design and Analysis of Computer Experiments , 1991 .

[4]  N. Zheng,et al.  Global Optimization of Stochastic Black-Box Systems via Sequential Kriging Meta-Models , 2006, J. Glob. Optim..

[5]  Henry P. Wynn,et al.  Screening, predicting, and computer experiments , 1992 .

[6]  Dave Higdon,et al.  Combining Field Data and Computer Simulations for Calibration and Prediction , 2005, SIAM J. Sci. Comput..

[7]  Nielen Stander,et al.  Stochastic analysis of highly non‐linear structures , 2006 .

[8]  Thomas J. Santner,et al.  Sequential design of computer experiments to minimize integrated response functions , 2000 .

[9]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[10]  Henry P. Wynn,et al.  Maximum entropy sampling , 1987 .

[11]  Timothy G. Trucano,et al.  Statistical Validation of Engineering and Scientific Models: Background , 1999 .

[12]  Karen A. F. Copeland.  Experiments: Planning, Analysis, and Parameter Design Optimization , 2002 .

[13]  Katherine Campbell,et al.  Statistical calibration of computer simulations , 2006, Reliab. Eng. Syst. Saf..

[14]  George Michailidis,et al.  Sequential Experiment Design for Contour Estimation From Complex Computer Codes , 2008, Technometrics.

[15]  Runze Li,et al.  Analysis of Computer Experiments Using Penalized Likelihood in Gaussian Kriging Models , 2005, Technometrics.

[16]  D. Bingham,et al.  Computer Model Calibration or Tuning in Practice , 2006 .

[17]  R. Saigal,et al.  Handbook of semidefinite programming : theory, algorithms, and applications , 2000 .

[18]  Timothy G. Trucano,et al.  General Concepts for Experimental Validation of ASCI Code Applications , 2002 .

[19]  M. Liefvendahl,et al.  A study on algorithms for optimization of Latin hypercubes , 2006 .

[20]  Soma Roy,et al.  Sequential-Adaptive Design of Computer Experiments for the Estimation of Percentiles , 2008 .

[21]  Fred J. Hickernell,et al.  A generalized discrepancy and quadrature error bound , 1998, Math. Comput..

[22]  Jeong Soo Park.  Tuning complex computer codes to data and optimal designs , 1992 .

[23]  M. E. Johnson,et al.  Hurricane Loss Estimation Models: Opportunities for Improving the State of the Art , 2004 .

[24]  A. O'Hagan,et al.  Probabilistic sensitivity analysis of complex models: a Bayesian approach , 2004 .

[25]  Ronald L. Iman,et al.  Statistical Aspects of Forecasting and Planning for Hurricanes , 2006 .

[26]  TIMOTHY G. TRUCANO,et al.  Guidelines for Sandia ASCI Verification and Validation Plans - Content and Format: Version 1.0 , 1999 .

[27]  James O. Berger,et al.  A Framework for Validation of Computer Models , 2007, Technometrics.

[28]  S. Azarm,et al.  Bayesian Meta-Modeling of Engineering Design Simulations : A Sequential Approach with Adaptation to Irregularities in the Response Behavior , 2005 .

[29]  Sallie Keller-McNulty,et al.  Combining experimental data and computer simulations, with an application to flyer plate experiments , 2006 .

[30]  Nagui M. Rouphail,et al.  STATISTICALLY-BASED VALIDATION OF COMPUTER SIMULATION MODELS IN TRAFFIC OPERATIONS AND MANAGEMENT , 2002 .

[31]  Peter Z. G. Qian,et al.  Sliced space-filling designs , 2009 .

[32]  William I. Notz,et al.  Sequential adaptive designs in computer experiments for response surface model fit , 2008 .

[33]  Wolfgang Jank,et al.  Modelling concurrency of events in on‐line auctions via spatiotemporal semiparametric models , 2007 .

[34]  G. Matheron.  Principles of geostatistics , 1963 .

[35]  Sallie Keller-McNulty,et al.  Workshop on Statistical Approaches for the Evaluation of Complex Computer Models , 2002 .

[36]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[37]  Madhusudan K. Iyengar,et al.  Challenges of data center thermal management , 2005, IBM J. Res. Dev..

[38]  David Mease,et al.  Latin Hyperrectangle Sampling for Computer Experiments , 2006, Technometrics.

[39]  K Ang,et al.  A NOTE ON UNIFORM DISTRIBUTION AND EXPERIMENTAL DESIGN , 1981 .

[40]  Jon C. Helton,et al.  Multiple predictor smoothing methods for sensitivity analysis: Example results , 2008, Reliab. Eng. Syst. Saf..

[41]  M. E. Johnson,et al.  Minimax and maximin distance designs , 1990 .

[42]  David M. Steinberg,et al.  Comparison of designs for computer experiments , 2006 .

[43]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[44]  Maurice Queyranne,et al.  An Exact Algorithm for Maximum Entropy Sampling , 1995, Oper. Res..

[45]  C. Michael Bull,et al.  Identifying mechanistic models of spatial behaviour using pattern-based modelling: An example from lizard home ranges , 2007 .

[46]  Sanjay B. Joshi,et al.  Metamodeling: Radial basis functions, versus polynomials , 2002, Eur. J. Oper. Res..

[47]  William J. Welch,et al.  Screening the Input Variables to a Computer Model Via Analysis of Variance and Visualization , 2006 .

[48]  Russell R. Barton,et al.  A review on design, modeling and applications of computer experiments , 2006 .

[49]  Hassan Hassan,et al.  Variable Turbulent Schmidt Number Formulation for Scramjet Applications , 2006 .

[50]  Michael Goldstein,et al.  Bayesian Forecasting for Complex Systems Using Computer Simulators , 2001 .

[51]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[52]  Peter Z. G. Qian,et al.  Gaussian Process Models for Computer Experiments With Qualitative and Quantitative Factors , 2008, Technometrics.

[53]  Charles C. Watson,et al.  Fitting Statistical Distributions to Data in Hurricane Modeling , 2007 .

[54]  Ruichen Jin,et al.  On Sequential Sampling for Global Metamodeling in Engineering Design , 2002, DAC 2002.

[55]  William I. Notz,et al.  Designing computer experiments to estimate integrated response functions , 2005 .