Advances in the Design of Gaussian Processes as Surrogate Models for Computer Experiments

We present some advances in the design of computer experiments. A Gaussian Process (GP) model is fitted to the computer experiment data as a surrogate model. We investigate using the Active Learning (AL) strategy of finding design points that maximize reduction on predictive variance. Using a series of approximations based on standard results from linear algebra (Weyl’s inequalities) we establish a score that approximates the AL utility. Our method is illustrated with a simulated example as well as with an intermediate climate computer model. The second example requires the calibration of a model that depends on three parameters that summarize important climate properties. The calibration of the model is done using one observation derived from historical records and model runs on a grid of 426 different parameter combinations. We use our score to revisit this design and also explore the possibility of weighting the score to create more adequate designs in terms of the calibration problem at hand.

[1]  Chris E. Forest,et al.  Statistical calibration of climate system properties , 2009 .

[2]  David M. Steinberg,et al.  Comparison of designs for computer experiments , 2006 .

[3]  Colin Fox,et al.  A GENERAL PURPOSE SCALE-INDEPENDENT MCMC ALGORITHM , 2007 .

[4]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[5]  Thomas J. Santner,et al.  Sequential design of computer experiments to minimize integrated response functions , 2000 .

[6]  Andrei P. Sokolov,et al.  A flexible climate model for use in integrated assessments , 1998 .

[7]  Robert B. Gramacy,et al.  Ja n 20 08 Bayesian Treed Gaussian Process Models with an Application to Computer Modeling , 2009 .

[8]  Thomas W. Lucas,et al.  Efficient Nearly Orthogonal and Space-Filling Latin Hypercubes , 2007, Technometrics.

[9]  David Mease,et al.  Latin Hyperrectangle Sampling for Computer Experiments , 2006, Technometrics.

[10]  Runze Li,et al.  Uniform design for computer experiments and its optimal properties , 2006 .

[11]  Andrei P. Sokolov,et al.  Joint Program on the Science and Policy of Global Change Estimated PDFs of Climate System Properties Including Natural and Anthropogenic Forcings , 2005 .

[12]  William I. Notz,et al.  DESIGNING COMPUTER EXPERIMENTS TO DETERMINE ROBUST CONTROL VARIABLES , 2004 .

[13]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[14]  Dick den Hertog,et al.  Constrained Maximin Designs for Computer Experiments , 2003, Technometrics.

[15]  Robert B. Gramacy,et al.  Bayesian treed gaussian process models , 2005 .

[16]  David A. Cohn,et al.  Neural Network Exploration Using Optimal Experiment Design , 1993, NIPS.