Computational Improvements to Estimating Kriging Metamodel Parameters

The details of a method to reduce the computational burden experienced while estimating the optimal model parameters for a Kriging model are presented. A Kriging model is a type of surrogate model that can be used to create a response surface based a set of observations of a computationally expensive system design analysis. This Kriging model can then be used as a computationally efficient surrogate to the original model, providing the opportunity for the rapid exploration of the resulting tradespace. The Kriging model can provide a more complex response surface than the more traditional linear regression response surface through the introduction of a few terms to quantify the spatial correlation of the observations. Implementation details and enhancements to gradient-based methods to estimate the model parameters are presented. It concludes with a comparison of these enhancements to using maximum likelihood estimation to estimate Kriging model parameters and their potential reduction in computational burden. These enhancements include the development of the analytic gradient and Hessian for the log-likelihood equation of a Kriging model that uses a Gaussian spatial correlation function. The suggested algorithm is similar to the SCORING algorithm traditionally used in statistics.

[1]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[2]  P. Kitanidis.  Parameter Uncertainty in Estimation of Spatial Functions: Bayesian Analysis , 1986 .

[3]  Timothy C. Coburn,et al.  Geostatistics for Natural Resources Evaluation , 2000, Technometrics.

[4]  Kanti V. Mardia,et al.  On multimodality of the likelihood in the spatial linear model , 1989 .

[5]  Jerome Sacks,et al.  Designs for Computer Experiments , 1989 .

[6]  T. Simpson,et al.  Use of Kriging Models to Approximate Deterministic Computer Models , 2005 .

[7]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[8]  A. Sudjianto,et al.  An Efficient Algorithm for Constructing Optimal Design of Computer Experiments , 2005, DAC 2003.

[9]  Søren Nymand Lophaven,et al.  DACE - A Matlab Kriging Toolbox, Version 2.0 , 2002 .

[10]  H. White.  Maximum Likelihood Estimation of Misspecified Models , 1982 .

[11]  Henry P. Wynn,et al.  Screening, predicting, and computer experiments , 1992 .

[12]  Jay D. Martin,et al.  A Methodology to Manage System-level Uncertainty During Conceptual Design , 2006 .

[13]  T. J. Mitchell,et al.  Bayesian Prediction of Deterministic Functions, with Applications to the Design and Analysis of Computer Experiments , 1991 .

[14]  H. Hartley,et al.  Computing Maximum Likelihood Estimates for the Mixed A.O.V. Model Using the W Transformation , 1973 .

[15]  Wei Chen,et al.  Analytical Variance-Based Global Sensitivity Analysis in Simulation-Based Design Under Uncertainty , 2005 .

[16]  A. J. Booker,et al.  A rigorous framework for optimization of expensive functions by surrogates , 1998 .

[17]  Cristina H. Amon,et al.  Bayesian Surrogates Applied to Conceptual Stages of the Engineering Design Process , 2003 .

[18]  Carolyn Conner Seepersad,et al.  Building Surrogate Models Based on Detailed and Approximate , 2004, DAC 2004.

[19]  Jay D. Martin,et al.  USE OF ADAPTIVE METAMODELING FOR DESIGN OPTIMIZATION , 2002 .

[20]  T. Simpson,et al.  A Monte Carlo Simulation of the Kriging Model , 2004 .

[21]  Timothy W. Simpson,et al.  Metamodels for Computer-based Engineering Design: Survey and recommendations , 2001, Engineering with Computers.

[22]  G. Gary Wang,et al.  Review of Metamodeling Techniques in Support of Engineering Design Optimization , 2007 .

[23]  Ren-Jye Yang,et al.  Metamodeling development for vehicle frontal impact simulation , 2001, DAC 2001.

[24]  Ruichen Jin,et al.  On Sequential Sampling for Global Metamodeling in Engineering Design , 2002, DAC 2002.

[25]  Farrokh Mistree,et al.  Kriging Models for Global Approximation in Simulation-Based Multidisciplinary Design Optimization , 2001 .

[26]  Robert I. Jennrich,et al.  Newton-Raphson and Related Algorithms for Maximum Likelihood Variance Component Estimation , 1976 .

[27]  Agus Sudjianto,et al.  Blind Kriging: A New Method for Developing Metamodels , 2008 .

[28]  B. Efron,et al.  Assessing the accuracy of the maximum likelihood estimator: Observed versus expected Fisher information , 1978 .

[29]  Jay D. Martin,et al.  A Methodology to Manage Uncertainty During System-Level Conceptual Design , 2005, DAC 2005.

[30]  Cristina H. Amon,et al.  An engineering design methodology with multistage Bayesian surrogates and optimal sampling , 1996 .

[31]  Brian D. Ripley,et al.  Problems with likelihood estimation of covariance functions of spatial Gaussian processes , 1987 .

[32]  Matthew B. Parkinson,et al.  Improving an Ergonomics Testing Procedure via Approximation- based Adaptive Experimental Design , 2005 .

[33]  K. Mardia,et al.  Maximum likelihood estimation of models for residual covariance in spatial regression , 1984 .