Parameter Screening in Statistical Dynamic Computer Model Calibration Using Global Sensitivities

Computer, or simulation, models are ubiquitous in science and engineering. Two research topics in building computer models, generally treated separately, are sensitivity analysis and computer model calibration. In sensitivity analysis, one quantifies the effect of each input factor on outputs, whereas in calibration, one finds the values of input factors that provide the best match to a set of test data. In this article, we show a connection between these two seemingly separate concepts for problems with transient signals. We use global sensitivity analysis for computer models with transient signals to screen out inactive input factors, thus making the calibration algorithm numerically more stable. We show that the computer model does not vary with respect to parameters having zero total sensitivity indices, indicating that such parameters are impossible to calibrate and must be screened out. Because the computer model can be computationally intensive, we construct a fast statistical surrogate of the computer model which is used for both sensitivity analysis and computer model calibration. We illustrate our approach with both a simple example and an automotive application involving a road load data acquisition (RLDA) computer model.

[1]  Kendall E. Atkinson An introduction to numerical analysis , 1978 .

[2]  K. Mardia,et al.  Maximum likelihood estimation of models for residual covariance in spatial regression , 1984 .

[3]  M. J. Bayarri,et al.  Computer model validation with functional output , 2007, 0711.3271.

[4]  D. Higdon,et al.  Computer Model Calibration Using High-Dimensional Output , 2008 .

[5]  E. Demidenko,et al.  Mixed Models: Theory and Applications (Wiley Series in Probability and Statistics) , 2004 .

[6]  Runze Li,et al.  Design and Modeling for Computer Experiments , 2005 .

[7]  Dorin Drignei,et al.  Functional ANOVA in Computer Models With Time Series Output , 2010, Technometrics.

[8]  James O. Berger,et al.  A Framework for Validation of Computer Models , 2007, Technometrics.

[9]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice , 2002 .

[10]  M. Schervish Theory of Statistics , 1995 .

[11]  Stefan M. Wild,et al.  Bayesian Calibration and Uncertainty Analysis for Computationally Expensive Models Using Optimization and Radial Basis Function Approximation , 2008 .

[12]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models , 2004 .

[13]  Roger Woodard,et al.  Interpolation of Spatial Data: Some Theory for Kriging , 1999, Technometrics.

[14]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[15]  T. J. Mitchell,et al.  Bayesian design and analysis of computer experiments: Use of derivatives in surface prediction , 1993 .

[16]  B. Silverman,et al.  Functional Data Analysis , 1997 .

[17]  Dorin Drignei,et al.  A kriging approach to the analysis of climate model experiments , 2009 .

[18]  Dorin Drignei,et al.  PARAMETER ESTIMATION FOR COMPUTATIONALLY INTENSIVE NONLINEAR REGRESSION WITH AN APPLICATION TO CLIMATE MODELING , 2008, 0901.3665.