Variance-based sensitivity analysis of model outputs using surrogate models

If a computer model is run many times with different inputs, the results obtained can often be used to derive a computationally cheaper approximation, or surrogate model, of the original computer code. Thereafter, the surrogate model can be employed to reduce the computational cost of a variance-based sensitivity analysis (VBSA) of the model output. Here, we draw attention to a procedure in which an adaptive sequential design is employed to derive surrogate models and estimate sensitivity indices for different sub-groups of inputs. The results of such group-wise VBSAs are then used to select inputs for a final VBSA. Our procedure is particularly useful when there is little prior knowledge about the response surface and the aim is to explore both the global variability and local nonlinear features of the model output. Our conclusions are based on computer experiments involving the process-based river basin model INCA-N, in which outputs like the average annual riverine load of nitrogen can be regarded as functions of 19 model parameters.

[1]  Bruno Sudret,et al.  Global sensitivity analysis using polynomial chaos expansions , 2008, Reliab. Eng. Syst. Saf..

[2]  H. Rabitz,et al.  Practical Approaches To Construct RS-HDMR Component Functions , 2002 .

[3]  D. Shahsavani,et al.  An adaptive design and interpolation technique for extracting highly nonlinear response surfaces from deterministic models , 2009, Reliab. Eng. Syst. Saf..

[4]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[5]  H. Rabitz,et al.  Random sampling-high dimensional model representation (RS-HDMR) and orthogonality of its different order component functions. , 2006, The journal of physical chemistry. A.

[6]  Andrea Saltelli,et al.  Use of Sobol's Quasirandom Sequence Generator for Integration of Modified Uncertainty Importance Measure , 1995 .

[7]  B. Silverman,et al.  Nonparametric regression and generalized linear models , 1994 .

[8]  E. J. Wilson,et al.  A semi-distributed integrated flow and nitrogen model for multiple source assessment in catchments (INCA): Part II — application to large river basins in south Wales and eastern England , 1998 .

[9]  Karen A. F. Copeland Experiments: Planning, Analysis, and Parameter Design Optimization , 2002 .

[10]  Jon C. Helton,et al.  Multiple predictor smoothing methods for sensitivity analysis: Example results , 2008, Reliab. Eng. Syst. Saf..

[11]  A. O'Hagan,et al.  Probabilistic sensitivity analysis of complex models: a Bayesian approach , 2004 .

[12]  Daniel Busby,et al.  Hierarchical adaptive experimental design for Gaussian process emulators , 2009, Reliab. Eng. Syst. Saf..

[13]  A. Saltelli,et al.  Making best use of model evaluations to compute sensitivity indices , 2002 .

[14]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice , 2002 .

[15]  Stefano Tarantola,et al.  Evaluation of MARS modeling technique for sensitivity analysis of model output , 2010 .

[16]  Véronique Beaujouan,et al.  A nitrogen model for European catchments: INCA, new model structure and equations , 2002 .

[17]  Jon C. Helton,et al.  Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models , 2009, Reliab. Eng. Syst. Saf..

[18]  E. J. Wilson,et al.  A semi-distributed ntegrated itrogen model for multiple source assessment in tchments (INCA): Part I — model structure and process equations , 1998 .

[19]  I. M. Soboĺ Quasi-Monte Carlo methods , 1990 .