Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index

Abstract Variance based methods have assessed themselves as versatile and effective among the various available techniques for sensitivity analysis of model output. Practitioners can in principle describe the sensitivity pattern of a model Y = f ( X 1 , X 2 , … , X k ) with k uncertain input factors via a full decomposition of the variance V of Y into terms depending on the factors and their interactions. More often practitioners are satisfied with computing just k first order effects and k total effects, the latter describing synthetically interactions among input factors. In sensitivity analysis a key concern is the computational cost of the analysis, defined in terms of number of evaluations of f ( X 1 , X 2 , … , X k ) needed to complete the analysis, as f ( X 1 , X 2 , … , X k ) is often in the form of a numerical model which may take long processing time. While the computational cost is relatively cheap and weakly dependent on k for estimating first order effects, it remains expensive and strictly k-dependent for total effect indices. In the present note we compare existing and new practices for this index and offer recommendations on which to use.

[1]  Fabrice Gamboa,et al.  Local Polynomial Estimation for Sensitivity Analysis on Models With Correlated Inputs , 2008, Technometrics.

[2]  Harald Niederreiter,et al.  Implementation and tests of low-discrepancy sequences , 1992, TOMC.

[3]  Stefano Tarantola,et al.  Winding Stairs: A sampling tool to compute sensitivity indices , 2000, Stat. Comput..

[4]  B. Iooss,et al.  Global sensitivity analysis for a numerical model of radionuclide migration from the RRC “Kurchatov Institute” radwaste disposal site , 2008 .

[5]  Stefano Tarantola,et al.  Random balance designs for the estimation of first order global sensitivity indices , 2006, Reliab. Eng. Syst. Saf..

[6]  Franklin A. Graybill,et al.  Introduction to the Theory of Statistics, 3rd ed. , 1974 .

[7]  Jon C. Helton,et al.  Survey of sampling-based methods for uncertainty and sensitivity analysis , 2006, Reliab. Eng. Syst. Saf..

[8]  Shuangzhe Liu,et al.  Global Sensitivity Analysis: The Primer by Andrea Saltelli, Marco Ratto, Terry Andres, Francesca Campolongo, Jessica Cariboni, Debora Gatelli, Michaela Saisana, Stefano Tarantola , 2008 .

[9]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[10]  Johan Grasman,et al.  Predictability and Nonlinear Modelling in Natural Sciences and Economics , 2012 .

[11]  Andrea Saltelli,et al.  An effective screening design for sensitivity analysis of large models , 2007, Environ. Model. Softw..

[12]  Abdelali Gabih,et al.  An ε-Optimal Portfolio with Stochastic Volatility , 2005, Monte Carlo Methods Appl..

[13]  B. Efron,et al.  The Jackknife Estimate of Variance , 1981 .

[14]  Xiaobo Zhou,et al.  Global Sensitivity Analysis , 2017, Encyclopedia of GIS.

[15]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[16]  Constantinos C. Pantelides,et al.  Monte Carlo evaluation of derivative-based global sensitivity measures , 2009, Reliab. Eng. Syst. Saf..

[17]  Stefano Tarantola,et al.  A Quantitative Model-Independent Method for Global Sensitivity Analysis of Model Output , 1999, Technometrics.

[18]  I. Sobola,et al.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[19]  M. Jansen,et al.  Monte Carlo estimation of uncertainty contributions from several independent multivariate sources. , 1994 .

[20]  M. Jansen Analysis of variance designs for model output , 1999 .

[21]  I. Sobol Uniformly distributed sequences with an additional uniform property , 1976 .

[22]  A. Saltelli,et al.  Making best use of model evaluations to compute sensitivity indices , 2002 .

[23]  A. O'Hagan,et al.  Probabilistic sensitivity analysis of complex models: a Bayesian approach , 2004 .

[24]  A. Saltelli,et al.  Sensitivity analysis for chemical models. , 2005, Chemical reviews.

[25]  A. Saltelli,et al.  Importance measures in global sensitivity analysis of nonlinear models , 1996 .

[26]  Sergei S. Kucherenko,et al.  On global sensitivity analysis of quasi-Monte Carlo algorithms , 2005, Monte Carlo Methods Appl..

[27]  I. Sobol Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[28]  George Z. Gertner,et al.  A general first-order global sensitivity analysis method , 2008, Reliab. Eng. Syst. Saf..

[29]  Richard Southwell The Imperial College , 1949 .

[30]  Stefano Tarantola,et al.  Estimating the approximation error when fixing unessential factors in global sensitivity analysis , 2007, Reliab. Eng. Syst. Saf..

[31]  H. Rabitz,et al.  Efficient input-output model representations , 1999 .

[32]  Jon C. Helton,et al.  Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models , 2009, Reliab. Eng. Syst. Saf..

[33]  J. Wolfowitz,et al.  An Introduction to the Theory of Statistics , 1951, Nature.

[34]  Julien Jacques,et al.  Sensitivity analysis in presence of model uncertainty and correlated inputs , 2006, Reliab. Eng. Syst. Saf..

[35]  Andrea Saltelli,et al.  Screening important inputs in models with strong interaction properties , 2009, Reliab. Eng. Syst. Saf..

[36]  Stefano Tarantola,et al.  Sensitivity Analysis as an Ingredient of Modeling , 2000 .

[37]  C. Fortuin,et al.  Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. I Theory , 1973 .

[38]  Peter C. Young,et al.  State Dependent Parameter metamodelling and sensitivity analysis , 2007, Comput. Phys. Commun..

[39]  A. Saltelli,et al.  A quantitative model-independent method for global sensitivity analysis of model output , 1999 .

[40]  Ilya M. Sobol,et al.  Sensitivity Estimates for Nonlinear Mathematical Models , 1993 .

[41]  I. Sobol,et al.  Sensitivity Measures, ANOVA-like Techniques and the Use of Bootstrap , 1997 .

[42]  Jon C. Helton,et al.  Multiple predictor smoothing methods for sensitivity analysis: Description of techniques , 2008, Reliab. Eng. Syst. Saf..

[43]  I. Sobol On the distribution of points in a cube and the approximate evaluation of integrals , 1967 .

[44]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[45]  L FoxBennett,et al.  Implementation and tests of low-discrepancy sequences , 1992 .

[46]  Harvey M. Wagner,et al.  Global Sensitivity Analysis , 1995, Oper. Res..

[47]  A. Saltelli,et al.  Sensitivity Anaysis as an Ingredient of Modeling , 2000 .

[48]  I. Sobol,et al.  About the use of rank transformation in sensitivity analysis of model output , 1995 .

[49]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[50]  Paul Bratley,et al.  Algorithm 659: Implementing Sobol's quasirandom sequence generator , 1988, TOMS.

[51]  A. Saltelli,et al.  On the Relative Importance of Input Factors in Mathematical Models , 2002 .