Understanding and comparisons of different sampling approaches for the Fourier Amplitudes Sensitivity Test (FAST)

Fourier Amplitude Sensitivity Test (FAST) is one of the most popular uncertainty and sensitivity analysis techniques. It uses a periodic sampling approach and a Fourier transformation to decompose the variance of a model output into partial variances contributed by different model parameters. Until now, the FAST analysis is mainly confined to the estimation of partial variances contributed by the main effects of model parameters, but does not allow for those contributed by specific interactions among parameters. In this paper, we theoretically show that FAST analysis can be used to estimate partial variances contributed by both main effects and interaction effects of model parameters using different sampling approaches (i.e., traditional search-curve based sampling, simple random sampling and random balance design sampling). We also analytically calculate the potential errors and biases in the estimation of partial variances. Hypothesis tests are constructed to reduce the effect of sampling errors on the estimation of partial variances. Our results show that compared to simple random sampling and random balance design sampling, sensitivity indices (ratios of partial variances to variance of a specific model output) estimated by search-curve based sampling generally have higher precision but larger underestimations. Compared to simple random sampling, random balance design sampling generally provides higher estimation precision for partial variances contributed by the main effects of parameters. The theoretical derivation of partial variances contributed by higher-order interactions and the calculation of their corresponding estimation errors in different sampling schemes can help us better understand the FAST method and provide a fundamental basis for FAST applications and further improvements.

[1]  J. Seinfeld,et al.  Automatic sensitivity analysis of kinetic mechanisms , 1979 .

[2]  George Z. Gertner,et al.  Extending a global sensitivity analysis technique to models with correlated parameters , 2007, Comput. Stat. Data Anal..

[3]  Moon-Hyun Chun,et al.  An uncertainty importance measure using a distance metric for the change in a cumulative distribution function , 2000, Reliab. Eng. Syst. Saf..

[4]  Ilya M. Sobol,et al.  Sensitivity Estimates for Nonlinear Mathematical Models , 1993 .

[5]  Emanuele Borgonovo,et al.  Comparison of global sensitivity analysis techniques and importance measures in PSA , 2003, Reliab. Eng. Syst. Saf..

[6]  E. Borgonovo.  Measuring Uncertainty Importance: Investigation and Comparison of Alternative Approaches , 2006, Risk analysis : an official publication of the Society for Risk Analysis.

[7]  I. Sobola,et al.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[8]  K. Shuler,et al.  Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. III. Analysis of the approximations , 1975 .

[9]  Jon C. Helton,et al.  Survey of sampling-based methods for uncertainty and sensitivity analysis , 2006, Reliab. Eng. Syst. Saf..

[10]  Andrea Saltelli,et al.  Sensitivity analysis of model output. Performance of the iterated fractional factorial design method , 1995 .

[11]  Stefano Tarantola,et al.  Random balance designs for the estimation of first order global sensitivity indices , 2006, Reliab. Eng. Syst. Saf..

[12]  K. Shuler,et al.  Nonlinear sensitivity analysis of multiparameter model systems , 1977 .

[13]  B. Bowerman.  Statistical Design and Analysis of Experiments, with Applications to Engineering and Science , 1989 .

[14]  Alan B. Anderson,et al.  Spatial uncertainty in prediction of the topographical factor for the revised universal soil loss equation (RUSLE) , 2002 .

[15]  George Z. Gertner,et al.  A general first-order global sensitivity analysis method , 2008, Reliab. Eng. Syst. Saf..

[16]  K. Shuler,et al.  Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. II Applications , 1973 .

[17]  Roni Avissar,et al.  Comparison of three land‐surface schemes with the Fourier amplitude sensitivity test (FAST) , 1998 .

[18]  F. J. Davis,et al.  Illustration of Sampling‐Based Methods for Uncertainty and Sensitivity Analysis , 2002, Risk analysis : an official publication of the Society for Risk Analysis.

[19]  Francisco Javier Elorza,et al.  Sensitivity analysis of distributed environmental simulation models: understanding the model behaviour in hydrological studies at the catchment scale , 2003, Reliab. Eng. Syst. Saf..

[20]  John H. Seinfeld,et al.  Global sensitivity analysis—a computational implementation of the Fourier Amplitude Sensitivity Test (FAST) , 1982 .

[21]  Kwang-Il Ahn,et al.  A new approach for measuring uncertainty importance and distributional sensitivity in probabilistic safety assessment , 1994 .

[22]  Jon C. Helton,et al.  A comparison of uncertainty and sensitivity analysis results obtained with random and Latin hypercube sampling , 2005, Reliab. Eng. Syst. Saf..

[23]  A. Saltelli,et al.  On the Relative Importance of Input Factors in Mathematical Models , 2002 .

[24]  Emanuele Borgonovo,et al.  A new uncertainty importance measure , 2007, Reliab. Eng. Syst. Saf..

[25]  P. Verheijen,et al.  Local and Global Sensitivity Analysis for a Reactor Design with Parameter Uncertainty , 2004 .

[26]  Jon C. Helton,et al.  Uncertainty and sensitivity analysis techniques for use in performance assessment for radioactive waste disposal , 1993 .

[27]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[28]  Sitakanta Mohanty,et al.  Sensitivity analysis of a complex, proposed geologic waste disposal system using the Fourier Amplitude Sensitivity Test method , 2001, Reliab. Eng. Syst. Saf..

[29]  C. Fortuin,et al.  Study of the sensitivity of coupled reaction systems to uncertainties in rate coefficients. I Theory , 1973 .

[30]  A. Saltelli,et al.  A quantitative model-independent method for global sensitivity analysis of model output , 1999 .

[31]  Chonggang Xu,et al.  Uncertainty analysis of transient population dynamics , 2009 .

[32]  S. A. Cryer,et al.  Regional sensitivity analysis using a fractional factorial method for the USDA model GLEAMS , 1999, Environ. Model. Softw..

[33]  Michael D. McKay,et al.  Nonparametric variance-based methods of assessing uncertainty importance , 1997 .

[34]  Terry Andres,et al.  Sensitivity analysis of model output: an investigation of new techniques , 1993 .

[35]  Paola Annoni,et al.  Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index , 2010, Comput. Phys. Commun..

[36]  Douglas M. Hawkins,et al.  Plackett–Burman technique for sensitivity analysis of many-parametered models , 2001 .

[37]  Chonggang Xu,et al.  Uncertainties in the response of a forest landscape to global climatic change , 2009 .

[38]  S. Tarantola,et al.  Moment independent and variance‐based sensitivity analysis with correlations: An application to the stability of a chemical reactor , 2008 .

[39]  Stefano Tarantola,et al.  Uncertainty and global sensitivity analysis of road transport emission estimates , 2004 .

[40]  Roni Avissar,et al.  An Evaluation with the Fourier Amplitude Sensitivity Test (FAST) of Which Land-Surface Parameters Are of Greatest Importance in Atmospheric Modeling , 1994 .

[41]  A. Saltelli,et al.  Sensitivity analysis for chemical models. , 2005, Chemical reviews.

[42]  Andrea Saltelli,et al.  Screening important inputs in models with strong interaction properties , 2009, Reliab. Eng. Syst. Saf..

[43]  Brian Henderson-Sellers,et al.  Sensitivity evaluation of environmental models using fractional factorial experimentation , 1996 .