A simple and efficient method for global sensitivity analysis based on cumulative distribution functions

Variance-based approaches are widely used for Global Sensitivity Analysis (GSA) of environmental models. However, methods that consider the entire Probability Density Function (PDF) of the model output, rather than its variance only, are preferable in cases where variance is not an adequate proxy of uncertainty, e.g. when the output distribution is highly-skewed or when it is multi-modal. Still, the adoption of density-based methods has been limited so far, possibly because they are relatively more difficult to implement. Here we present a novel GSA method, called PAWN, to efficiently compute density-based sensitivity indices. The key idea is to characterise output distributions by their Cumulative Distribution Functions (CDF), which are easier to derive than PDFs. We discuss and demonstrate the advantages of PAWN through applications to numerical and environmental modelling examples. We expect PAWN to increase the application of density-based approaches and to be a complementary approach to variance-based GSA. We present a new density-based GSA method called PAWN to complement variance-based GSA.Differently from variance-based methods, PAWN can be applied to highly-skewed or multi-modal output distributions.Differently from other density-based methods, PAWN uses output CDFs, which simplifies numerical implementation.PAWN can be easily tailored to focus on output sub-ranges, for instance extreme values.Intermediate results generated in the application of PAWN can be visualized to gather insights about the model behaviour.

[1]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[2]  Emanuele Borgonovo,et al.  Sampling strategies in density-based sensitivity analysis , 2012, Environ. Model. Softw..

[3]  Florian Pappenberger,et al.  Multi-method global sensitivity analysis of flood inundation models. , 2008 .

[4]  Cosimo Solidoro,et al.  Global sensitivity analysis of a shallow-water 3D eutrophication model , 1999 .

[5]  R. Moore The probability-distributed principle and runoff production at point and basin scales , 1985 .

[6]  Emanuele Borgonovo,et al.  A new uncertainty importance measure , 2007, Reliab. Eng. Syst. Saf..

[7]  Shuangzhe Liu,et al.  Global Sensitivity Analysis: The Primer by Andrea Saltelli, Marco Ratto, Terry Andres, Francesca Campolongo, Jessica Cariboni, Debora Gatelli, Michaela Saisana, Stefano Tarantola , 2008 .

[8]  S. Sorooshian,et al.  Evaluation of Maximum Likelihood Parameter estimation techniques for conceptual rainfall‐runoff models: Influence of calibration data variability and length on model credibility , 1983 .

[9]  D. Boyle Multicriteria Calibration of Hydrologic Models , 2013 .

[10]  Kwang-Il Ahn,et al.  A new approach for measuring uncertainty importance and distributional sensitivity in probabilistic safety assessment , 1994 .

[11]  Agus Sudjianto,et al.  Relative Entropy Based Method for Probabilistic Sensitivity Analysis in Engineering Design , 2006 .

[12]  Andrea Saltelli,et al.  Sensitivity Analysis for Importance Assessment , 2002, Risk analysis : an official publication of the Society for Risk Analysis.

[13]  S. Hora,et al.  A Robust Measure of Uncertainty Importance for Use in Fault Tree System Analysis , 1990 .

[14]  Emanuele Borgonovo,et al.  Uncertainty in Climate Change Modeling: Can Global Sensitivity Analysis Be of Help? , 2014, Risk analysis : an official publication of the Society for Risk Analysis.

[15]  Soroosh Sorooshian,et al.  A framework for development and application of hydrological models , 2001, Hydrology and Earth System Sciences.

[16]  P. Reed,et al.  Hydrology and Earth System Sciences Discussions Comparing Sensitivity Analysis Methods to Advance Lumped Watershed Model Identification and Evaluation , 2022 .

[17]  AN Kolmogorov-Smirnov,et al.  Sulla determinazione empírica di uma legge di distribuzione , 1933 .

[18]  Willy Bauwens,et al.  Sobol' sensitivity analysis of a complex environmental model , 2011, Environ. Model. Softw..

[19]  R. Spear Eutrophication in peel inlet—II. Identification of critical uncertainties via generalized sensitivity analysis , 1980 .

[20]  Qiao Liu,et al.  A new computational method of a moment-independent uncertainty importance measure , 2009, Reliab. Eng. Syst. Saf..

[21]  S. Tarantola,et al.  Reduced‐complexity modeling of braided rivers: Assessing model performance by sensitivity analysis, calibration, and validation , 2013 .

[22]  Terry Andres Sampling methods and sensitivity analysis for large parameter sets , 1997 .

[23]  Paola Annoni,et al.  Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index , 2010, Comput. Phys. Commun..

[24]  Stefano Tarantola,et al.  A General Probabilistic Framework for uncertainty and global sensitivity analysis of deterministic models: A hydrological case study , 2014, Environ. Model. Softw..

[25]  Jasper V. Wall,et al.  Practical Statistics for Astronomers , 2003 .

[26]  P. Reed,et al.  Rainfall characteristics define the value of streamflow observations for distributed watershed model identification , 2008 .

[27]  Emanuele Borgonovo,et al.  Global sensitivity measures from given data , 2013, Eur. J. Oper. Res..

[28]  S. Tarantola,et al.  Moment Independent Importance Measures: New Results and Analytical Test Cases , 2011, Risk analysis : an official publication of the Society for Risk Analysis.

[29]  Susan Cuddy,et al.  Robust global sensitivity analysis of a river management model to assess nonlinear and interaction effects , 2014 .

[30]  A. Saltelli,et al.  Making best use of model evaluations to compute sensitivity indices , 2002 .