A multi-method Generalized Global Sensitivity Matrix approach to accounting for the dynamical nature of earth and environmental systems models

Abstract Many applications of global sensitivity analysis (GSA) do not adequately account for the dynamical nature of earth and environmental systems models. Gupta and Razavi (2018) highlight this fact and develop a sensitivity analysis framework from first principles, based on the sensitivity information contained in trajectories of partial derivatives of the dynamical model responses with respect to controlling factors. Here, we extend and generalize that framework to accommodate any GSA philosophy, including derivative-based approaches (such as Morris and DELSA), direct-response-based approaches (such as the variance-based Sobol’, distribution-based PAWN, and higher-moment-based methods), and unifying variogram-based approaches (such as VARS). The framework is implemented within the VARS-TOOL software toolbox and demonstrated using the HBV-SASK model applied to the Oldman Watershed, Canada. This enables a comprehensive multi-variate investigation of the influence of parameters and forcings on different modeled state variables and responses, without the need for observational data regarding those responses.

[1]  Nong Shang,et al.  Parameter uncertainty and interaction in complex environmental models , 1994 .

[2]  S. Uhlenbrook,et al.  Sensitivity analyses of a distributed catchment model to verify the model structure , 2005 .

[3]  Matieyendou Lamboni,et al.  Multivariate global sensitivity analysis for dynamic crop models , 2009 .

[4]  Saman Razavi,et al.  Progressive Latin Hypercube Sampling: An efficient approach for robust sampling-based analysis of environmental models , 2017, Environ. Model. Softw..

[5]  Brian J. Williams,et al.  Sensitivity analysis when model outputs are functions , 2006, Reliab. Eng. Syst. Saf..

[6]  Francesca Pianosi,et al.  Understanding the time‐varying importance of different uncertainty sources in hydrological modelling using global sensitivity analysis , 2016 .

[7]  Jack P. C. Kleijnen,et al.  Sensitivity analysis and optimization of system dynamics models: Regression analysis and statistical design of experiments , 1995 .

[8]  Bertrand Iooss,et al.  Global sensitivity analysis for models with spatially dependent outputs , 2009, 0911.1189.

[9]  D. Hamby.  A review of techniques for parameter sensitivity analysis of environmental models , 1994, Environmental monitoring and assessment.

[10]  I. Sobola,et al.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[11]  Saman Razavi,et al.  Multicriteria sensitivity analysis as a diagnostic tool for understanding model behaviour and characterizing model uncertainty , 2017 .

[12]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[13]  Soroosh Sorooshian,et al.  Toward improved calibration of hydrologic models: Combining the strengths of manual and automatic methods , 2000 .

[14]  Hoshin Vijai Gupta,et al.  A process‐based diagnostic approach to model evaluation: Application to the NWS distributed hydrologic model , 2008 .

[15]  Joseph H. A. Guillaume,et al.  Characterising performance of environmental models , 2013, Environ. Model. Softw..

[16]  P. Bates,et al.  Quantifying the importance of spatial resolution and other factors through global sensitivity analysis of a flood inundation model , 2016 .

[17]  N. Fohrer,et al.  How to improve the representation of hydrological processes in SWAT for a lowland catchment – temporal analysis of parameter sensitivity and model performance , 2014 .

[18]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[19]  Mike Rees,et al.  5. Statistics for Spatial Data , 1993 .

[20]  Francesca Pianosi,et al.  A simple and efficient method for global sensitivity analysis based on cumulative distribution functions , 2015, Environ. Model. Softw..

[21]  Emanuele Borgonovo,et al.  Making the most out of a hydrological model data set: Sensitivity analyses to open the model black‐box , 2017 .

[22]  Mary C. Hill,et al.  Distributed Evaluation of Local Sensitivity Analysis (DELSA), with application to hydrologic models , 2014 .

[23]  Saman Razavi,et al.  Insights into sensitivity analysis of Earth and environmental systems models: On the impact of parameter perturbation scale , 2017, Environ. Model. Softw..

[24]  W. James Shuttleworth,et al.  Towards a comprehensive approach to parameter estimation in land surface parameterization schemes , 2013 .

[25]  Sergei S. Kucherenko,et al.  Derivative based global sensitivity measures and their link with global sensitivity indices , 2009, Math. Comput. Simul..

[26]  P. Reed,et al.  Rainfall characteristics define the value of streamflow observations for distributed watershed model identification , 2008 .

[27]  Saman Razavi,et al.  Revisiting the Basis of Sensitivity Analysis for Dynamical Earth System Models , 2018, Water Resources Research.

[28]  H. Gupta,et al.  A new framework for comprehensive, robust, and efficient global sensitivity analysis: 1. Theory , 2016 .

[29]  Yuqiong Liu,et al.  Reconciling theory with observations: elements of a diagnostic approach to model evaluation , 2008 .

[30]  Philippe Gourbesville,et al.  Spatial Global Sensitivity Analysis of High Resolution classified topographic data use in 2D urban flood modelling , 2016, Environ. Model. Softw..

[31]  Saman Razavi,et al.  What do we mean by sensitivity analysis? The need for comprehensive characterization of “global” sensitivity in Earth and Environmental systems models , 2015 .

[32]  Kwang-Il Ahn,et al.  A new approach for measuring uncertainty importance and distributional sensitivity in probabilistic safety assessment , 1994 .

[33]  W. James Shuttleworth,et al.  A fully multiple-criteria implementation of the Sobol' method for parameter sensitivity analysis , 2012 .

[34]  David Makowski,et al.  Multivariate sensitivity analysis to measure global contribution of input factors in dynamic models , 2011, Reliab. Eng. Syst. Saf..

[35]  H. Gupta,et al.  A new framework for comprehensive, robust, and efficient global sensitivity analysis: 2. Application , 2016 .

[36]  R. Srinivasan,et al.  A global sensitivity analysis tool for the parameters of multi-variable catchment models , 2006 .

[37]  Indrajeet Chaubey,et al.  Sensitivity and identifiability of stream flow generation parameters of the SWAT model , 2010 .

[38]  Saman Razavi,et al.  Enhanced identification of a hydrologic model using streamflow and satellite water storage data: A multicriteria sensitivity analysis and optimization approach , 2017 .

[39]  Andrea Saltelli,et al.  An effective screening design for sensitivity analysis of large models , 2007, Environ. Model. Softw..

[40]  Saman Razavi,et al.  Global sensitivity analysis for high-dimensional problems: How to objectively group factors and measure robustness and convergence while reducing computational cost , 2019, Environ. Model. Softw..

[41]  Patrick M. Reed,et al.  From maps to movies: High-resolution time-varying sensitivity analysis for spatially distributed watershed models , 2013 .

[42]  Alberto Guadagnini,et al.  Moment-based metrics for global sensitivity analysis of hydrological systems , 2017 .

[43]  Erwin Zehe,et al.  Temporal dynamics of model parameter sensitivity for computationally expensive models with the Fourier amplitude sensitivity test , 2011 .