Understanding the time‐varying importance of different uncertainty sources in hydrological modelling using global sensitivity analysis

Simulations from hydrological models are affected by potentially large uncertainties stemming from various sources, including model parameters and observational uncertainty in the input/output data. Understanding the relative importance of such sources of uncertainty is essential to support model calibration, validation and diagnostic evaluation and to prioritize efforts for uncertainty reduction. It can also support the identification of ‘disinformative data’ whose values are the consequence of measurement errors or inadequate observations. Sensitivity analysis (SA) provides the theoretical framework and the numerical tools to quantify the relative contribution of different sources of uncertainty to the variability of the model outputs. In traditional applications of global SA (GSA), model outputs are aggregations of the full set of a simulated variable. For example, many GSA applications use a performance metric (e.g. the root mean squared error) as model output that aggregates the distances of a simulated time series to available observations. This aggregation of propagated uncertainties prior to GSA may lead to a significant loss of information and may cover up local behaviour that could be of great interest. Time-varying sensitivity analysis (TVSA), where the aggregation and SA are repeated at different time steps, is a viable option to reduce this loss of information. In this work, we use TVSA to address two questions: (1) Can we distinguish between the relative importance of parameter uncertainty versus data uncertainty in time? (2) Do these influences change in catchments with different characteristics? To our knowledge, the results present one of the first quantitative investigations on the relative importance of parameter and data uncertainty across time. We find that the approach is capable of separating influential periods across data and parameter uncertainties, while also highlighting significant differences between the catchments analysed. Copyright © 2016 The Authors. Hydrological Processes. Published by John Wiley & Sons Ltd.

[1]  J. Freer,et al.  Benchmarking observational uncertainties for hydrology: rainfall, river discharge and water quality , 2012 .

[2]  Hoshin Vijai Gupta,et al.  Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling , 2009 .

[3]  Neil McIntyre,et al.  Towards reduced uncertainty in conceptual rainfall‐runoff modelling: dynamic identifiability analysis , 2003 .

[4]  Keith Beven,et al.  Concepts of Information Content and Likelihood in Parameter Calibration for Hydrological Simulation Models , 2014 .

[5]  Stefano Tarantola,et al.  Introduction to Sensitivity Analysis , 2008 .

[6]  Patrick M. Reed,et al.  Time‐varying sensitivity analysis clarifies the effects of watershed model formulation on model behavior , 2013 .

[7]  K. Beven,et al.  Bayesian Estimation of Uncertainty in Runoff Prediction and the Value of Data: An Application of the GLUE Approach , 1996 .

[8]  M. Morris,et al.  Transformations and invariance in the sensitivity analysis of computer experiments , 2014 .

[9]  Soroosh Sorooshian,et al.  A framework for development and application of hydrological models , 2001, Hydrology and Earth System Sciences.

[10]  Robert S. Anderson,et al.  Risk and Uncertainty Assessment for Natural Hazards , 2014 .

[11]  Keith Beven,et al.  A physically based model of heterogeneous hillslopes: 1. Runoff production , 1989 .

[12]  Keith Beven,et al.  So just why would a modeller choose to be incoherent , 2008 .

[13]  Brian J. Wagner,et al.  Experimental design for estimating parameters of rate‐limited mass transfer: Analysis of stream tracer studies , 1997 .

[14]  R. Spear Eutrophication in peel inlet—II. Identification of critical uncertainties via generalized sensitivity analysis , 1980 .

[15]  Emanuele Borgonovo,et al.  A new uncertainty importance measure , 2007, Reliab. Eng. Syst. Saf..

[16]  Patrick M. Reed,et al.  From maps to movies: High-resolution time-varying sensitivity analysis for spatially distributed watershed models , 2013 .

[17]  George Kuczera,et al.  Bayesian analysis of input uncertainty in hydrological modeling: 2. Application , 2006 .

[18]  Keith Beven,et al.  On red herrings and real herrings: disinformation and information in hydrological inference , 2011 .

[19]  R. Allan Freeze,et al.  A stochastic‐conceptual analysis of rainfall‐runoff processes on a hillslope , 1980 .

[20]  Erwin Zehe,et al.  Inferring model structural deficits by analyzing temporal dynamics of model performance and parameter sensitivity , 2011 .

[21]  B. Croke,et al.  Addressing ten questions about conceptual rainfall–runoff models with global sensitivity analyses in R , 2013 .

[22]  Thorsten Wagener,et al.  A new approach to visualizing time-varying sensitivity indices for environmental model diagnostics across evaluation time-scales , 2014, Environ. Model. Softw..

[23]  N. Fohrer,et al.  How to improve the representation of hydrological processes in SWAT for a lowland catchment – temporal analysis of parameter sensitivity and model performance , 2014 .

[24]  Francesca Pianosi,et al.  A simple and efficient method for global sensitivity analysis based on cumulative distribution functions , 2015, Environ. Model. Softw..

[25]  Soroosh Sorooshian,et al.  Model Parameter Estimation Experiment (MOPEX): An overview of science strategy and major results from the second and third workshops , 2006 .

[26]  D. Kavetski,et al.  Confronting Input Uncertainty in Environmental Modelling , 2013 .

[27]  Keith Beven,et al.  Multivariate seasonal period model rejection within the generalised likelihood uncertainty estimation procedure. , 2013 .

[28]  Thorsten Wagener,et al.  Identifiability of transient storage model parameters along a mountain stream , 2013 .

[29]  Keith Beven,et al.  The future of distributed models: model calibration and uncertainty prediction. , 1992 .

[30]  V. Singh,et al.  The HBV model. , 1995 .

[31]  Jan Seibert,et al.  Estimation of Parameter Uncertainty in the HBV Model , 1997 .

[32]  Patrick M. Reed,et al.  When are multiobjective calibration trade‐offs in hydrologic models meaningful? , 2012 .

[33]  J. Vrugt,et al.  A formal likelihood function for parameter and predictive inference of hydrologic models with correlated, heteroscedastic, and non‐Gaussian errors , 2010 .

[34]  P. Reed,et al.  Characterization of watershed model behavior across a hydroclimatic gradient , 2008 .

[35]  Florian Pappenberger,et al.  Multi‐method global sensitivity analysis (MMGSA) for modelling floodplain hydrological processes , 2008 .

[36]  Q. Duana,et al.  Model Parameter Estimation Experiment (MOPEX): An overview of science strategy and major results from the second and third workshops , 2006 .

[37]  S. Uhlenbrook,et al.  Sensitivity analyses of a distributed catchment model to verify the model structure , 2005 .

[38]  Francesca Pianosi,et al.  A Matlab toolbox for Global Sensitivity Analysis , 2015, Environ. Model. Softw..