A global sensitivity analysis approach for identifying critical sources of uncertainty in non-identifiable, spatially distributed environmental models: A holistic analysis applied to SWAT for input datasets and model parameters

Abstracts Environmental models have a key role to play in understanding complex environmental phenomena in space and time. Although their inherent uncertainty and non-identifiability are being increasingly recognized with the development and application of various methods, a more holistic analysis of all sources of model uncertainty is warranted. This paper addresses sources of uncertainty from various types of input datasets and model parameters, including those related to model structure assumptions, using a Soil and Water Assessment Tool (SWAT) application for the Minjiang River watershed, China. The holistic uncertainty sources in the SWAT application are summarized, and a sensitivity analysis (SA) is applied to examine the relative importance of the uncertainty sources influencing average streamflow and the load of nitrate. The analysis reveals that uncertainties related to the stream network precision and certain SWAT parameters are the most critical factors. Furthermore, building upon our SA framework to consider uncertainty sources more holistically would provide a good starting point for subsequent SA of spatially distributed environmental models in general.

[1]  Xi Chen,et al.  Uncertainty analysis of a semi-distributed hydrologic model based on a Gaussian Process emulator , 2018, Environ. Model. Softw..

[2]  Richard M. Vogel,et al.  On the deterministic and stochastic use of hydrologic models , 2016 .

[3]  Andrew Jarvis,et al.  Hole-filled SRTM for the globe Version 4 , 2008 .

[4]  Sihem Benabdallah,et al.  Sensitivity analysis of SWAT model to the spatial rainfall distribution and watershed subdivision in streamflow simulations in the Mediterranean context: A case study in the Joumine watershed. Tunisia , 2013, 2013 5th International Conference on Modeling, Simulation and Applied Optimization (ICMSAO).

[5]  Michael F. Goodchild,et al.  Development and test of an error model for categorical data , 1992, Int. J. Geogr. Inf. Sci..

[6]  I. Sobola,et al.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[7]  John Norton,et al.  An introduction to sensitivity assessment of simulation models , 2015, Environ. Model. Softw..

[8]  Grzegorz J. Ciach,et al.  Local Random Errors in Tipping-Bucket Rain Gauge Measurements , 2003 .

[9]  Nicholas Chrisman,et al.  THE ERROR COMPONENT IN SPATIAL DATA , 2005 .

[10]  A. Bárdossy,et al.  Influence of rainfall observation network on model calibration and application , 2006 .

[11]  Stefano Tarantola,et al.  GLOBAL sensitivity analysis, GIS and multi‐criteria evaluation for a sustainable planning of a hazardous waste disposal site in Spain , 2006, Int. J. Geogr. Inf. Sci..

[12]  Joseph H. A. Guillaume,et al.  Introductory overview of identifiability analysis: A guide to evaluating whether you have the right type of data for your modeling purpose , 2019, Environ. Model. Softw..

[13]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models , 2004 .

[14]  Gerard B. M. Heuvelink,et al.  Geostatistical simulation and error propagation in geomorphometry , 2009 .

[15]  Jeffrey G. Arnold,et al.  Soil and Water Assessment Tool Theoretical Documentation Version 2009 , 2011 .

[16]  Wenzhong Shi A Generic Statistical Approach for Modelling Error of Geometric Features in GIS , 1998, Int. J. Geogr. Inf. Sci..

[17]  Max D. Morris,et al.  Factorial sampling plans for preliminary computational experiments , 1991 .

[18]  Gerard B. M. Heuvelink,et al.  Error Propagation in Environmental Modelling with GIS , 1998 .

[19]  R. Moore,et al.  Rainfall and sampling uncertainties: A rain gauge perspective , 2008 .

[20]  S. Jade,et al.  Uncertainties in the Shuttle Radar Topography Mission (SRTM) Heights: Insights from the Indian Himalaya and Peninsula , 2017, Scientific Reports.

[21]  Zongxue Xu,et al.  Analysis of parameter uncertainty in semi-distributed hydrological models using bootstrap method: a case study of SWAT model applied to Yingluoxia watershed in northwest China. , 2010 .

[22]  L. Shawn Matott,et al.  Evaluating uncertainty in integrated environmental models: A review of concepts and tools , 2009 .

[23]  Litan Kumar Ray Limitation of automatic watershed delineation tools in coastal region , 2018, Ann. GIS.

[24]  D. Mackay,et al.  Impacts of input parameter spatial aggregation on an agricultural nonpoint source pollution model , 2000 .

[25]  C. George,et al.  WaterBase: SWAT in an Open Source GIS , 2008 .

[26]  I. Sobol,et al.  Global sensitivity indices for nonlinear mathematical models. Review , 2005 .

[27]  Venkatesh Merwade,et al.  Impact of Watershed Subdivision and Soil Data Resolution on SWAT Model Calibration and Parameter Uncertainty 1 , 2009 .

[28]  Shuangzhe Liu,et al.  Global Sensitivity Analysis: The Primer by Andrea Saltelli, Marco Ratto, Terry Andres, Francesca Campolongo, Jessica Cariboni, Debora Gatelli, Michaela Saisana, Stefano Tarantola , 2008 .

[29]  David D. Bosch,et al.  Effect of spatial distribution of rainfall on temporal and spatial uncertainty of SWAT output. , 2009 .

[30]  Edzer J. Pebesma,et al.  Multivariable geostatistics in S: the gstat package , 2004, Comput. Geosci..

[31]  Mazdak Arabi,et al.  A Bayesian total uncertainty analysis framework for assessment of management practices using watershed models , 2018, Environ. Model. Softw..

[32]  Wei Chu,et al.  A comprehensive evaluation of various sensitivity analysis methods: A case study with a hydrological model , 2014, Environ. Model. Softw..

[33]  Vladimir U. Smakhtin,et al.  Assessing the Impact of Areal Precipitation Input on Streamflow Simulations Using the SWAT Model 1 , 2011 .

[34]  Laura Uusitalo,et al.  An overview of methods to evaluate uncertainty of deterministic models in decision support , 2015, Environ. Model. Softw..

[35]  K. Abbaspour,et al.  Modelling hydrology and water quality in the pre-alpine/alpine Thur watershed using SWAT , 2007 .

[36]  Saman Razavi,et al.  Revisiting the Basis of Sensitivity Analysis for Dynamical Earth System Models , 2018, Water Resources Research.

[37]  Daniel A. Griffith,et al.  Optimal Map Classification Incorporating Uncertainty Information , 2017 .

[38]  Martin Volk,et al.  Using precipitation data ensemble for uncertainty analysis in SWAT streamflow simulation , 2012 .

[39]  Marc B. Neumann,et al.  Global sensitivity analysis for urban water quality modelling: terminology, convergence and comparison of different methods. , 2015 .

[40]  Limin Yang,et al.  Development of a global land cover characteristics database and IGBP DISCover from 1 km AVHRR data , 2000 .

[41]  Min Chen,et al.  Design and development of a service-oriented wrapper system for sharing and reusing distributed geoanalysis models on the web , 2019, Environ. Model. Softw..

[42]  Jiaping Wu,et al.  Evaluating DEM source and resolution uncertainties in the Soil and Water Assessment Tool , 2012, Stochastic Environmental Research and Risk Assessment.

[43]  Lei Chen,et al.  Uncertainty analysis for nonpoint source pollution modeling: implications for watershed models , 2015, International Journal of Environmental Science and Technology.

[44]  P. Kyriakidis,et al.  Error in a USGS 30-meter digital elevation model and its impact on terrain modeling , 2000 .

[45]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[46]  Florian Pappenberger,et al.  Multi-method global sensitivity analysis of flood inundation models. , 2008 .

[47]  Tammo S. Steenhuis,et al.  Using the Climate Forecast System Reanalysis as weather input data for watershed models , 2014 .

[48]  Stefano Tarantola,et al.  Uncertainty and sensitivity analysis: tools for GIS-based model implementation , 2001, Int. J. Geogr. Inf. Sci..

[49]  Pebesma Edzer,et al.  Managing uncertainty in integrated environmental modelling frameworks: The UncertWeb framework , 2012 .

[50]  Charles Tong Problem Solving Environment for Uncertainty Analysis and Design Exploration , 2008 .

[51]  Torben O. Sonnenborg,et al.  Impact of Precipitation Spatial Resolution on the Hydrological Response of an Integrated Distributed Water Resources Model , 2011 .

[52]  P. Reichert,et al.  Hydrological modelling of the Chaohe Basin in China: Statistical model formulation and Bayesian inference , 2007 .

[53]  Dan B. Jaynes,et al.  Effect of the accuracy of spatial rainfall information on the modeling of water, sediment, and NO3–N loads at the watershed level , 2005 .

[54]  David J. Maguire,et al.  Geographical Information Systems , 1993 .

[55]  Barnali M. Dixon,et al.  Resample or not?! Effects of resolution of DEMs in watershed modeling , 2009 .

[56]  J. Feyen,et al.  Effect of watershed delineation and areal rainfall distribution on runoff prediction using the SWAT model , 2009 .

[57]  M. Goodchild,et al.  Geographic Information Systems and Science (second edition) , 2001 .

[58]  S. Liu,et al.  Impacts of forest changes on hydrology: a case study of large watersheds in the upper reaches of Minjiang River watershed in China , 2012 .

[59]  T. Sarjakoski,et al.  Error propagation analysis of DEM‐based drainage basin delineation , 2005 .

[60]  Shuguang Liu,et al.  Automating calibration, sensitivity and uncertainty analysis of complex models using the R package Flexible Modeling Environment (FME): SWAT as an example , 2012, Environ. Model. Softw..

[61]  A. Saltelli,et al.  A quantitative model-independent method for global sensitivity analysis of model output , 1999 .

[62]  Henrik Madsen,et al.  An evaluation of the impact of model structure on hydrological modelling uncertainty for streamflow simulation , 2004 .

[63]  Saman Razavi,et al.  A multi-method Generalized Global Sensitivity Matrix approach to accounting for the dynamical nature of earth and environmental systems models , 2019, Environ. Model. Softw..

[64]  Gerard B. M. Heuvelink,et al.  Chapter 5 Geostatistical Simulation and Error Propagation in Geomorphometry , 2009 .

[65]  Manfred M. Fischer,et al.  Handbook of Regional Science , 2014 .

[66]  Dan Cornford,et al.  Managing uncertainty in integrated environmental modelling: The UncertWeb framework , 2013, Environ. Model. Softw..

[67]  Gerard B. M. Heuvelink,et al.  On the uncertainty of stream networks derived from elevation data: the error propagation approach , 2010 .

[68]  Aranya Venkatesh,et al.  Large-scale hydrological modeling for calculating water stress indices: implications of improved spatiotemporal resolution, surface-groundwater differentiation, and uncertainty characterization. , 2015, Environmental science & technology.

[69]  Assefa M. Melesse,et al.  SWAT model application and prediction uncertainty analysis in the Lake Tana Basin, Ethiopia , 2009 .

[70]  Guohe Huang,et al.  Characterization and Evaluation of Elevation Data Uncertainty in Water Resources Modeling with GIS , 2008 .

[71]  T. A. Costello,et al.  Effect of DEM data resolution on SWAT output uncertainty , 2005 .

[72]  Anthony O'Hagan,et al.  Probabilistic uncertainty specification: Overview, elaboration techniques and their application to a mechanistic model of carbon flux , 2012, Environ. Model. Softw..

[73]  Qian Hong,et al.  Parameter uncertainty analysis of the non-point source pollution in the Daning River watershed of the Three Gorges Reservoir Region, China. , 2008, The Science of the total environment.

[74]  Qinglan Li,et al.  Parameter Uncertainty Analysis of the SWAT Model in a Mountain-Loess Transitional Watershed on the Chinese Loess Plateau , 2018 .

[75]  Michael D. McKay,et al.  Evaluating Prediction Uncertainty , 1995 .

[76]  Lei Chen,et al.  Effect of Rainfall Measurement Errors on Nonpoint-Source Pollution Model Uncertainty , 2016 .

[77]  Erik Fridell,et al.  The mechanism for NOx storage , 2000 .

[78]  Peter F. Fisher,et al.  Improved Modeling of Elevation Error with Geostatistics , 1998, GeoInformatica.

[79]  Anthony J. Jakeman,et al.  Flood inundation modelling: A review of methods, recent advances and uncertainty analysis , 2017, Environ. Model. Softw..

[80]  Qin Huang,et al.  A comprehensive study of the effect of GIS data on hydrology and non-point source pollution modeling , 2013 .

[81]  Anthony J. Jakeman,et al.  A review of catchment-scale water quality and erosion models and a synthesis of future prospects , 2019, Environ. Model. Softw..