On the practical usefulness of least squares for assessing uncertainty in hydrologic and water quality predictions

Abstract Sophisticated methods for uncertainty quantification have been proposed for overcoming the pitfalls of simple statistical inference in hydrology. The implementation of such methods is conceptually and computationally challenging, however, especially for large-scale models. Here, we explore whether there are circumstances in which simple approaches, such as least squares, produce comparably accurate and reliable predictions. We do so using three case studies, with two involving a small sewer catchment with limited calibration data, and one an agricultural river basin with rich calibration data. We also review additional published case studies. We find that least squares performs similarly to more sophisticated approaches such as a Bayesian autoregressive error model in terms of both accuracy and reliability if calibration periods are long or if the input data and the model have minimal bias. Overall, we find that, when mindfully applied, simple statistical methods such as least squares can still be useful for uncertainty quantification.

[1]  Gabriele Freni,et al.  Urban runoff modelling uncertainty: Comparison among Bayesian and pseudo-Bayesian methods , 2009, Environ. Model. Softw..

[2]  Bryan A. Tolson,et al.  An efficient framework for hydrologic model calibration on long data periods , 2013 .

[3]  C. Stow,et al.  Predicting the frequency of water quality standard violations: a probabilistic approach for TMDL development. , 2002, Environmental science & technology.

[4]  P. Reichert,et al.  Linking statistical bias description to multiobjective model calibration , 2012 .

[5]  Robert D. Hetland,et al.  Multivariable statistical regression models of the areal extent of hypoxia over the Texas–Louisiana continental shelf , 2011 .

[6]  J. Vrugt,et al.  A formal likelihood function for parameter and predictive inference of hydrologic models with correlated, heteroscedastic, and non‐Gaussian errors , 2010 .

[7]  Dmitri Kavetski,et al.  Impact of temporal data resolution on parameter inference and model identification in conceptual hydrological modeling: Insights from an experimental catchment , 2010 .

[8]  Peter Reichert,et al.  Bayesian inference of a lake water quality model by emulating its posterior density , 2014 .

[9]  S. Sorooshian,et al.  Automatic calibration of conceptual rainfall-runoff models: sensitivity to calibration data , 1996 .

[10]  Martin F. Lambert,et al.  A strategy for diagnosing and interpreting hydrological model nonstationarity , 2014 .

[11]  Peter Reichert,et al.  Bayesian uncertainty analysis in distributed hydrologic modeling: A case study in the Thur River basin (Switzerland) , 2007 .

[12]  Michael Rode,et al.  Multi-site identification of a distributed hydrological nitrogen model using Bayesian uncertainty analysis , 2015 .

[13]  P. Reichert,et al.  Describing the catchment‐averaged precipitation as a stochastic process improves parameter and input estimation , 2016 .

[14]  George Kuczera,et al.  Toward a reliable decomposition of predictive uncertainty in hydrological modeling: Characterizing rainfall errors using conditional simulation , 2011 .

[15]  S. Sorooshian,et al.  A Shuffled Complex Evolution Metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters , 2002 .

[16]  Nathan S. Bosch,et al.  Application of the Soil and Water Assessment Tool for six watersheds of Lake Erie: Model parameteriz , 2011 .

[17]  Keith Beven,et al.  Concepts of Information Content and Likelihood in Parameter Calibration for Hydrological Simulation Models , 2014 .

[18]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[19]  George Kuczera,et al.  Comparison of joint versus postprocessor approaches for hydrological uncertainty estimation accounting for error autocorrelation and heteroscedasticity , 2014 .

[20]  Quan J. Wang,et al.  A log‐sinh transformation for data normalization and variance stabilization , 2012 .

[21]  John R. Williams,et al.  LARGE AREA HYDROLOGIC MODELING AND ASSESSMENT PART I: MODEL DEVELOPMENT 1 , 1998 .

[22]  Andreas Scheidegger,et al.  Improving uncertainty estimation in urban hydrological modeling by statistically describing bias , 2013 .

[23]  S. Sorooshian,et al.  Stochastic parameter estimation procedures for hydrologie rainfall‐runoff models: Correlated and heteroscedastic error cases , 1980 .

[24]  Peter Reichert,et al.  Analyzing input and structural uncertainty of nonlinear dynamic models with stochastic, time‐dependent parameters , 2009 .

[25]  P. Reichert,et al.  Hydrological modelling of the Chaohe Basin in China: Statistical model formulation and Bayesian inference , 2007 .

[26]  Sylvain Coutu,et al.  Parsimonious hydrological modeling of urban sewer and river catchments , 2012 .

[27]  James O. Berger,et al.  A Framework for Validation of Computer Models , 2007, Technometrics.

[28]  Margaret Kalcic,et al.  Pay-for-performance conservation using swat highlights need for field-level agricultural conservation , 2017 .

[29]  Peter Steen Mikkelsen,et al.  Comparison of two stochastic techniques for reliable urban runoff prediction by modeling systematic errors , 2015 .

[30]  Dario Del Giudice,et al.  The value of streamflow data in improving TSS predictions - Bayesian multi-objective calibration , 2015 .

[31]  Christian Stamm,et al.  Integrated uncertainty assessment of discharge predictions with a statistical error model , 2013 .

[32]  Jeffrey M. Wooldridge,et al.  Introductory Econometrics: A Modern Approach , 1999 .

[33]  Dario Del Giudice,et al.  Model bias and complexity - Understanding the effects of structural deficits and input errors on runoff predictions , 2015, Environ. Model. Softw..

[34]  Hoshin Vijai Gupta,et al.  Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling , 2009 .

[35]  Wolfgang Rauch,et al.  Performance and sensitivity analysis of stormwater models using a Bayesian approach and long-term high resolution data , 2011, Environ. Model. Softw..