Estimating bootstrap and Bayesian prediction intervals for constituent load rating curves

[1] Assessment of constituent loads in rivers is essential to evaluate water quality of streams and estuaries; however, uncertainty in load estimation may be large and must be considered and communicated together with estimates. In this comparative study, the usefulness of two existing methods (bootstrap and Bayesian inference) to assess uncertainty in constituent loads estimated with an improved eight-parameter rating curve is demonstrated. Bootstrap prediction intervals and Bayesian credible intervals were estimated for daily and monthly loads obtained with a rating curve applied to routine monitoring sampling data sets of nitrate (NO3-N), reactive phosphorus (RP), and total phosphorus (TP) of the Duck River, in Tasmania (Australia). Predicted loads and prediction intervals were compared to benchmark loads obtained by an independent, high frequency monitoring program. The eight-parameter rating curve resulted in better prediction of NO3-N and TP than RP loads. Both inference methods successfully generated prediction intervals. The bracketing frequency (i.e., the fraction of prediction intervals that comprised benchmark loads) of bootstrap prediction intervals was 50–65% of daily or monthly benchmark loads. Bracketing frequency of Bayesian credible intervals was consistently higher, and included 74–85% of benchmark daily loads and 80% or more of benchmark monthly loads. Both methods proved to be robust to the presence of an artificial outlier. Prediction intervals were affected by the distribution of the regression error, hence they reflected uncertainty in the regression data set and limitations in the rating curve formulation. They did not account for other sources of uncertainty, i.e., they were still conservative predictions of load uncertainty.

[1]  Ulrike Bende-Michl,et al.  A systematic approach to choosing an automated nutrient analyser for river monitoring. , 2010, Journal of environmental monitoring : JEM.

[2]  F. E. Grubbs Sample Criteria for Testing Outlying Observations , 1950 .

[3]  Qi Zhang,et al.  Parameter and modeling uncertainty simulated by GLUE and a formal Bayesian method for a conceptual hydrological model , 2010 .

[4]  Ming Ye,et al.  Analysis of regression confidence intervals and Bayesian credible intervals for uncertainty quantification , 2012 .

[5]  N. Cox,et al.  Fitting concentration and load rating curves with generalized linear models , 2008 .

[6]  A. Horowitz An evaluation of sediment rating curves for estimating suspended sediment concentrations for subsequent flux calculations , 2003 .

[7]  V. Singh,et al.  Evaluation of the subjective factors of the GLUE method and comparison with the formal Bayesian method in uncertainty assessment of hydrological models , 2010 .

[8]  Benjamin Renard,et al.  Evaluation of statistical models for forecast errors from the HBV model , 2010 .

[9]  Jim Freer,et al.  Uncertainties in data and models to describe event dynamics of agricultural sediment and phosphorus transfer. , 2009, Journal of environmental quality.

[10]  Ulrike Bende-Michl,et al.  High-frequency nutrient monitoring to infer seasonal patterns in catchment source availability, mobilisation and delivery , 2013, Environmental Monitoring and Assessment.

[11]  N. Duan Smearing Estimate: A Nonparametric Retransformation Method , 1983 .

[12]  D. R. Smith,et al.  Estimating storm discharge and water quality data uncertainty: A software tool for monitoring and modeling applications , 2009, Environ. Model. Softw..

[13]  S. Verma,et al.  Development of error correction techniques for nitrate-N load estimation methods , 2012 .

[14]  Richard P. Hooper,et al.  The composite method: an improved method for stream‐water solute load estimation , 2006 .

[15]  Asgeir Petersen-Øverleir,et al.  Dynamic rating curve assessment in unstable rivers using Ornstein‐Uhlenbeck processes , 2011 .

[16]  K. Beven,et al.  A method of computing uncertain nitrogen and phosphorus loads in a small stream from an agricultural catchment using continuous monitoring data , 2012 .

[17]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[18]  George B. Arhonditsis,et al.  A Bayesian methodological framework for accommodating interannual variability of nutrient loading with the SPARROW model , 2012 .

[19]  N. Cox,et al.  A Note on the Concordance Correlation Coefficient , 2002 .

[20]  Kerrie M. Tomkins,et al.  Uncertainty in streamflow rating curves: methods, controls and consequences , 2014 .

[21]  Robert M. Summers,et al.  The validity of a simple statistical model for estimating fluvial constituent loads: An Empirical study involving nutrient loads entering Chesapeake Bay , 1992 .

[22]  Andrew Thomas,et al.  The BUGS project: Evolution, critique and future directions , 2009, Statistics in medicine.

[23]  Penny J Johnes,et al.  Uncertainties in annual riverine phosphorus load estimation: Impact of load estimation methodology, sampling frequency, baseflow index and catchment population density , 2007 .

[24]  Matthew J. Helmers,et al.  Rating curve estimation of nutrient loads in Iowa rivers , 2011 .

[25]  J. Freer,et al.  Benchmarking observational uncertainties for hydrology: rainfall, river discharge and water quality , 2012 .

[26]  R. T. Clarke,et al.  The use of Bayesian methods for fitting rating curves, with case studies , 2005 .

[27]  Grady Hanrahan,et al.  Flow analysis techniques for spatial and temporal measurement of nutrients in aquatic systems , 2006 .

[28]  A. S. Hamilton,et al.  Quantifying Uncertainty in Streamflow Records , 2012 .

[29]  L. Lin,et al.  A concordance correlation coefficient to evaluate reproducibility. , 1989, Biometrics.

[30]  A. Petersen-Øverleir Accounting for heteroscedasticity in rating curve estimates , 2004 .

[31]  N. Asselman Fitting and interpretation of sediment rating curves , 2000 .

[32]  R. Coats,et al.  A MONTE CARLO TEST OF LOAD CALCULATION METHODS, LAKE TAHOE BASIN, CALIFORNIA‐NEVADA 1 , 2002 .

[33]  Ibrahim Alameddine,et al.  A Bayesian changepoint-threshold model to examine the effect of TMDL implementation on the flow-nitrogen concentration relationship in the Neuse River basin. , 2011, Water research.

[34]  Rebecca Bartley,et al.  A review of sediment and nutrient concentration data from Australia for use in catchment water quality models. , 2012, Marine pollution bulletin.

[35]  Gregory E Schwarz,et al.  A Multi-Agency Nutrient Dataset Used to Estimate Loads, Improve Monitoring Design, and Calibrate Regional Nutrient SPARROW Models1 , 2011, Journal of the American Water Resources Association.

[36]  You-Gan Wang,et al.  Load estimation with uncertainties from opportunistic sampling data: A semiparametric approach , 2011 .

[37]  P. Kuhnert,et al.  Quantifying total suspended sediment export from the Burdekin River catchment using the loads regression estimator tool , 2012 .

[38]  M. Demissie,et al.  The accuracy of sediment loads when log-transformation produces nonlinear sediment load–discharge relationships , 2007 .

[39]  Yiping Guo,et al.  Uncertainty of nitrate‐N load computations for agricultural watersheds , 2002 .

[40]  Robert J. Abrahart,et al.  DAMP: A protocol for contextualising goodness-of-fit statistics in sediment-discharge data-driven modelling , 2011 .

[41]  Kyoichi Otsuki,et al.  Determining storm sampling requirements for improving precision of annual load estimates of nutrients from a small forested watershed , 2011, Environmental Monitoring and Assessment.

[42]  S. Wilkinson,et al.  Applying bootstrap resampling to quantify uncertainty in fluvial suspended sediment loads estimated using rating curves , 2008 .

[43]  G. Holz Sources and processes of contaminant loss from an intensively grazed catchment inferred from patterns in discharge and concentration of thirteen analytes using high intensity sampling , 2010 .