Error reduction and representation in stages (ERRIS) in hydrologicalmodelling for ensemble streamflow forecasting

Abstract. This study develops a new error modelling method for ensemble short-term and real-time streamflow forecasting, called error reduction and representation in stages (ERRIS). The novelty of ERRIS is that it does not rely on a single complex error model but runs a sequence of simple error models through four stages. At each stage, an error model attempts to incrementally improve over the previous stage. Stage 1 establishes parameters of a hydrological model and parameters of a transformation function for data normalization, Stage 2 applies a bias correction, Stage 3 applies autoregressive (AR) updating, and Stage 4 applies a Gaussian mixture distribution to represent model residuals. In a case study, we apply ERRIS for one-step-ahead forecasting at a range of catchments. The forecasts at the end of Stage 4 are shown to be much more accurate than at Stage 1 and to be highly reliable in representing forecast uncertainty. Specifically, the forecasts become more accurate by applying the AR updating at Stage 3, and more reliable in uncertainty spread by using a mixture of two Gaussian distributions to represent the residuals at Stage 4. ERRIS can be applied to any existing calibrated hydrological models, including those calibrated to deterministic (e.g. least-squares) objectives.

[1]  Roman Krzysztofowicz,et al.  Transformation and normalization of variates with specified distributions , 1997 .

[2]  J. Thielen,et al.  The European Flood Alert System – Part 1: Concept and development , 2008 .

[3]  C. Perrin,et al.  Improvement of a parsimonious model for streamflow simulation , 2003 .

[4]  Dimitri Solomatine,et al.  A novel method to estimate model uncertainty using machine learning techniques , 2009 .

[5]  A. Raftery,et al.  Probabilistic forecasts, calibration and sharpness , 2007 .

[6]  T. Hamill.  Interpretation of Rank Histograms for Verifying Ensemble Forecasts , 2001 .

[7]  Paolo Reggiani,et al.  Uncertainty assessment via Bayesian revision of ensemble streamflow predictions in the operational river Rhine forecasting system , 2009 .

[8]  Anton H. Westveld,et al.  Calibrated Probabilistic Forecasting Using Ensemble Model Output Statistics and Minimum CRPS Estimation , 2005 .

[9]  George Kuczera,et al.  Pitfalls and improvements in the joint inference of heteroscedasticity and autocorrelation in hydrological model calibration , 2013 .

[10]  Soroosh Sorooshian,et al.  Optimal use of the SCE-UA global optimization method for calibrating watershed models , 1994 .

[11]  James C. Bennett,et al.  Improving Precipitation Forecasts by Generating Ensembles through Postprocessing , 2015 .

[12]  Quan J. Wang,et al.  A log‐sinh transformation for data normalization and variance stabilization , 2012 .

[13]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[14]  James C. Bennett,et al.  A System for Continuous Hydrological Ensemble Forecasting (SCHEF) to lead times of 9 days , 2014 .

[15]  H. Hersbach.  Decomposition of the Continuous Ranked Probability Score for Ensemble Prediction Systems , 2000 .

[16]  C. Diks,et al.  Improved treatment of uncertainty in hydrologic modeling: Combining the strengths of global optimization and data assimilation , 2005 .

[17]  M. H. Diskin,et al.  A procedure for the selection of objective functions for hydrologic simulation models , 1977 .

[18]  Quan J. Wang,et al.  Quantifying parameter uncertainty in stochastic models using the Box–Cox transformation , 2002 .

[19]  Ashish Sharma,et al.  Modeling the catchment via mixtures: Issues of model specification and validation , 2005 .

[20]  James C. Bennett,et al.  A strategy to overcome adverse effects of autoregressive updating of streamflow forecasts , 2015 .

[21]  George Kuczera,et al.  Bayesian analysis of input uncertainty in hydrological modeling: 2. Application , 2006 .

[22]  M. Trosset,et al.  Bayesian recursive parameter estimation for hydrologic models , 2001 .

[23]  Bettina Schaefli,et al.  Quantifying hydrological modeling errors through a mixture of normal distributions , 2007 .

[24]  A. Brath,et al.  A stochastic approach for assessing the uncertainty of rainfall‐runoff simulations , 2004 .

[25]  James C. Bennett,et al.  Quantifying predictive uncertainty of streamflow forecasts based on a Bayesian joint probability model , 2015 .

[26]  Stefania Tamea,et al.  Verification tools for probabilistic forecasts of continuous hydrological variables , 2006 .

[27]  Ezio Todini,et al.  A model conditional processor to assess predictive uncertainty in flood forecasting , 2008 .

[28]  James D. Brown,et al.  The Science of NOAA's Operational Hydrologic Ensemble Forecast Service , 2014 .

[29]  George Kuczera,et al.  Understanding predictive uncertainty in hydrologic modeling: The challenge of identifying input and structural errors , 2010 .

[30]  P. Reichert,et al.  Hydrological modelling of the Chaohe Basin in China: Statistical model formulation and Bayesian inference , 2007 .

[31]  Francesca Pianosi,et al.  Dynamic modeling of predictive uncertainty by regression on absolute errors , 2012 .

[32]  Roman Krzysztofowicz,et al.  Hydrologic uncertainty processor for probabilistic river stage forecasting , 2000 .

[33]  P. E. O'connell,et al.  River flow forecasting through conceptual models part III - The Ray catchment at Grendon Underwood , 1970 .

[34]  George Kuczera,et al.  Comparison of joint versus postprocessor approaches for hydrological uncertainty estimation accounting for error autocorrelation and heteroscedasticity , 2014 .

[35]  Qingyun Duan,et al.  An integrated hydrologic Bayesian multimodel combination framework: Confronting input, parameter, and model structural uncertainty in hydrologic prediction , 2006 .

[36]  Q. J. Wang,et al.  Multisite probabilistic forecasting of seasonal flows for streams with zero value occurrences , 2011 .

[37]  Roman Krzysztofowicz,et al.  The case for probabilistic forecasting in hydrology , 2001 .

[38]  Tyler Smith,et al.  Development of a formal likelihood function for improved Bayesian inference of ephemeral catchments , 2010 .

[39]  Q. Duana,et al.  Model Parameter Estimation Experiment (MOPEX): An overview of science strategy and major results from the second and third workshops , 2006 .

[40]  Christopher J. Taylor,et al.  Evaluation of Statistical Models , 2008 .

[41]  Roman Krzysztofowicz,et al.  A bivariate meta-Gaussian density for use in hydrology , 1997 .

[42]  Ashish Sharma,et al.  Improving real-time inflow forecasting into hydropower reservoirs through a complementary modelling framework , 2014 .

[43]  D. Kavetski,et al.  Towards a Bayesian total error analysis of conceptual rainfall-runoff models: Characterising model error using storm-dependent parameters , 2006 .

[44]  Kuolin Hsu,et al.  Uncertainty assessment of hydrologic model states and parameters: Sequential data assimilation using the particle filter , 2005 .

[45]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[46]  George Kuczera,et al.  Bayesian analysis of input uncertainty in hydrological modeling: 1. Theory , 2006 .

[47]  Quan J. Wang,et al.  The challenge of forecasting high streamflows 1–3 months in advance with lagged climate indices in southeast Australia , 2014 .

[48]  Benjamin Renard,et al.  Evaluation of statistical models for forecast errors from the HBV model , 2010 .

[49]  D. Jones,et al.  High-quality spatial climate data-sets for Australia , 2009 .

[50]  Roman Krzysztofowicz,et al.  Bayesian theory of probabilistic forecasting via deterministic hydrologic model , 1999 .

[51]  T. Gneiting,et al.  The continuous ranked probability score for circular variables and its application to mesoscale forecast ensemble verification , 2006 .

[52]  Quan J. Wang,et al.  Post-processing rainfall forecasts from numerical weather prediction models for short-term streamflow forecasting , 2013 .

[53]  B. Bates,et al.  A Markov Chain Monte Carlo Scheme for parameter estimation and inference in conceptual rainfall‐runoff modeling , 2001 .

[54]  Lihua Xiong,et al.  Comparison of four updating models for real-time river flow forecasting , 2002 .

[55]  Quan J. Wang,et al.  Evaluation of numerical weather prediction model precipitation forecasts for short-term streamflow forecasting purpose , 2013 .

[56]  Andreas Scheidegger,et al.  Improving uncertainty estimation in urban hydrological modeling by statistically describing bias , 2013 .

[57]  S. Sorooshian,et al.  Stochastic parameter estimation procedures for hydrologie rainfall‐runoff models: Correlated and heteroscedastic error cases , 1980 .

[58]  Q. J. Wang,et al.  Statistical calibration and bridging of ECMWF System4 outputs for forecasting seasonal precipitation over China , 2014 .

[59]  J. Vrugt,et al.  A formal likelihood function for parameter and predictive inference of hydrologic models with correlated, heteroscedastic, and non‐Gaussian errors , 2010 .

[60]  Quan J. Wang,et al.  A Bayesian joint probability modeling approach for seasonal forecasting of streamflows at multiple sites , 2009 .

[61]  L. Alfieri,et al.  GloFAS – global ensemble streamflow forecasting and flood early warning , 2012 .

[62]  G. Kuczera.  Improved parameter inference in catchment models: 1. Evaluating parameter uncertainty , 1983 .

[63]  James C. Bennett,et al.  Accounting for seasonal dependence in hydrological model errors and prediction uncertainty , 2013 .

[64]  O. Talagrand,et al.  Evaluation of probabilistic prediction systems for a scalar variable , 2005 .

[65]  Soroosh Sorooshian,et al.  Model Parameter Estimation Experiment (MOPEX): An overview of science strategy and major results from the second and third workshops , 2006 .