Treatment of uncertainty using ensemble methods: Comparison of sequential data assimilation and Bayesian model averaging

[1] Predictive uncertainty analysis in hydrologic modeling has become an active area of research, the goal being to generate meaningful error bounds on model predictions. State-space filtering methods, such as the ensemble Kalman filter (EnKF), have shown the most flexibility to integrate all sources of uncertainty. However, predictive uncertainty analyses are typically carried out using a single conceptual mathematical model of the hydrologic system, rejecting a priori valid alternative plausible models and possibly underestimating uncertainty in the model itself. Methods based on Bayesian model averaging (BMA) have also been proposed in the statistical and meteorological literature as a means to account explicitly for conceptual model uncertainty. The present study compares the performance and applicability of the EnKF and BMA for probabilistic ensemble streamflow forecasting, an application for which a robust comparison of the predictive skills of these approaches can be conducted. The results suggest that for the watershed under consideration, BMA cannot achieve a performance matching that of the EnKF method.

[1]  E. Hansen,et al.  NUMERICAL SIMULATION OF THE RAINFALL-RUNOFF PROCESS ON A DAILY BASIS , 1973 .

[2]  D. Madigan,et al.  Bayesian Model Averaging for Linear Regression Models , 1997 .

[3]  Martyn P. Clark,et al.  Multi‐objective calibration of forecast ensembles using Bayesian model averaging , 2006 .

[4]  P. Kitanidis,et al.  Real‐time forecasting with a conceptual hydrologic model: 2. Applications and results , 1980 .

[5]  Walter C. Boughton,et al.  Systematic Procedure for Evaluating Partial Areas of Watershed Runoff , 1990 .

[6]  E. George,et al.  Journal of the American Statistical Association is currently published by American Statistical Association. , 2007 .

[7]  Thibault Mathevet,et al.  Impact of biased and randomly corrupted inputs on the efficiency and the parameters of watershed models , 2006 .

[8]  H. Gupta,et al.  Real-Time Data Assimilation for Operational Ensemble Streamflow Forecasting , 2006 .

[9]  Ming Ye,et al.  Maximum likelihood Bayesian averaging of spatial variability models in unsaturated fractured tuff , 2003 .

[10]  A. Shamseldin,et al.  Methods for combining the outputs of different rainfall–runoff models , 1997 .

[11]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[12]  A. Raftery,et al.  Discussion: Performance of Bayesian Model Averaging , 2003 .

[13]  George Kuczera,et al.  Monte Carlo assessment of parameter uncertainty in conceptual catchment models: the Metropolis algorithm , 1998 .

[14]  Soroosh Sorooshian,et al.  Dual state-parameter estimation of hydrological models using ensemble Kalman filter , 2005 .

[15]  S. Sorooshian,et al.  Application of stochastic parameter optimization to the Sacramento Soil Moisture Accounting model , 2006, Journal of Hydrology.

[16]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[17]  S. Sorooshian,et al.  Multimodel Combination Techniques for Analysis of Hydrological Simulations: Application to Distributed Model Intercomparison Project Results , 2006 .

[18]  Peter K. Kitanidis,et al.  Real‐time forecasting with a conceptual hydrologic model: 1. Analysis of uncertainty , 1980 .

[19]  Ashish Sharma,et al.  Hydrological model selection: A Bayesian alternative , 2005 .

[20]  M. Clark,et al.  Probabilistic Quantitative Precipitation Estimation in Complex Terrain , 2005 .

[21]  A. Raftery,et al.  Long-Run Performance of Bayesian Model Averaging , 2003 .

[22]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[23]  S. Sorooshian,et al.  Stochastic parameter estimation procedures for hydrologie rainfall‐runoff models: Correlated and heteroscedastic error cases , 1980 .

[24]  Soroosh Sorooshian,et al.  Multi-Model Combination Techniques for Hydrological Forecasting: Application to Distributed Model Intercomparison Project Results , 2005 .

[25]  Kuolin Hsu,et al.  Uncertainty assessment of hydrologic model states and parameters: Sequential data assimilation using the particle filter , 2005 .

[26]  Soroosh Sorooshian,et al.  Toward improved identifiability of hydrologic model parameters: The information content of experimental data , 2002 .

[27]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[28]  A. Shamseldin,et al.  A real-time combination method for the outputs of different rainfall-runoff models , 1999 .

[29]  S. Sorooshian,et al.  Automatic calibration of conceptual rainfall-runoff models: sensitivity to calibration data , 1996 .

[30]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[31]  Dong-Jun Seo,et al.  Towards the characterization of streamflow simulation uncertainty through multimodel ensembles , 2004 .

[32]  S. Sorooshian,et al.  A Shuffled Complex Evolution Metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters , 2002 .

[33]  C. Perrin,et al.  Improvement of a parsimonious model for streamflow simulation , 2003 .

[34]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[35]  Jens Christian Refsgaard,et al.  Validation and Intercomparison of Different Updating Procedures for Real-Time Forecasting , 1997 .

[36]  Qingyun Duan,et al.  An integrated hydrologic Bayesian multimodel combination framework: Confronting input, parameter, and model structural uncertainty in hydrologic prediction , 2006 .

[37]  A. P. Dawid,et al.  Bayesian Model Averaging and Model Search Strategies , 2007 .

[38]  V. Singh,et al.  The HBV model. , 1995 .

[39]  G. Evensen Sequential data assimilation with a nonlinear quasi‐geostrophic model using Monte Carlo methods to forecast error statistics , 1994 .

[40]  J. M. Sloughter,et al.  Probabilistic Quantitative Precipitation Forecasting Using Bayesian Model Averaging , 2007 .

[41]  James O. Berger,et al.  Ockham's Razor and Bayesian Analysis , 1992 .

[42]  S. P. Neuman,et al.  Maximum likelihood Bayesian averaging of uncertain model predictions , 2003 .

[43]  C. Diks,et al.  Improved treatment of uncertainty in hydrologic modeling: Combining the strengths of global optimization and data assimilation , 2005 .

[44]  Dong-Jun Seo,et al.  Real-Time Variational Assimilation of Hydrologic and Hydrometeorological Data into Operational Hydrologic Forecasting , 2003 .

[45]  Soroosh Sorooshian,et al.  Toward improved streamflow forecasts: value of semidistributed modeling , 2001 .