Equifinality of formal (DREAM) and informal (GLUE) Bayesian approaches in hydrologic modeling?

In recent years, a strong debate has emerged in the hydrologic literature regarding what constitutes an appropriate framework for uncertainty estimation. Particularly, there is strong disagreement whether an uncertainty framework should have its roots within a proper statistical (Bayesian) context, or whether such a framework should be based on a different philosophy and implement informal measures and weaker inference to summarize parameter and predictive distributions. In this paper, we compare a formal Bayesian approach using Markov Chain Monte Carlo (MCMC) with generalized likelihood uncertainty estimation (GLUE) for assessing uncertainty in conceptual watershed modeling. Our formal Bayesian approach is implemented using the recently developed differential evolution adaptive metropolis (DREAM) MCMC scheme with a likelihood function that explicitly considers model structural, input and parameter uncertainty. Our results demonstrate that DREAM and GLUE can generate very similar estimates of total streamflow uncertainty. This suggests that formal and informal Bayesian approaches have more common ground than the hydrologic literature and ongoing debate might suggest. The main advantage of formal approaches is, however, that they attempt to disentangle the effect of forcing, parameter and model structural error on total predictive uncertainty. This is key to improving hydrologic theory and to better understand and predict the flow of water through catchments.

[1]  K. Beven,et al.  Comment on “Equifinality of formal (DREAM) and informal (GLUE) Bayesian approaches in hydrologic modeling?” by Jasper A. Vrugt, Cajo J. F. ter Braak, Hoshin V. Gupta and Bruce A. Robinson , 2009 .

[2]  J. Stedinger,et al.  Appraisal of the generalized likelihood uncertainty estimation (GLUE) method , 2008 .

[3]  S. Sorooshian,et al.  A Shuffled Complex Evolution Metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters , 2002 .

[4]  G. Hornberger,et al.  Approach to the preliminary analysis of environmental systems , 1981 .

[5]  Keith Beven,et al.  So just why would a modeller choose to be incoherent , 2008 .

[6]  George Kuczera,et al.  Bayesian analysis of input uncertainty in hydrological modeling: 2. Application , 2006 .

[7]  Keith Beven,et al.  A manifesto for the equifinality thesis , 2006 .

[8]  Emmanouil N. Anagnostou,et al.  A Statistical Approach to Ground Radar-Rainfall Estimation , 2005 .

[9]  S. Sorooshian,et al.  Stochastic parameter estimation procedures for hydrologie rainfall‐runoff models: Correlated and heteroscedastic error cases , 1980 .

[10]  Jery R. Stedinger,et al.  Appraisal of the generalized likelihood uncertainty estimation (GLUE) method , 2008 .

[11]  Keith Beven,et al.  Data‐based modelling of runoff and chemical tracer concentrations in the Haute‐Mentue research catchment (Switzerland) , 2005 .

[12]  K. Bevenb,et al.  Use of spatially distributed water table observations to constrain uncertainty in a rainfall – runoff model , 1998 .

[13]  Misgana K. Muleta,et al.  Sensitivity and uncertainty analysis coupled with automatic calibration for a distributed watershed model , 2005 .

[14]  Alberto Montanari,et al.  What do we mean by ‘uncertainty’? The need for a consistent wording about uncertainty assessment in hydrology , 2007 .

[15]  Keith Beven,et al.  Changing ideas in hydrology — The case of physically-based models , 1989 .

[16]  Cajo J. F. ter Braak,et al.  Treatment of input uncertainty in hydrologic modeling: Doing hydrology backward with Markov chain Monte Carlo simulation , 2008 .

[17]  K. Beven,et al.  Bayesian Estimation of Uncertainty in Runoff Prediction and the Value of Data: An Application of the GLUE Approach , 1996 .

[18]  Hugo A. Loáiciga,et al.  Distributed hydrological modelling in California semi-arid shrublands: MIKE SHE model calibration and uncertainty estimation , 2006 .

[19]  Ashish Sharma,et al.  A comparative study of Markov chain Monte Carlo methods for conceptual rainfall‐runoff modeling , 2004 .

[20]  John R. Williams,et al.  SENSITIVITY AND UNCERTAINTY ANALYSES OF CROP YIELDS AND SOIL ORGANIC CARBON SIMULATED WITH EPIC , 2005 .

[21]  Soroosh Sorooshian,et al.  A framework for development and application of hydrological models , 2001, Hydrology and Earth System Sciences.

[22]  George Kuczera,et al.  Bayesian analysis of input uncertainty in hydrological modeling: 1. Theory , 2006 .

[23]  Keith Beven,et al.  Prophecy, reality and uncertainty in distributed hydrological modelling , 1993 .

[24]  Keith Beven,et al.  On the sensitivity of soil-vegetation-atmosphere transfer (SVAT) schemes: equifinality and the problem of robust calibration , 1997 .

[25]  L. Gottschalk,et al.  Bayesian estimation of parameters in a regional hydrological model , 2002 .

[26]  Keith Beven,et al.  Using CFD in a GLUE framework to model the flow and dispersion characteristics of a natural fluvial dead zone , 2001 .

[27]  Keith Beven,et al.  Stochastic capture zone delineation within the generalized likelihood uncertainty estimation methodology: Conditioning on head observations , 2001 .

[28]  S. Sorooshian,et al.  Application of stochastic parameter optimization to the Sacramento Soil Moisture Accounting model , 2006, Journal of Hydrology.

[29]  Keith Beven,et al.  Implications of model uncertainty for the mapping of hillslope‐scale soil erosion predictions , 2001 .

[30]  B. Bates,et al.  A Markov Chain Monte Carlo Scheme for parameter estimation and inference in conceptual rainfall‐runoff modeling , 2001 .

[31]  Henrik Madsen,et al.  Generalized likelihood uncertainty estimation (GLUE) using adaptive Markov Chain Monte Carlo sampling , 2008 .

[32]  G. Villarini,et al.  Empirically-based modeling of spatial sampling uncertainties associated with rainfall measurements by rain gauges , 2008 .

[33]  Lars-Christer Lundin,et al.  Equifinality and sensitivity in freezing and thawing simulations of laboratory and in situ data , 2006 .

[34]  George Kuczera,et al.  Monte Carlo assessment of parameter uncertainty in conceptual catchment models: the Metropolis algorithm , 1998 .

[35]  Jacob Birk Jensen Parameter and Uncertainty Estimation in Groundwater Modelling , 2003 .

[36]  S. Sorooshian,et al.  Effective and efficient global optimization for conceptual rainfall‐runoff models , 1992 .

[37]  D. Higdon,et al.  Accelerating Markov Chain Monte Carlo Simulation by Differential Evolution with Self-Adaptive Randomized Subspace Sampling , 2009 .

[38]  Paul D. Bates,et al.  Assessing the uncertainty in distributed model predictions using observed binary pattern information within GLUE , 2002 .

[39]  Steen Christensen A synthetic groundwater modelling study of the accuracy of GLUE uncertainty intervals , 2002 .

[40]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[41]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[42]  P. Mantovan,et al.  Hydrological forecasting uncertainty assessment: Incoherence of the GLUE methodology , 2006 .

[43]  Alberto Montanari,et al.  Large sample behaviors of the generalized likelihood uncertainty estimation (GLUE) in assessing the uncertainty of rainfall‐runoff simulations , 2005 .

[44]  Yuqiong Liu,et al.  Uncertainty in hydrologic modeling: Toward an integrated data assimilation framework , 2007 .

[45]  Keith Beven,et al.  The future of distributed models: model calibration and uncertainty prediction. , 1992 .

[46]  Henrik Madsen,et al.  Including prior information in the estimation of effective soil parameters in unsaturated zone modelling , 2004 .