Ensemble evaluation of hydrological model hypotheses

It is demonstrated for the first time how model parameter, structural and data uncertainties can be accounted for explicitly and simultaneously within the Generalized Likelihood Uncertainty Estimation (GLUE) methodology. As an example application, 72 variants of a single soil moisture accounting store are tested as simplified hypotheses of runoff generation at six experimental grassland field-scale lysimeters through model rejection and a novel diagnostic scheme. The fields, designed as replicates, exhibit different hydrological behaviors which yield different model performances. For fields with low initial discharge levels at the beginning of events, the conceptual stores considered reach their limit of applicability. Conversely, one of the fields yielding more discharge than the others, but having larger data gaps, allows for greater flexibility in the choice of model structures. As a model learning exercise, the study points to a “leaking” of the fields not evident from previous field experiments. It is discussed how understanding observational uncertainties and incorporating these into model diagnostics can help appreciate the scale of model structural error.

[1]  Robert J. Abrahart,et al.  Multi-model data fusion for river flow forecasting: an evaluation of six alternative methods based on two contrasting catchments , 2002 .

[2]  George Kuczera,et al.  Calibration of conceptual hydrological models revisited: 1. Overcoming numerical artefacts , 2006 .

[3]  K. Beven,et al.  Cascading model uncertainty from medium range weather forecasts (10 days) through a rainfall-runoff model to flood inundation predictions within the European Flood Forecasting System (EFFS) , 2005 .

[4]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[5]  George Kuczera,et al.  Bayesian analysis of input uncertainty in hydrological modeling: 1. Theory , 2006 .

[6]  Wales,et al.  Soil classification for England and Wales : (higher categories) , 1980 .

[7]  Robert J. Abrahart,et al.  Multi-model data fusion for hydrological forecasting , 2001 .

[8]  Keith Beven,et al.  Influence of uncertain boundary conditions and model structure on flood inundation predictions. , 2006 .

[9]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[10]  Keith Beven,et al.  Detection of structural inadequacy in process‐based hydrological models: A particle‐filtering approach , 2008 .

[11]  Peter C. Young,et al.  Downward Approach to Hydrological Model Development , 2006 .

[12]  Henrik Madsen,et al.  An evaluation of the impact of model structure on hydrological modelling uncertainty for streamflow simulation , 2004 .

[13]  Ming Ye,et al.  Maximum likelihood Bayesian averaging of spatial variability models in unsaturated fractured tuff , 2003 .

[14]  S. Sorooshian,et al.  Multi-model ensemble hydrologic prediction using Bayesian model averaging , 2007 .

[15]  V. T. Chow Open-channel hydraulics , 1959 .

[16]  A. Shamseldin,et al.  Methods for combining the outputs of different rainfall–runoff models , 1997 .

[17]  E. Mückenhausen Avery, B.W.: Soil Classification for England and Wales (Higher Categories). Soil Survey, Technical Monograph No. 14, Rothamsted Experimental Station, Harpenden/England 1980. Preis£ 1,— , 1981 .

[18]  David Huard,et al.  Calibration of hydrological model GR2M using Bayesian uncertainty analysis , 2008 .

[19]  Thorsten Wagener,et al.  Numerical and visual evaluation of hydrological and environmental models using the Monte Carlo analysis toolbox , 2007, Environ. Model. Softw..

[20]  K Beven,et al.  On the concept of model structural error. , 2005, Water science and technology : a journal of the International Association on Water Pollution Research.

[21]  Cajo J. F. ter Braak,et al.  Treatment of input uncertainty in hydrologic modeling: Doing hydrology backward with Markov chain Monte Carlo simulation , 2008 .

[22]  David Huard,et al.  A Bayesian perspective on input uncertainty in model calibration: Application to hydrological model “abc” , 2006 .

[23]  George Kuczera,et al.  Bayesian analysis of input uncertainty in hydrological modeling: 2. Application , 2006 .

[24]  Stan Openshaw,et al.  A hybrid multi-model approach to river level forecasting , 2000 .

[25]  M. B. Beck,et al.  Water quality modeling: A review of the analysis of uncertainty , 1987 .

[26]  Bruce A. Robinson,et al.  Treatment of uncertainty using ensemble methods: Comparison of sequential data assimilation and Bayesian model averaging , 2007 .

[27]  Keith Beven,et al.  Calibration of watershed models , 2003 .

[28]  Qingyun Duan,et al.  An integrated hydrologic Bayesian multimodel combination framework: Confronting input, parameter, and model structural uncertainty in hydrologic prediction , 2006 .

[29]  S. P. Neuman,et al.  Maximum likelihood Bayesian averaging of uncertain model predictions , 2003 .

[30]  Martyn P. Clark,et al.  Multi‐objective calibration of forecast ensembles using Bayesian model averaging , 2006 .

[31]  Martyn P. Clark,et al.  Framework for Understanding Structural Errors (FUSE): A modular framework to diagnose differences between hydrological models , 2008 .

[32]  K. Beven,et al.  Bayesian Estimation of Uncertainty in Runoff Prediction and the Value of Data: An Application of the GLUE Approach , 1996 .

[33]  Keith Beven,et al.  Detecting the effects of spatial variability of rainfall on hydrological modelling within an uncertainty analysis framework , 2009 .

[34]  A. Shamseldin,et al.  A real-time combination method for the outputs of different rainfall-runoff models , 1999 .

[35]  Kellie B. Vaché,et al.  A process‐based rejectionist framework for evaluating catchment runoff model structure , 2006 .

[36]  Jim Freer,et al.  Towards a limits of acceptability approach to the calibration of hydrological models : Extending observation error , 2009 .

[37]  M. Sivapalan,et al.  Process controls of water balance variability in a large semi-arid catchment: downward approach to hydrological model development , 2001 .

[38]  Asaad Y. Shamseldin,et al.  A non-linear combination of the forecasts of rainfall-runoff models by the first-order Takagi–Sugeno fuzzy system , 2001 .

[39]  R. Daren Harmel,et al.  Consideration of measurement uncertainty in the evaluation of goodness-of-fit in hydrologic and water quality modeling , 2007 .

[40]  Soroosh Sorooshian,et al.  A framework for development and application of hydrological models , 2001, Hydrology and Earth System Sciences.

[41]  Keith Beven,et al.  The future of distributed models: model calibration and uncertainty prediction. , 1992 .

[42]  J. Vrugt,et al.  On the value of soil moisture measurements in vadose zone hydrology: A review , 2008 .

[43]  D. Kavetski,et al.  Towards a Bayesian total error analysis of conceptual rainfall-runoff models: Characterising model error using storm-dependent parameters , 2006 .

[44]  Keith Beven,et al.  A manifesto for the equifinality thesis , 2006 .

[45]  David Anderson,et al.  Multimodel Ranking and Inference in Ground Water Modeling , 2004, Ground water.

[46]  S. Sorooshian,et al.  A Shuffled Complex Evolution Metropolis algorithm for optimization and uncertainty assessment of hydrologic model parameters , 2002 .

[47]  Kuolin Hsu,et al.  A sequential Bayesian approach for hydrologic model selection and prediction , 2009 .

[48]  J. E. Freera,et al.  Constraining dynamic TOPMODEL responses for imprecise water table information using fuzzy rule based performance measures , 2004 .

[49]  C. Diks,et al.  Improved treatment of uncertainty in hydrologic modeling: Combining the strengths of global optimization and data assimilation , 2005 .

[50]  Peter C. Young,et al.  Data-based mechanistic modelling and the rainfall-flow non-linearity. , 1994 .

[51]  Neil McIntyre,et al.  Towards reduced uncertainty in conceptual rainfall‐runoff modelling: dynamic identifiability analysis , 2003 .

[52]  Ashish Sharma,et al.  Modeling the catchment via mixtures: Issues of model specification and validation , 2005 .

[53]  Dong-Jun Seo,et al.  Towards the characterization of streamflow simulation uncertainty through multimodel ensembles , 2004 .

[54]  L. A. Richards Capillary conduction of liquids through porous mediums , 1931 .

[55]  C. Priestley,et al.  On the Assessment of Surface Heat Flux and Evaporation Using Large-Scale Parameters , 1972 .

[56]  E. A. Garwood,et al.  Hydrological consequences of artificial drainage of grassland , 1991 .

[57]  S. Sorooshian,et al.  Multimodel Combination Techniques for Analysis of Hydrological Simulations: Application to Distributed Model Intercomparison Project Results , 2006 .

[58]  Soroosh Sorooshian,et al.  Toward improved calibration of hydrologic models: Combining the strengths of manual and automatic methods , 2000 .

[59]  I. R. Johnson,et al.  Plant and Crop Modelling: A Mathematical Approach to Plant and Crop Physiology , 1990 .

[60]  V. Klemeš Conceptualization and scale in hydrology , 1983 .