On the colour and spin of epistemic error (and what we might do about it)

Disinformation as a result of epistemic error is an issue in hydrological modelling. In particular the way in which the colour in model residuals resulting from epistemic errors should be expected to be non-stationary means that it is difficult to justify the spin that the structure of residuals can be properly represented by statistical likelihood functions. To do so would be to greatly overestimate the information content in a set of calibration data and increase the possibility of both Type I and Type II errors. Some principles of trying to identify periods of disinformative data prior to evaluation of a model structure of interest, are discussed. An example demonstrates the effect on the estimated parameter values of a hydrological model.

[1]  Keith Beven,et al.  Regionalization as a learning process , 2009 .

[2]  T. Bayes.  An essay towards solving a problem in the doctrine of chances , 2003 .

[3]  Thibault Mathevet,et al.  What is really undermining hydrologic science today? , 2007 .

[4]  Michael Goldstein,et al.  Probabilistic Formulations for Transferring Inferences from Mathematical Models to Physical Systems , 2005, SIAM J. Sci. Comput..

[5]  Keith Beven,et al.  Robert E. Horton's perceptual model of infiltration processes , 2004 .

[6]  Jeroen P. van der Sluijs,et al.  A framework for dealing with uncertainty due to model structure error , 2004 .

[7]  K. Beven.  Towards a coherent philosophy for modelling the environment , 2002, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[8]  Keith Beven,et al.  Informal likelihood measures in model assessment: Theoretic development and investigation , 2008 .

[9]  Keith Beven,et al.  Using interactive recession curve analysis to specify a general catchment storage model , 1997 .

[10]  Keith Beven,et al.  So just why would a modeller choose to be incoherent , 2008 .

[11]  George Kuczera,et al.  Critical evaluation of parameter consistency and predictive uncertainty in hydrological modeling: A case study using Bayesian total error analysis , 2009 .

[12]  M. Sklash,et al.  The Role Of Groundwater In Storm Runoff , 1979 .

[13]  Yuqiong Liu,et al.  Reconciling theory with observations: elements of a diagnostic approach to model evaluation , 2008 .

[14]  F. R. Hall.  Base‐Flow Recessions—A Review , 1968 .

[15]  G. Hornberger,et al.  Approach to the preliminary analysis of environmental systems , 1981 .

[16]  Murugesu Sivapalan,et al.  Conservation equations governing hillslope responses: Exploring the physical basis of water balance , 2000 .

[17]  Joseph Y. Halpern.  Reasoning about uncertainty , 2003 .

[18]  Cajo J. F. ter Braak,et al.  Equifinality of formal (DREAM) and informal (GLUE) Bayesian approaches in hydrologic modeling? , 2009 .

[19]  Keith Beven,et al.  Comment on "Hydrological forecasting uncertainty assessment: incoherence of the GLUE methodology" by Pietro Mantovan and Ezio Todini , 2007 .

[20]  Keith Beven.  Robert Horton’s perceptual model of infiltration. , 2004 .

[21]  Jery R. Stedinger,et al.  Appraisal of the generalized likelihood uncertainty estimation (GLUE) method , 2008 .

[22]  Keith Beven,et al.  Preferential flows and travel time distributions: defining adequate hypothesis tests for hydrological process models , 2010 .

[23]  K. Beven,et al.  Bayesian Estimation of Uncertainty in Runoff Prediction and the Value of Data: An Application of the GLUE Approach , 1996 .

[24]  Keith Beven,et al.  Stage‐discharge uncertainty derived with a non‐stationary rating curve in the Choluteca River, Honduras , 2011 .

[25]  Jeremy E. Oakley,et al.  Probability is perfect, but we can't elicit it perfectly , 2004, Reliab. Eng. Syst. Saf..

[26]  Neil McIntyre,et al.  Towards reduced uncertainty in conceptual rainfall‐runoff modelling: dynamic identifiability analysis , 2003 .

[27]  K. Beven.  Environmental Modelling , 2007 .

[28]  K. Loague,et al.  Simulating hydrological response for the R‐5 catchment: comparison of two models and the impact of the roads , 2002 .

[29]  Keith Beven,et al.  The future of distributed models: model calibration and uncertainty prediction. , 1992 .

[30]  W. G. Gray,et al.  Coupled equations for mass and momentum balance in a stream network: theoretical derivation and computational experiments , 2001, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[31]  Keith Beven,et al.  Calibration of hydrological models using flow-duration curves , 2010 .

[32]  Keith Loague,et al.  Further testing of the Integrated Hydrology Model (InHM): event‐based simulations for a small rangeland catchment located near Chickasha, Oklahoma , 2005 .

[33]  P. Mantovan,et al.  Hydrological forecasting uncertainty assessment: Incoherence of the GLUE methodology , 2006 .

[34]  Jim Freer,et al.  Towards a limits of acceptability approach to the calibration of hydrological models : Extending observation error , 2009 .

[35]  K. Beven,et al.  Nonparametric direct mapping of rainfall‐runoff relationships: An alternative approach to data analysis and modeling? , 2004 .

[36]  Jaap Schellekens,et al.  Modelling of hydrological responses: the representative elementary watershed approach as an alternative blueprint for watershed modelling , 2003 .

[37]  George Kuczera,et al.  Understanding predictive uncertainty in hydrologic modeling: The challenge of identifying input and structural errors , 2010 .

[38]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[39]  Bruce A. Robinson,et al.  Response to comment by Keith Beven on “Equifinality of formal (DREAM) and informal (GLUE) Bayesian approaches in hydrologic modeling?” , 2009 .

[40]  J. Kirchner,et al.  Catchment-scale advection and dispersion as a mechanism for fractal scaling in stream tracer concentrations , 2001 .

[41]  Keith Beven,et al.  Modelling the chloride signal at Plynlimon, Wales, using a modified dynamic TOPMODEL incorporating conservative chemical mixing (with uncertainty) , 2007 .

[42]  L. Tallaksen.  A review of baseflow recession analysis , 1995 .

[43]  K Beven,et al.  On the concept of model structural error. , 2005, Water science and technology : a journal of the International Association on Water Pollution Research.

[44]  D. Kavetski,et al.  Towards a Bayesian total error analysis of conceptual rainfall-runoff models: Characterising model error using storm-dependent parameters , 2006 .

[45]  Keith Beven,et al.  A manifesto for the equifinality thesis , 2006 .

[46]  K. Beven,et al.  Comment on “Equifinality of formal (DREAM) and informal (GLUE) Bayesian approaches in hydrologic modeling?” by Jasper A. Vrugt, Cajo J. F. ter Braak, Hoshin V. Gupta and Bruce A. Robinson , 2009 .

[47]  Keith Beven,et al.  On red herrings and real herrings: disinformation and information in hydrological inference , 2011 .

[48]  S. Sorooshian,et al.  Stochastic parameter estimation procedures for hydrologie rainfall‐runoff models: Correlated and heteroscedastic error cases , 1980 .

[49]  Chong-Yu Xu,et al.  Uncertainty estimates by Bayesian method with likelihood of AR (1) plus Normal model and AR (1) plus Multi-Normal model in different time-scales hydrological models , 2011 .

[50]  Albert Tarantola,et al.  Inverse problem theory - and methods for model parameter estimation , 2004 .