A synthetic groundwater modelling study of the accuracy of GLUE uncertainty intervals

Synthetic groundwater flow models with one unknown parameter, the average log transmissivity of the flow domain, and with Gaussian log-transmissivity error structure were used to study the nature and the accuracy of Generalized Likelihood Uncertainty Estimation (GLUE) intervals. The uniform prior distribution of log10 transmissivities was sampled uniformly and 1000 values per log10-transmissivity cycle were required to produce unbiased GLUE results. Because the errors in hydraulic head resulting from the log-transmissivity errors are known to be Gaussian for a linear model for heads, the Gaussian likelihood function was used as the GLUE goodness-of-fit function in most cases studied. The GLUE interval computed for the hydraulic head at different locations within the domain has the characteristics of a confidence interval for the hydraulic heads computed using the spatial average log transmissivity. The GLUE interval does not have the characteristics of a prediction interval, which is a probability interval for an uncertain observation of some variable such as the hydraulic head. The goodness-of-fit function can be corrected so that the resulting GLUE interval has the characteristics of a prediction interval. However, neither the original nor the corrected GLUE interval account for the uncertainty caused by small-scale model errors, which is always present in practical groundwater flow modelling. It is therefore concluded that one should be careful with using the GLUE interval to evaluate the validity of a model's structure. The structure may be valid even though observations fall significantly outside the GLUE interval if the observations are uncertain and the goodness-of-fit function is not corrected to account for this, or if small-scale model error is significant. If small-scale model error does not significantly bias model predictions, the predictions will be useful although uncertain. Small-scale model error did not bias the predictions in the examples studied here except near a strong sink. Changing the goodness-of-fit function from the Gaussian likelihood function to a similar but different function made the resulting GLUE intervals very inaccurate. Changing to a third function based on a fitted model rejection value produced results that were somewhat better than those obtained with the Gaussian likelihood function. However, the results were sensitive to the model rejection value, which in the ideal case should be adjusted for each predicted variable individually. Thus, the third function is not attractive for practical applications with the GLUE methodology.

[1]  Steen Christensen,et al.  Evaluation of prediction intervals for expressing uncertainties in groundwater flow model predictions , 1999 .

[2]  Keith Beven,et al.  Implications of model uncertainty for the mapping of hillslope‐scale soil erosion predictions , 2001 .

[3]  Jacob Birk Jensen Parameter and Uncertainty Estimation in Groundwater Modelling , 2003 .

[4]  K. Beven,et al.  Bayesian Estimation of Uncertainty in Runoff Prediction and the Value of Data: An Application of the GLUE Approach , 1996 .

[5]  Alberto Guadagnini,et al.  Nonlocal and localized analyses of conditional mean steady state flow in bounded, randomly nonuniform domains: 2. Computational examples , 1999 .

[6]  Keith Beven,et al.  Using CFD in a GLUE framework to model the flow and dispersion characteristics of a natural fluvial dead zone , 2001 .

[7]  Keith Beven,et al.  The future of distributed models: model calibration and uncertainty prediction. , 1992 .

[8]  K. Bevenb,et al.  Use of spatially distributed water table observations to constrain uncertainty in a rainfall – runoff model , 1998 .

[9]  Keith Beven,et al.  Stochastic capture zone delineation within the generalized likelihood uncertainty estimation methodology: Conditioning on head observations , 2001 .

[10]  Keith Beven,et al.  Equifinality, data assimilation, and uncertainty estimation in mechanistic modelling of complex environmental systems using the GLUE methodology , 2001 .

[11]  Steen Christensen,et al.  Prediction of Regional Ground Water Flow to Streams , 1998 .

[12]  Steen Christensen,et al.  On the Strategy of Estimating Regional‐Scale Transmissivity Fields , 1997 .

[13]  Steen Christensen,et al.  Experience gained in testing a theory for modelling groundwater flow in heterogeneous media , 2002 .

[14]  R. L. Cooley A theory for modeling ground-water flow in heterogeneous media , 2004 .

[15]  Peter K. Kitanidis,et al.  Introduction to geostatistics , 1997 .