Model calibration/parameter estimation techniques and conceptual model error

In a modeling exercise, errors in the model structure cannot be avoided because they arise from our limited capability to exactly describe mathematically the complexity of a physical system. The effect of model error on model predictions is not random but systematic, therefore, it does not necessarily have any probabilistic properties that can be easily exploited in the construction of a model performance criterion. The effect of model error varies in both space and time. It is also different for the flow and the solute transport components of a groundwater model and may have a significant impact on parameter estimation, uncertainty analyses and risk assessments. Structural errors may result in a misleading evaluation of prediction uncertainty associated with parameter error because model sensitivity to uncertain parameters may be quite different than that of the correct model. A substantial model error may significantly degrade the usefulness of model calibration and the reliability of model predictions because parameter estimates are forced to compensate for the existing structural errors. Incorrect uncertainty analyses and estimated parameters that have little value in predictive modeling could potentially lead to an engineering design failure or to a selection of a management strategy that involves unnecessary expenditures. A complementary to classical inverse methods model calibration procedure is presented for assessing the uncertainty in parameter estimates associated with model error. This procedure is based on the concept of a per-datum calibration for capturing the spatial and temporal behavior of model error. A set of per-datum parameter estimates obtained by this new method defines a posterior parameter space that may be translated into a probabilistic description of model predictions. The resulted prediction uncertainty represents a reflection on model predictions of available information regarding the dependent variables and measures the level of confidence in model performance.

[1]  Keith Beven,et al.  Equifinality, data assimilation, and uncertainty estimation in mechanistic modelling of complex environmental systems using the GLUE methodology , 2001 .

[2]  Petros Gaganis,et al.  Evaluation of the uncertainty of groundwater model predictions associated with conceptual errors: A per-datum approach to model calibration , 2006 .

[3]  S. P. Neuman,et al.  Maximum likelihood Bayesian averaging of uncertain model predictions , 2003 .

[4]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[5]  William W.-G. Yeh,et al.  A proposed stepwise regression method for model structure identification , 1998 .

[6]  G. Dagan.  Flow and transport in porous formations , 1989 .

[7]  M. B. Beck,et al.  Water quality modeling: A review of the analysis of uncertainty , 1987 .

[8]  Richard L. Cooley,et al.  Incorporation of prior information on parameters into nonlinear regression groundwater flow models: 2. Applications , 1983 .

[9]  Petros Gaganis,et al.  Strontium-90 Migration to Water Wells at the Chernobyl Nuclear Power Plant: Re-evaluation of a Decision Model , 1998 .

[10]  Joel Massmann,et al.  Hydrogeological Decision Analysis: 1. A Framework , 1990 .

[11]  John D. Bredehoeft,et al.  Ground-water models cannot be validated , 1992 .

[12]  P. C. Shah,et al.  Reservoir History Matching by Bayesian Estimation , 1976 .

[13]  S. P. Neuman,et al.  Estimation of aquifer parameters under transient and steady-state conditions: 2 , 1986 .

[14]  D. A. Zimmerman,et al.  A comparison of seven geostatistically based inverse approaches to estimate transmissivities for modeling advective transport by groundwater flow , 1998 .

[15]  Richard L. Cooley,et al.  Incorporation of prior information on parameters into nonlinear regression groundwater flow models: 1. Theory , 1982 .

[16]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[17]  Richard L. Cooley,et al.  Nonlinear‐regression groundwater flow modeling of a deep regional aquifer system , 1986 .

[18]  S. P. Neuman,et al.  Estimation of Aquifer Parameters Under Transient and Steady State Conditions: 1. Maximum Likelihood Method Incorporating Prior Information , 1986 .

[19]  Leslie Smith,et al.  Accounting for model error in risk assessments: Alternatives to adopting a bias towards conservative risk estimates in decision models , 2008 .

[20]  Andres Alcolea,et al.  Inverse problem in hydrogeology , 2005 .

[21]  Leslie Smith,et al.  A Bayesian Approach to the quantification of the effect of model error on the predictions of groundwater models , 2001 .

[22]  Dennis McLaughlin,et al.  A stochastic approach to model validation , 1992 .

[23]  Ming Ye,et al.  Maximum likelihood Bayesian averaging of spatial variability models in unsaturated fractured tuff , 2003 .

[24]  D. McLaughlin,et al.  A Reassessment of the Groundwater Inverse Problem , 1996 .

[25]  S. P. Neuman.  Calibration of distributed parameter groundwater flow models viewed as a multiple‐objective decision process under uncertainty , 1973 .

[26]  C. Tiedeman,et al.  Effective Groundwater Model Calibration , 2007 .

[27]  Roger Beckie,et al.  Measurement Scale, Network Sampling Scale, and Groundwater Model Parameters , 1996 .

[28]  C. Tiedeman,et al.  Effective Groundwater Model Calibration: With Analysis of Data, Sensitivities, Predictions, and Uncertainty , 2007 .

[29]  Keith Beven,et al.  The future of distributed models: model calibration and uncertainty prediction. , 1992 .

[30]  E. Poeter,et al.  Inverse Models: A Necessary Next Step in Ground‐Water Modeling , 1997 .

[31]  Soroosh Sorooshian,et al.  Toward improved calibration of hydrologic models: Multiple and noncommensurable measures of information , 1998 .

[32]  John J. Warwick.  INTERPLAY BETWEEN PARAMETER UNCERTAINTY AND MODEL AGGREGATION ERROR , 1989 .

[33]  E. G. Vomvoris,et al.  A geostatistical approach to the inverse problem in groundwater modeling (steady state) and one‐dimensional simulations , 1983 .

[34]  Leslie Smith,et al.  Parameter space methods in joint parameter estimation for groundwater flow models , 1998 .