Combined Estimation of Hydrogeologic Conceptual Model and Parameter Uncertainty

The objective of the research described in this report is the development and application of a methodology for comprehensively assessing the hydrogeologic uncertainties involved in dose assessment, including uncertainties associated with conceptual models, parameters, and scenarios. This report describes and applies a statistical method to quantitatively estimate the combined uncertainty in model predictions arising from conceptual model and parameter uncertainties. The method relies on model averaging to combine the predictions of a set of alternative models. Implementation is driven by the available data. When there is minimal site-specific data the method can be carried out with prior parameter estimates based on generic data and subjective prior model probabilities. For sites with observations of system behavior (and optionally data characterizing model parameters), the method uses model calibration to update the prior parameter estimates and model probabilities based on the correspondence between model predictions and site observations. The set of model alternatives can contain both simplified and complex models, with the requirement that all models be based on the same set of data. The method was applied to the geostatistical modeling of air permeability at a fractured rock site. Seven alternative variogram models of log air permeability were considered to represent data from single-hole pneumatic injection tests in six boreholes at the site. Unbiased maximum likelihood estimates of variogram and drift parameters were obtained for each model. Standard information criteria provided an ambiguous ranking of the models, which would not justify selecting one of them and discarding all others as is commonly done in practice. Instead, some of the models were eliminated based on their negligibly small updated probabilities and the rest were used to project the measured log permeabilities by kriging onto a rock volume containing the six boreholes. These four projections, and associated kriging variances, were averaged using the posterior model probabilities as weights. Finally, cross-validation was conducted by eliminating from consideration all data from one borehole at a time, repeating the above process, and comparing the predictive capability of the model-averaged result with that of each individual model. Using two quantitative measures of comparison, the model-averaged result was superior to any individual geostatistical model of log permeability considered.

[1]  Shlomo P. Neuman,et al.  Stochastic continuum modeling of flow and transport in a crystalline rock mass: Fanay-Augères, France, revisited , 2003 .

[2]  N. Siu,et al.  Proceedings of workshop I in advanced topics in risk and reliability analysis. Model uncertainty: Its characterization and quantification , 1994 .

[3]  A. Sahuquillo,et al.  Stochastic simulation of transmissivity fields conditional to both transmissivity and piezometric data—I. Theory , 1997 .

[4]  Curtis M. Oldenburg,et al.  Linear and Monte Carlo uncertainty analysis for subsurface contaminant transport simulation , 1997 .

[5]  S. P. Neuman,et al.  Validation studies for assessing unsaturated flow and transport through fractured rock , 1994 .

[6]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[7]  James A. Davis,et al.  Surface ionization and complexation at the oxide/water interface II. Surface properties of amorphous iron oxyhydroxide and adsorption of metal ions , 1978 .

[8]  H. Akaike A new look at the statistical model identification , 1974 .

[9]  J. Ware,et al.  Applications of Statistics , 1978 .

[10]  Enrico Zio,et al.  Two methods for the structured assessment of model uncertainty by experts in performance assessments of radioactive waste repositories , 1996 .

[11]  E. Poeter,et al.  Documentation of UCODE; a computer code for universal inverse modeling , 1998 .

[12]  Harry F. Martz,et al.  On the meaning of probability , 1988 .

[13]  William H. Press,et al.  Numerical Recipes in Fortran 77: The Art of Scientific Computing 2nd Editionn - Volume 1 of Fortran Numerical Recipes , 1992 .

[14]  Ming Ye,et al.  Maximum likelihood Bayesian averaging of spatial variability models in unsaturated fractured tuff , 2003 .

[15]  Robert L. Winkler,et al.  Uncertainty in probabilistic risk assessment , 1996 .

[16]  Clayton V. Deutsch,et al.  GSLIB: Geostatistical Software Library and User's Guide , 1993 .

[17]  D. Madigan,et al.  Bayesian Model Averaging in Proportional Hazard Models: Assessing the Risk of a Stroke , 1997 .

[18]  James A. Davis,et al.  Pb2+ and Zn2+ adsorption by a natural aluminum- and iron-bearing surface coating on an aquifer sand , 1995 .

[19]  D. Kent,et al.  Application of the Surface Complexation Concept to Complex Mineral Assemblages , 1998 .

[20]  Jon C. Helton,et al.  Guest editorial: treatment of aleatory and epistemic uncertainty in performance assessments for complex systems , 1996 .

[21]  Harald Kunstmann,et al.  Conditional first‐order second‐moment method and its application to the quantification of uncertainty in groundwater modeling , 2002 .

[22]  S. P. Neuman,et al.  Simulation of Large-Scale Field Infiltration Experiments Using a Hierarchy of Models Based on Public, Generic, and Site Data , 2003 .

[23]  D. Madigan,et al.  Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window , 1994 .

[24]  Philip D. Meyer,et al.  Information on Hydrologic Conceptual Models, Parameters, Uncertainty Analysis, and Data Sources for Dose Assessments at Decommissioning Sites , 2000 .

[25]  Velimir Valentinov. Vesselinov Numerical inverse interpretation of pneumatic tests in unsaturated fractured tuffs at the Apache Leap Research Site , 2000 .

[26]  Bilal M. Ayyub,et al.  Probability, Statistics, and Reliability for Engineers and Scientists , 2003 .

[27]  D. F. Williams,et al.  AN 8 , 1999 .

[28]  Jon C. Helton,et al.  Treatment of Uncertainty in Performance Assessments for Complex Systems , 1994 .

[29]  James O. Berger,et al.  Ockham's Razor and Bayesian Analysis , 1992 .

[30]  Jesús Carrera,et al.  Subsurface Flow and Transport: Formulations and computational issues of the inversion of random fields , 1997 .

[31]  Philip D. Meyer,et al.  Uncertainty analyses of infiltration and subsurface flow and transport for SDMP sites , 1997 .

[32]  C. M. Kishtawal,et al.  Multimodel Ensemble Forecasts for Weather and Seasonal Climate , 2000 .

[33]  Jon C. Helton,et al.  Uncertainty and sensitivity analysis techniques for use in performance assessment for radioactive waste disposal , 1993 .

[34]  L. Abramson The philosophical basis for the use of probabilities in safety assessments , 1988 .

[35]  Hirotugu Akaike,et al.  On entropy maximization principle , 1977 .

[36]  Robert Blair Vocci Geology , 1882, Nature.

[37]  James A. Davis,et al.  Surface ionization and complexation at the oxide/water interface. 3. Adsorption of anions , 1980 .

[38]  E. Hannan The Estimation of the Order of an ARMA Process , 1980 .

[39]  M. C. Hill Methods and guidelines for effective model calibration; with application to UCODE, a computer code for universal inverse modeling, and MODFLOWP, a computer code for inverse modeling with MODFLOW , 1998 .

[40]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[41]  S. Isukapalli,et al.  Stochastic Response Surface Methods (SRSMs) for Uncertainty Propagation: Application to Environmental and Biological Systems , 1998, Risk analysis : an official publication of the Society for Risk Analysis.

[42]  J. Leckie,et al.  Surface ionization and complexation at the oxide/water interface , 1978 .

[43]  Roberto T. Pabalan,et al.  Role of Radionuclide Sorption in High-Level Waste Performance Assessment: Approaches for the Abstraction of Detailed Models , 2002 .

[44]  Leslie Smith,et al.  A Bayesian Approach to the quantification of the effect of model error on the predictions of groundwater models , 2001 .

[45]  Michael D. McKay,et al.  Evaluating Prediction Uncertainty , 1995 .

[46]  Robert M. Holt,et al.  Spatial bias in field‐estimated unsaturated hydraulic properties , 2002 .

[47]  S. P. Neuman,et al.  Estimation of aquifer parameters under transient and steady-state conditions: 2 , 1986 .

[48]  D. A. Zimmerman,et al.  A comparison of seven geostatistically based inverse approaches to estimate transmissivities for modeling advective transport by groundwater flow , 1998 .

[49]  I. Langmuir THE ADSORPTION OF GASES ON PLANE SURFACES OF GLASS, MICA AND PLATINUM. , 1918 .

[50]  F. Morel,et al.  Surface Complexation Modeling: Hydrous Ferric Oxide , 1990 .

[51]  Adrian E. Raftery,et al.  Bayesian Model Selection in Structural Equation Models , 1992 .

[52]  N. Cressie Geostatistical analysis of spatial data , 1991 .

[53]  Emanuele Borgonovo,et al.  Comparison of global sensitivity analysis techniques and importance measures in PSA , 2003, Reliab. Eng. Syst. Saf..

[54]  Thomas D. Waite,et al.  Approaches to modelling uranium(VI) adsorption on natural mineral assemblages , 2000 .

[55]  Philip D. Meyer,et al.  Hydrologic Uncertainty Assessment for Decommissioning Sites: Hypothetical Test Case Applications , 2001 .

[56]  Peter K. Kitanidis,et al.  Analysis of the Spatial Structure of Properties of Selected Aquifers , 1985 .

[57]  S. P. Neuman,et al.  estimation of spatial covariance structures by adjoint state maximum likelihood cross validation: 1. Theory , 1989 .

[58]  Paul W. Schindler,et al.  Ligand properties of surface silanol groups. I. surface complex formation with Fe3+, Cu2+, Cd2+, and Pb2+ , 1976 .

[59]  Joseph A. C. Delaney Sensitivity analysis , 2018, The African Continental Free Trade Area: Economic and Distributional Effects.

[60]  S. P. Neuman,et al.  Estimation of Aquifer Parameters Under Transient and Steady State Conditions: 1. Maximum Likelihood Method Incorporating Prior Information , 1986 .

[61]  A. J. Desbarats,et al.  Subsurface Flow and Transport: A Stochastic Approach , 1998 .

[62]  Herbert Freundlich,et al.  Colloid and capillary chemistry , 1922 .

[63]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[64]  M. I. Sheppard,et al.  Default soil solid/liquid partition coefficients, Kds, for four major soil types: a compendium. , 1990, Health physics.

[65]  S. P. Neuman,et al.  A comprehensive strategy of hydrogeologic modeling and uncertainty analysis for nuclear facilities a , 2003 .

[66]  Adrian E. Raftery,et al.  Accounting for Model Uncertainty in Survival Analysis Improves Predictive Performance , 1995 .

[67]  S. P. Neuman,et al.  Estimation of Aquifer Parameters Under Transient and Steady State Conditions: 3. Application to Synthetic and Field Data , 1986 .

[68]  John Doherty,et al.  Ground Water Model Calibration Using Pilot Points and Regularization , 2003, Ground water.

[69]  Shlomo P. Neuman,et al.  Estimation of spatial covariance structures by adjoint state maximum likelihood cross validation: 2. Synthetic experiments , 1989 .

[70]  Stefano Tarantola,et al.  Sensitivity Analysis as an Ingredient of Modeling , 2000 .

[71]  Keith Beven,et al.  Equifinality, data assimilation, and uncertainty estimation in mechanistic modelling of complex environmental systems using the GLUE methodology , 2001 .

[72]  David Draper,et al.  Assessment and Propagation of Model Uncertainty , 2011 .

[73]  Alberto Guadagnini,et al.  Conditioning steady-state mean stochastic flow equations on head and hydraulic conductivity measurements , 2001 .

[74]  R. Taplin Robust Likelihood Calculation for Time Series , 1993 .

[75]  Rangasami L. Kashyap,et al.  Optimal Choice of AR and MA Parts in Autoregressive Moving Average Models , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[76]  Paul D. Thorne,et al.  Uncertainty Analysis Framework - Hanford Site-Wide Groundwater Flow and Transport Model , 2001 .

[77]  S. P. Neuman,et al.  Summary of air permeability data from single-hole injection tests in unsaturated fractured tuffs at the Apache Leap Research Site: Results of steady-state test interpretation , 1996 .

[78]  R. T. Kennedy Nuclear Regulatory Commission and its regulatory role , 1977 .

[79]  S. P. Neuman,et al.  Analysis of nonintrinsic spatial variability by residual kriging with application to regional groundwater levels , 1984 .

[80]  Alberto Guadagnini,et al.  Conditioning mean steady state flow on hydraulic head and conductivity through geostatistical inversion , 2003 .

[81]  S. P. Neuman,et al.  Accounting for conceptual model uncertainty via maximum likelihood Bayesian model averaging , 2002 .

[82]  Mary C. Hill,et al.  Methods and Guidelines for Effective Model Calibration , 2000 .

[83]  Huifang Xu,et al.  Iron oxide coatings on sand grains from the Atlantic coastal plain: High-resolution transmission electron microscopy characterization , 2001 .