Bayesian Treatment of Model Uncertainty for Partially Applicable Models

This article discusses how analyst's or expert's beliefs on the credibility and quality of models can be assessed and incorporated into the uncertainty assessment of an unknown of interest. The proposed methodology is a specialization of the Bayesian framework for the assessment of model uncertainty presented in an earlier paper. This formalism treats models as sources of information in assessing the uncertainty of an unknown, and it allows the use of predictions from multiple models as well as experimental validation data about the models' performances. In this article, the methodology is extended to incorporate additional types of information about the model, namely, subjective information in terms of credibility of the model and its applicability when it is used outside its intended domain of application. An example in the context of fire risk modeling is also provided.

[1]  David F. Layton,et al.  Embracing Model Uncertainty: Strategies for Response Pooling and Model Averaging , 2006 .

[2]  Sankaran Mahadevan,et al.  Model uncertainty and Bayesian updating in reliability-based inspection , 2000 .

[3]  R. L. Alpert Calculation of response time of ceiling-mounted fire detectors , 1972 .

[4]  David Draper,et al.  Assessment and Propagation of Model Uncertainty , 2011 .

[5]  Kathryn B. Laskey Model uncertainty: theory and practical implications , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[6]  Nowlen A summary of nuclear power plant fire safety research at Sandia National Laboratories 1975-1987 , 1989 .

[7]  Yuji Hasemi,et al.  Fuel Shape Effect on the Deterministic Properties of Turbulent Diffusion Flames , 1989 .

[8]  Ali Mosleh,et al.  Structured treatment of model uncertainty in complex thermal-hydraulics codes: Technical challenges, prospective and characterization , 2011 .

[9]  Peter Kafka,et al.  Safety & reliability : proceedings of ESREL '99, the 10th European Conference on Safety and Reliability, Munich-Garching, Germany, 13-17 September 1999 , 1999 .

[10]  Madan M. Gupta,et al.  Analysis and management of uncertainty : theory and applications , 1992 .

[11]  Matthew W Wheeler,et al.  Model Uncertainty and Risk Estimation for Experimental Studies of Quantal Responses , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[12]  Louis Anthony Tony Cox Clarifying types of uncertainty: when are models accurate, and uncertainties small? , 2011, Risk analysis : an official publication of the Society for Risk Analysis.

[13]  Enrico Zio,et al.  Two methods for the structured assessment of model uncertainty by experts in performance assessments of radioactive waste repositories , 1996 .

[14]  A. Hoefer,et al.  Uncertainty Treatment for Level-2 Probabilistic Safety Analysis , 2010 .

[15]  Chris Chatfield,et al.  Model uncertainty and forecast accuracy , 1996 .

[16]  A. Patil,et al.  Analysis of uncertainty propagation through model parameters and structure. , 2010, Water science and technology : a journal of the International Association on Water Pollution Research.

[17]  Enrique López Droguett,et al.  Bayesian Methodology for Model Uncertainty Using Model Performance Data , 2008, Risk analysis : an official publication of the Society for Risk Analysis.

[18]  Robert L. Winkler,et al.  Aggregating Point Estimates: A Flexible Modeling Approach , 1993 .

[19]  George E. Apostolakis,et al.  Including model uncertainty in risk-informed decision making , 2006 .

[20]  Ingmar Nopens,et al.  Shall we upgrade one-dimensional secondary settler models used in WWTP simulators? - An assessment of model structure uncertainty and its propagation. , 2011, Water science and technology : a journal of the International Association on Water Pollution Research.

[21]  Ali Mosleh,et al.  Methodology for the use of experimental data to enhance model output uncertainty assessment in thermal hydraulics codes , 2010, Reliab. Eng. Syst. Saf..

[22]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[23]  Ramana V. Grandhi,et al.  A Bayesian approach for quantification of model uncertainty , 2010, Reliab. Eng. Syst. Saf..

[24]  Ali Mosleh,et al.  Integrated treatment of model and parameter uncertainties through a Bayesian approach , 2013 .

[25]  Renate Hagedorn,et al.  Representing model uncertainty in weather and climate prediction , 2005 .

[26]  N. Siu,et al.  Proceedings of workshop I in advanced topics in risk and reliability analysis. Model uncertainty: Its characterization and quantification , 1994 .

[27]  G. Apostolakis,et al.  Models for the use of Expert Opinions , 1984 .

[28]  Ali Mosleh,et al.  Improving default risk prediction using Bayesian model uncertainty techniques. , 2012, Risk analysis : an official publication of the Society for Risk Analysis.

[29]  G. Apostolakis The concept of probability in safety assessments of technological systems. , 1990, Science.

[30]  Gianpaolo Pulcini ACCOUNTING FOR MODEL UNCERTAINTY IN RELIABILITY ANALYSIS OF MECHANICAL REPAIRABLE EQUIPMENT , 2002 .

[31]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[32]  Enrico Zio,et al.  A Comparison Between Probabilistic and Dempster‐Shafer Theory Approaches to Model Uncertainty Analysis in the Performance Assessment of Radioactive Waste Repositories , 2010, Risk analysis : an official publication of the Society for Risk Analysis.

[33]  Enrique Andres Lopez Droguett Methodology for the treatment of model uncertainty , 1999 .

[34]  James J. Chen,et al.  Model Averaging Using the Kullback Information Criterion in Estimating Effective Doses for Microbial Infection and Illness , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[35]  N. Siu,et al.  Bayesian assessment of modeling uncertainties application to fire risk assessment , 1990, [1990] Proceedings. First International Symposium on Uncertainty Modeling and Analysis.

[36]  R. A. Waller,et al.  Low-Probability High-Consequence Risk Analysis , 1984, Advances in Risk Analysis.

[37]  Sankaran Mahadevan,et al.  Bayesian risk-based decision method for model validation under uncertainty , 2007, Reliab. Eng. Syst. Saf..

[38]  Frank J. Groen,et al.  Foundations of probabilistic inference with uncertain evidence , 2005, Int. J. Approx. Reason..