Ideas underlying the Quantification of Margins and Uncertainties

Key ideas underlying the application of Quantification of Margins and Uncertainties (QMU) to nuclear weapons stockpile lifecycle decisions are described. While QMU is a broad process and methodology for generating critical technical information to be used in U.S. nuclear weapon stockpile management, this paper emphasizes one component, which is information produced by computational modeling and simulation. In particular, the following topics are discussed: (i) the key principles of developing QMU information in the form of Best Estimate Plus Uncertainty, (ii) the need to separate aleatory and epistemic uncertainty in QMU, and (iii) the properties of risk-informed decision making (RIDM) that are best suited for effective application of QMU. The paper is written at a high level, but provides an extensive bibliography of useful papers for interested readers to deepen their understanding of the presented ideas.

[1]  J. C. Helton,et al.  Uncertainty and sensitivity analysis in the presence of stochastic and subjective uncertainty , 1997 .

[2]  Robert L. Winkler,et al.  Uncertainty in probabilistic risk assessment , 1996 .

[3]  S. Krimsky,et al.  Social Theories of Risk , 1992 .

[4]  T. Trucano,et al.  Verification, Validation, and Predictive Capability in Computational Engineering and Physics , 2004 .

[5]  Martin M. Pilch,et al.  The method of belief scales as a means for dealing with uncertainty in tough regulatory decisions. , 2005 .

[6]  John Kadvany,et al.  Taming chance: Risk and the quantification of uncertainty , 1996 .

[7]  Mark C. Paulk,et al.  The Capability Maturity Model: Guidelines for Improving the Software Process , 1994 .

[8]  Vicki M. Bier.  Challenges to the Acceptance of Probabilistic Risk Analysis , 1999 .

[9]  A. Prošek,et al.  The State-of-the-Art Theory and Applications of Best-Estimate Plus Uncertainty Methods , 2007 .

[10]  Jon C. Helton,et al.  Conceptual structure of the 1996 performance assessment for the Waste Isolation Pilot Plant , 2000, Reliab. Eng. Syst. Saf..

[11]  Jon C. Helton,et al.  An exploration of alternative approaches to the representation of uncertainty in model predictions , 2003, Reliab. Eng. Syst. Saf..

[12]  Mohammad Modarres,et al.  A historical overview of probabilistic risk assessment development and its use in the nuclear power industry: a tribute to the late Professor Norman Carl Rasmussen , 2005, Reliab. Eng. Syst. Saf..

[13]  Jon C. Helton,et al.  Guest editorial: treatment of aleatory and epistemic uncertainty in performance assessments for complex systems , 1996 .

[14]  Alessandro Petruzzi,et al.  STATE OF THE ART IN USING BEST ESTIMATE CALCULATION TOOLS IN NUCLEAR TECHNOLOGY , 2006 .

[15]  M. Elisabeth Paté,et al.  Acceptable decision processes and acceptable risks in public sector regulations , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  George E Apostolakis,et al.  How Useful Is Quantitative Risk Assessment? , 2004, Risk analysis : an official publication of the Society for Risk Analysis.

[17]  S. Kaplan,et al.  On The Quantitative Definition of Risk , 1981 .

[18]  Timothy G. Trucano,et al.  Predictive Capability Maturity Model for computational modeling and simulation. , 2007 .

[19]  Jon C. Helton,et al.  Quantification of margins and uncertainties: Conceptual and computational basis , 2011, Reliab. Eng. Syst. Saf..

[20]  A. Introduction,et al.  AN APPROACH FOR USING PROBABILISTIC RISK ASSESSMENT IN RISK-INFORMED DECISIONS ON PLANT- SPECIFIC CHANGES TO THE LICENSING BASIS , 2009 .

[21]  Paul Slovic,et al.  Going Beyond the Red Book: The Sociopolitics of Risk , 2003 .

[22]  Jon C. Helton,et al.  Calculation of reactor accident safety goals , 1993 .

[23]  M.J.W. Jansen,et al.  Review of Saltelli, A. & Chan, K. & E.M.Scott (Eds) (2000), Sensitivity analysis. Wiley (2000) , 2001 .

[24]  Jon C. Helton,et al.  Risk, Uncertainty in Risk, and the EPA Release Limits for Radioactive Waste Disposal , 1993 .

[25]  M. E Paté-Cornell,et al.  Probability and uncertainty in nuclear safety decisions , 1986 .

[26]  François M. Hemez,et al.  Defining predictive maturity for validated numerical simulations , 2010 .

[27]  M K Silva,et al.  Resolution of the Long-Term Performance Issues at the Waste Isolation Pilot Plant , 1999, Risk analysis : an official publication of the Society for Risk Analysis.

[28]  A. Saltelli,et al.  Sensitivity analysis for chemical models. , 2005, Chemical reviews.

[29]  George Apostolakis.  Uncertainty in probabilistic safety assessment , 1989 .

[30]  Sheila Jasanoff,et al.  Risk management and political culture , 1986 .

[31]  Christine M. Anderson-Cook,et al.  Quantifying reliability uncertainty from catastrophic and margin defects: A proof of concept , 2011, Reliab. Eng. Syst. Saf..

[32]  Timothy G. Trucano,et al.  Verification and Validation in Computational Fluid Dynamics , 2002 .

[33]  Timothy G. Trucano,et al.  General Concepts for Experimental Validation of ASCI Code Applications , 2002 .

[34]  R L Sielken,et al.  Challenges to default assumptions stimulate comprehensive realism as a new tier in quantitative cancer risk assessment. , 1995, Regulatory toxicology and pharmacology : RTP.

[35]  B. John Garrick,et al.  Probabilistic risk assessment practices in the USA for nuclear power plants , 2002 .

[36]  Jon C. Helton,et al.  Representation of analysis results involving aleatory and epistemic uncertainty , 2010, Int. J. Gen. Syst..

[37]  Jon C. Helton,et al.  Probability of loss of assured safety in temperature dependent systems with multiple weak and strong links , 2006, Reliab. Eng. Syst. Saf..

[38]  E. M. Scott.  Modelling Radioactivity in the Environment , 2003 .

[39]  Jon C. Helton,et al.  Ideas underlying quantification of margins and uncertainties(QMU): a white paper. , 2006 .

[40]  Jon C. Helton,et al.  Conceptual basis for the definition and calculation of expected dose in performance assessments for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada , 2009, Reliab. Eng. Syst. Saf..

[41]  Christine M. Anderson-Cook,et al.  Quantifying reliability uncertainty : a proof of concept. , 2009 .

[42]  Laura Painton Swiler,et al.  Calibration, validation, and sensitivity analysis: What's what , 2006, Reliab. Eng. Syst. Saf..

[43]  S. Ferson,et al.  Different methods are needed to propagate ignorance and variability , 1996 .

[44]  R. L. Bierbaum,et al.  DOE Nuclear Weapon Reliability Definition: History, Description, and Implementation , 1999 .

[45]  Jon C. Helton,et al.  Survey of sampling-based methods for uncertainty and sensitivity analysis , 2006, Reliab. Eng. Syst. Saf..

[46]  Alessandro Petruzzi,et al.  RELAP5 simulation of surge line break accident using combined and best estimate plus uncertainty approaches , 2009 .

[47]  F. Hemez,et al.  Defining a Practical QMU Metric , 2008 .

[48]  B John Garrick,et al.  Quantitative risk assessment of the New York State operated West Valley Radioactive Waste Disposal Area. , 2010, Risk analysis : an official publication of the Society for Risk Analysis.

[49]  G. W. Parry,et al.  Characterization and evaluation of uncertainty in probabilistic risk analysis , 1981 .

[50]  S. Y. Harmon,et al.  A Proposed Model for Simulation Validation Process Maturity , 2005 .

[51]  Jon Craig Helton,et al.  Conceptual and computational basis for the quantification of margins and uncertainty. , 2009 .

[52]  Jon C. Helton,et al.  Chapter 12 Mathematical and numerical approaches in performance assessment for radioactive waste disposal: dealing with uncertainty , 2000 .

[53]  Ray W. Cooksey,et al.  Judgment analysis : theory, methods, and applications , 1996 .

[54]  Thomas A. Zang,et al.  NASA Standard for Models and Simulations (M and S): Development Process and Rationale , 2013 .

[55]  Rene L. Bierbaum,et al.  Nuclear Weapon Reliability Evaluation Methodology , 2002 .

[56]  R. Zeckhauser,et al.  The perils of prudence: how conservative risk assessments distort regulation. , 1988, Regulatory toxicology and pharmacology : RTP.

[57]  H Christopher Frey,et al.  OF SENSITIVITY ANALYSIS , 2001 .

[58]  Gareth W. Parry,et al.  The characterization of uncertainty in probabilistic risk assessments of complex systems , 1996 .

[59]  M. Elisabeth Paté-Cornell.  Conditional Uncertainty Analysis and Implications for Decision Making: The Case of WIPP , 1999, Risk analysis : an official publication of the Society for Risk Analysis.

[60]  B T Goodwin,et al.  National Certification Methodology for the Nuclear Weapons Stockpile , 2006 .

[61]  Jon C. Helton,et al.  Latin Hypercube Sampling and the Propagation of Uncertainty in Analyses of Complex Systems , 2002 .

[62]  R P Rechard,et al.  Historical Relationship Between Performance Assessment for Radioactive Waste Disposal and Other Types of Risk Assessment , 1999, Risk analysis : an official publication of the Society for Risk Analysis.

[63]  Jon C. Helton,et al.  Quantification of margins and uncertainties: Alternative representations of epistemic uncertainty , 2011, Reliab. Eng. Syst. Saf..

[64]  Jon C. Helton,et al.  Alternative representations of epistemic uncertainty , 2004, Reliab. Eng. Syst. Saf..

[65]  Jon C. Helton,et al.  Quantification of margins and uncertainties: Example analyses from reactor safety and radioactive waste disposal involving the separation of aleatory and epistemic uncertainty , 2011, Reliab. Eng. Syst. Saf..

[66]  M. Elisabeth Paté-Cornell,et al.  Uncertainties in risk analysis: Six levels of treatment , 1996 .

[67]  A. Amendola.  Recent paradigms for risk informed decision making , 2002 .

[68]  Timothy G. Trucano,et al.  On the role of code comparisons in verification and validation. , 2003 .

[69]  F. O. Hoffman,et al.  Propagation of uncertainty in risk assessments: the need to distinguish between uncertainty due to lack of knowledge and uncertainty due to variability. , 1994, Risk analysis : an official publication of the Society for Risk Analysis.

[70]  Jon C. Helton,et al.  Treatment of Uncertainty in Performance Assessments for Complex Systems , 1994 .

[71]  Jean Baccou,et al.  Numerical accuracy and efficiency in the propagation of epistemic and aleatory uncertainties , 2010, Int. J. Gen. Syst..

[72]  J. C. Helton,et al.  Uncertainty and sensitivity analysis in performance assessment for the Waste Isolation Pilot Plant , 1999 .

[73]  Jon C. Helton,et al.  Performance Assessment for the Waste Isolation Pilot Plant: From Regulation to Calculation for 40 CFR 191.13 , 1997, Oper. Res..

[74]  J. Kagan,et al.  Rational choice in an uncertain world , 1988 .

[75]  Elisabeth Paté-Cornell,et al.  Risk and Uncertainty Analysis in Government Safety Decisions , 2002, Risk analysis : an official publication of the Society for Risk Analysis.

[76]  C. Althaus,et al.  A Disciplinary Perspective on the Epistemological Status of Risk , 2005, Risk analysis : an official publication of the Society for Risk Analysis.

[77]  D. Sharp,et al.  QMU and Nuclear Weapons Certification What ’ s under the hood ? , 2022 .

[78]  Timothy G. Trucano,et al.  Toward a More Rigorous Application of Margins and Uncertainties within the Nuclear Weapons Life Cycle - A Sandia Perspective , 2007 .

[79]  Jon C. Helton,et al.  Computational implementation of sampling-based approaches to the calculation of expected dose in performance assessments for the proposed high-level radioactive waste repository at Yucca Mountain, Nevada , 2009, Reliab. Eng. Syst. Saf..

[80]  G. Apostolakis.  The concept of probability in safety assessments of technological systems. , 1990, Science.

[81]  Michael C. Cheok,et al.  An approach for using risk assessment in risk-informed decisions on plant-specific changes to the licensing basis , 1999 .