Confidence in computational predictions is enhanced if the potential ‘error’ in these predictions (the difference between the prediction and nature’s outcome in the situation being simulated) can be credibly bounded. The “model-validation” process by which experimental or field results are compared to computational predictions to produce this confidence provides the raw material for characterizing a computational model’s predictive capability in terms of such error limits. In general, the goal is to evaluate predictive capability, first for predictions in the region of experimentation, then, if possible, for predictions in untested regions of applications. This whole process is fundamentally statistical because it requires the acquisition and careful analysis of appropriate data. We establish a statistical model for characterizing predictive-capability and discuss various experimental design and statistical data analysis issues and approaches for resolving them Analyses based on both ‘frequentist’ and Bayesian statistical paradigms are discussed in general in this paper and illustrated in accompanying papers presented at this workshop. The work of the first author was supported by Sandia National Laboratories and the United States Department of Energy under Contract DE-AC04-97AL85000. Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockhed Martin Company, for the United States Department of Energy. **The work of the second author was supported by General Motors and the National Science Foundation, Grant DMS-0103265.
[1]
Timothy G. Trucano,et al.
Statistical Validation of Engineering and Scientific Models with Application to CTH
,
2001
.
[2]
N Oreskes,et al.
Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences
,
1994,
Science.
[3]
Timothy G. Trucano,et al.
General Concepts for Experimental Validation of ASCI Code Applications
,
2002
.
[4]
F. E. Satterthwaite.
An approximate distribution of estimates of variance components.
,
1946,
Biometrics.
[5]
William L. Oberkampf,et al.
Experimental methodology for computational fluid dynamics code validation
,
1997
.
[6]
TIMOTHY G. TRUCANO,et al.
Guidelines for Sandia ASCI Verification and Validation Plans - Content and Format: Version 1.0
,
1999
.
[7]
P A Johnson,et al.
Comparison of Pier-Scour Equations Using Field Data
,
1995
.
[8]
George E. P. Box,et al.
Sampling and Bayes' inference in scientific modelling and robustness
,
1980
.
[9]
J. Chilès,et al.
Geostatistics: Modeling Spatial Uncertainty
,
1999
.
[10]
Robert G. Easterling,et al.
Measuring the Predictive Capability of Computational Models: Principles and Methods, Issues and Illustrations
,
2001
.
[11]
William L. Oberkampf,et al.
Guide for the verification and validation of computational fluid dynamics simulations
,
1998
.