Statistical Validation For Heat Transfer Problems: A Case Study

This paper presents a proposed methodology for applying statistical techniques as the basis for validation activities of a computer model of heat transfer. To demonstrate this approach, a case study of a Ruggedized Instrumentation Package subject to heating from battery discharge and electrical resistance during normal operations is considered. First, the uncertainty in the simulation due to the discretization of the governing partial differential equations is quantified. This error is analogous to the measure ment error in an experiment in that it is not representative of actual physical variation, and is necessary to completely characterize the range of simulation outcomes. Secondly, physical uncertainties, such as unknown or variable material properties, are incorporated into the model and propagated through it. To this end, a sensitivity study enables exploration of the output space of the model. Experiments are considered to be a realization of one of these possible outcomes, with the added complication of containing physical processes not included in the model. Statistical tests are proposed to quantitatively compare experimental measurements and simulation results. The problem of discrepancies between the computational model and tests is considered as well.

[1]  Jon C. Helton,et al.  Sampling-based methods for uncertainty and sensitivity analysis. , 2000 .

[2]  Timothy G. Trucano,et al.  General Concepts for Experimental Validation of ASCI Code Applications , 2002 .

[3]  Christopher J. Roy,et al.  Verification and Validation in Scientific Computing , 2010 .

[4]  Christopher J. Roy,et al.  Review of code and solution verification procedures for computational simulation , 2005 .

[5]  Long Chen.  FINITE ELEMENT METHOD , 2013 .

[6]  Jack P. C. Kleijnen,et al.  EUROPEAN JOURNAL OF OPERATIONAL , 1992 .

[7]  J. Z. Zhu,et al.  The finite element method , 1977 .

[8]  Roger W. Logan,et al.  Comparing 10 Methods for Solution Verification, and Linking to Model Validation , 2005, J. Aerosp. Comput. Inf. Commun..

[9]  Stephen E. Fienberg,et al.  Testing Statistical Hypotheses , 2005 .

[10]  Michael S. Eldred,et al.  DAKOTA : a multilevel parallel object-oriented framework for design optimization, parameter estimation, uncertainty quantification, and sensitivity analysis. Version 5.0, user's reference manual. , 2010 .

[11]  Karl Pearson F.R.S..  X. On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling , 2009 .

[12]  Sarah Nicole Scott,et al.  Computational solution verification applied to a thermal model of a Ruggedized Instrumentation Package , 2013 .

[13]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models , 2004 .

[14]  Y. Jaluria,et al.  An Introduction to Heat Transfer , 1950 .

[15]  Matthew F. Barone,et al.  Measures of agreement between computation and experiment: Validation metrics , 2004, J. Comput. Phys..

[16]  A. Kolmogorov.  On the Empirical Determination of a Distribution Function , 1992 .

[17]  Patrick J. Roache,et al.  Verification and Validation in Computational Science and Engineering , 1998 .

[18]  William Roshan Quadros,et al.  CUBIT geometry and mesh generation toolkit 15.1 user documentation , 2016 .

[19]  Timothy G. Trucano,et al.  Verification and validation. , 2005 .

[20]  Michael S. Eldred,et al.  DAKOTA , A Multilevel Parallel Object-Oriented Framework for Design Optimization , Parameter Estimation , Uncertainty Quantification , and Sensitivity Analysis Version 4 . 0 User ’ s Manual , 2006 .

[21]  P. Lettieri,et al.  An introduction to heat transfer , 2007 .

[22]  J. Tinsley Oden,et al.  Verification and validation in computational engineering and science: basic concepts , 2004 .

[23]  K. Pearson.  On the Criterion that a Given System of Deviations from the Probable in the Case of a Correlated System of Variables is Such that it Can be Reasonably Supposed to have Arisen from Random Sampling , 1900 .

[24]  Timothy G. Trucano,et al.  Verification and Validation in Computational Fluid Dynamics , 2002 .