Towards a Credibility Assessment of Models and Simulations

*† ‡ § ** †† A scale is presented to evaluate the rigor of modeling and simulation (M&S) practices for the purpose of supporting a credibility assessment of the M&S results. The scale distinguishes required and achieved levels of rigor for a set of M&S elements that contribute to credibility including both technical and process measures. The work has its origins in an interest within NASA to include a “Credibility Assessment Scale” in development of a NASA standard for models and simulations.

[1]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[2]  Osman Balci,et al.  Quality assessment, verification, and validation of modeling and simulation applications , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[3]  Unmeel B. Mehta,et al.  Guide to credible computer simulations of fluid flows , 1996 .

[4]  Leonard E. Schwer,et al.  An overview of the PTC 60/V&V 10: guide for verification and validation in computational solid mechanics , 2007, Engineering with Computers.

[5]  Osman Balci,et al.  A collaborative evaluation environment for credibility assessment of modeling and simulation applications , 2002, Proceedings of the Winter Simulation Conference.

[6]  Ram K. Tripathi,et al.  An Uncertainty Structure Matrix for Models and Simulations , 2008 .

[7]  Lawrence L. Green.  Uncertainty Analysis of Historical Hurricane Data , 2007 .

[8]  Diane M. Strong,et al.  Beyond Accuracy: What Data Quality Means to Data Consumers , 1996, J. Manag. Inf. Syst..

[9]  Pamela Samuelson.  Why the anticircumvention regulations need revision , 1999 .

[10]  B. J. Fogg,et al.  Credibility and computing technology , 1999, CACM.

[11]  P. Roache.  Verification of Codes and Calculations , 1998 .

[12]  S. Blattnig,et al.  Numerical Uncertainty Quantification for Radiation Analysis Tools , 2007 .

[13]  William L. Oberkampf,et al.  Guide for the verification and validation of computational fluid dynamics simulations , 1998 .

[14]  Roger W. Logan,et al.  Validation, Uncertainty, and Quantitative Reliability at Confidence (QRC) , 2003 .