Validation and verification of simulation models

This paper discusses validation and verification of simulation models. The different approaches to deciding model validity are presented; how model validation and verification relate to the model development process are discussed; various validation techniques are defined; conceptual model validity, model verification, operational validity, and data validity are described; ways to document results are given; and a recommended procedure is presented.

[1]  George B. Kleindorfer,et al.  THE PHILOSOPHY OF SCIENCE AND VAL1DATION IN SIMULATION , 1993 .

[2]  Lee W. Schruben,et al.  Establishing the credibility of simulations , 1980 .

[3]  O. Balci How to assess the acceptability and credibility of simulation results , 1989, WSC '89.

[4]  Jack P. C. Kleijnen,et al.  EUROPEAN JOURNAL OF OPERATIONAL , 1992 .

[5]  Osman Balci,et al.  Guidelines For Selecting And Using Simulation Model Verification Techniques , 1989, 1989 Winter Simulation Conference Proceedings.

[6]  Osman Balci,et al.  Some examples of simulation model validation using hypothesis testing , 1982, WSC.

[7]  Gideon Oron Statistical tools for simulation practitioners , 1988 .

[8]  Saul I. Gass,et al.  Model accreditation: A rationale and process for determining a numerical rating , 1993 .

[9]  Saul I. Gass,et al.  Concepts of model confidence , 1981, Comput. Oper. Res..

[10]  Osman Balci,et al.  A methodology for cost-risk analysis in the statistical validation of simulation models , 1981, CACM.

[11]  Osman Balci,et al.  Validation fo Multivariate Response Trace-driven Simulation Models , 1983, Performance.

[12]  Robert G. Sargent,et al.  An expository on verification and validation of simulation models , 1985, WSC '85.

[13]  Robert G. Sargent,et al.  Investigation Into Scheduling for an Interactive Computing System , 1974, IBM J. Res. Dev..

[14]  Peter L. Knepell,et al.  Simulation Validation: A Confidence Assessment Methodology , 1993 .

[15]  Robert G. Sargent,et al.  The use of graphical models in model validation , 1986, WSC '86.

[16]  Connie M. Borror,et al.  Miller and Freund's Probability and Statistics for Engineers, 6th Ed. , 2001 .

[17]  Robert G. Sargent Some subjective validation methods using graphical displays of data , 1996, Winter Simulation Conference.

[18]  Robert G. Sargent A tutorial on validation and verification of simulation models , 1988, WSC '88.

[19]  Saul I. Gass,et al.  Feature Article - Decision-Aiding Models: Validation, Assessment, and Related Issues for Policy Analysis , 1983, Oper. Res..

[20]  R. Sargent,et al.  Validation of Simulation Models via Simultaneous Confidence Intervals , 1984 .

[21]  Robert G. Sargent Validation of simulation models , 1979, WSC '79.

[22]  Robert G Sargent,et al.  An Assessment Procedure and a Set of Criteria for Use in the Evaluation of 'Computerized Models and Computer-Based Modelling Tools'. , 1981 .

[23]  I. A. Chaikovsky,et al.  Terminology for model credibility , 1979 .

[24]  M Panjabi,et al.  Validation of mathematical models. , 1979, Journal of biomechanics.