A tutorial on validation and verification of simulation models

We give a general introduction to validation and verification of simulation models, define the various validation techniques, and present a recommended model validation procedure in this tutorial paper.

[1]  Saul I. Gass,et al.  Feature Article - Decision-Aiding Models: Validation, Assessment, and Related Issues for Policy Analysis , 1983, Oper. Res..

[2]  Thomas H. Naylor,et al.  Verification of Computer Simulation Models , 1967 .

[3]  David O. Wood,et al.  MIT model analysis program: what we have learned about policy model review , 1986, WSC '86.

[4]  Carl A Mauro,et al.  Factor Screening in Computer Simulation , 1982 .

[5]  Robert G. Sargent,et al.  Statistical analysis of simulation output data , 1976, SIML.

[6]  Osman Balci,et al.  A methodology for cost-risk analysis in the statistical validation of simulation models , 1981, CACM.

[7]  Robert G Sargent,et al.  An Assessment Procedure and a Set of Criteria for Use in the Evaluation of 'Computerized Models and Computer-Based Modelling Tools'. , 1981 .

[8]  Udo W. Pooch,et al.  Integrated Design and Verification of Simulation Programs , 1977, Computer.

[9]  Osman Balci,et al.  Validation of multivariate response models using Hotelling's two-sample T2 test , 1982 .

[10]  Jack P. C. Kleijnen,et al.  Statistical Techniques in Simulation , 1977, IEEE Transactions on Systems, Man and Cybernetics.

[11]  I ÖrenTuncer.  Concepts and criteria to assess acceptability of simulation studies , 1981 .

[12]  Robert G. Sargent,et al.  The use of graphical models in model validation , 1986, WSC '86.

[13]  Lee W. Schruben,et al.  Establishing the credibility of simulations , 1980 .

[14]  Osman Balci,et al.  Credibility Assessment of Simulation Results: The State of the Art , 1986 .

[15]  Richard L. Scheaffer,et al.  Probability and statistics for engineers , 1986 .

[16]  Bernard P. Zeigler,et al.  Theory of Modelling and Simulation , 1979, IEEE Transactions on Systems, Man and Cybernetics.

[17]  Osman Balci,et al.  Some examples of simulation model validation using hypothesis testing , 1982, WSC.

[18]  Edward A. Davis.  Use of seminar gaming to specify and validate simulation models , 1986, WSC '86.

[19]  Robert E. Shannon.  Tests for the verification and validation of computer simulation models , 1981, WSC '81.

[20]  Robert G. Sargent,et al.  An expository on verification and validation of simulation models , 1985, WSC '85.

[21]  Osman Balci,et al.  Validation of Multivariate Response Simulation Models by Using Hotelling's Two-sample T^2 Test , 1981 .

[22]  Robert G. Sargent,et al.  Using Standardized Time Series to Estimate Confidence Intervals for the Difference Between Two Stationary Stochastic Processes , 1987, Oper. Res..

[23]  Saul I. Gass,et al.  Documenting a Computer-Based Model , 1984 .

[24]  Osman Balci,et al.  Validation fo Multivariate Response Trace-driven Simulation Models , 1983, Performance.

[25]  George S. Fishman,et al.  On validation of simulation models , 1973, AFIPS National Computer Conference.

[26]  Saul I. Gass,et al.  Letter to the Editor - Guidelines for Model Evaluation: An Abridged Version of the U.S. General Accounting Office Exposure Draft , 1980, Oper. Res..

[27]  Bernard P. Zeigler,et al.  Theory of Modelling and Simulation , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[28]  Tuncer Ören,et al.  Concepts and criteria to assess acceptability of simulation studies: a frame of reference , 1981, CACM.

[29]  Gunnar Abrahamson,et al.  Terminology for model credibility , 1980 .

[30]  G. Enderlein,et al.  Miller, I., and J. E. Freund: Probability and Statistics for Engineers. Prentice‐Hall, Englewood Cliffs, New Jersey 1965. 432 S., Preis 96. s. , 1968 .

[31]  R. Tompkins.  A general accounting. , 1990, Minnesota medicine.

[32]  F. David,et al.  Statistical Techniques in Simulation: Part I , 1975 .

[33]  Robert G. Sargent,et al.  An overview of verification and validation of simulation models , 1987, WSC '87.

[34]  R. Sargent,et al.  Validation of Simulation Models via Simultaneous Confidence Intervals , 1984 .

[35]  Jack P. C. Kleijnen,et al.  Statistical Techniques in Simulation , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[36]  Marek Rusinkiewicz,et al.  Query generation in an instructional database management system , 1987, SIGCSE '87.