How to Build Valid and Credible Simulation Models

In this tutorial we present techniques for building valid and credible simulation models. Ideas to be discussed include the importance of a definitive problem formulation, discussions with subject-matter experts, interacting with the decision-maker on a regular basis, development of a written assumptions document, structured walk-through of the assumptions document, use of sensitivity analysis to determine important model factors, and comparison of model and system output data for an existing system (if any). Each idea will be illustrated by one or more real-world examples. We will also discuss the difficulty in using formal statistical techniques (e.g., confidence intervals) to validate simulation models.

[1]  Lee W. Schruben,et al.  Establishing the credibility of simulations , 1980 .

[2]  Osman Balci,et al.  History of verification and validation of simulation models , 2017, 2017 Winter Simulation Conference (WSC).

[3]  Osman Balci,et al.  Verification, validation, and accreditation , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).

[4]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[5]  Robert G. Sargent,et al.  An introductory tutorial on verification and validation of simulation models , 2015, 2015 Winter Simulation Conference (WSC).

[6]  Robert G. Sargent,et al.  Validation and verification of simulation models , 1999, Proceedings of the 2004 Winter Simulation Conference, 2004..

[7]  J. Banks,et al.  Discrete-Event System Simulation , 1995 .

[8]  Averill Law,et al.  Simulation Modeling and Analysis (McGraw-Hill Series in Industrial Engineering and Management) , 2006 .

[9]  Osman Balci,et al.  Verification, Validation, and Testing , 2007 .

[10]  David Goldsman,et al.  A tutorial on the operational validation of simulation models , 2016, 2016 Winter Simulation Conference (WSC).

[11]  J. D. Johannes,et al.  Systems Simulation: The Art and Science , 1975, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  Robert G. Sargent,et al.  Verifying and validating simulation models , 1996, Proceedings Winter Simulation Conference.