Validation of simulation based models: A theoretical outlook

Validation is the most incomprehensible part of developing a model. Nevetheless, no model can be accepted unless it has passed the tests of validation, since the procedure of validation is vital to ascertain the credibility of the model. Validation procedures are usually framework based and dynamic, but a methodical procedure can be followed by a modeller (researcher) in order to authenticate the model. The paper starts with a discussion on the views and burning issues by various researchers on model validation and the foundational terminology involved. The paper later highlights on the methodology and the process of validation adopted. Reasons for the failure of the model have also been explored. The paper finally focuses on the widely approved validation schemes (both quantitative and qualitative) and techniques in practice, since no one test can determine the credibility and validity of a simulation model. Moreover, as the model passes more tests (both quantitative and qualitative) the confidence in the model increases correspondingly.

[1]  Averill M. Law,et al.  How to build valid and credible simulation models , 2008, 2008 Winter Simulation Conference.

[2]  J. S. Carson.  Verification and validation: a consultant's perspective , 1989, WSC '89.

[3]  Yaman Barlas,et al.  Formal aspects of model validity and validation in system dynamics , 1996 .

[4]  Jack P. C. Kleijnen,et al.  Validation of models: statistical techniques and data availability , 1999, WSC '99.

[5]  I. A. Chaikovsky,et al.  Terminology for model credibility , 1979 .

[6]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[7]  Gunnar Abrahamson,et al.  Terminology for model credibility , 1980 .

[8]  Joseph A. Heim,et al.  Manufacturing systems : foundations of world-class practice , 1992 .

[9]  J Swanson,et al.  Business Dynamics—Systems Thinking and Modeling for a Complex World , 2002, J. Oper. Res. Soc..

[10]  Yaman Barlas,et al.  Tests of Model Behavior that can Detect Structural Flaws: Demonstration with Simulation Experiments , 1989 .

[11]  J. Forrester.  Industrial Dynamics , 1997 .

[12]  W. N. Jessop.  Management System Dynamics , 1978 .

[13]  P. M. Milling,et al.  Computer-Based Management of Complex Systems , 1989 .

[14]  William L. Oberkampf,et al.  Guide for the verification and validation of computational fluid dynamics simulations , 1998 .

[15]  J. Goldberg,et al.  A simulation model for evaluating a set of emergency vehicle base locations: development, validation, and usage. , 1990, Socio-economic planning sciences.

[16]  Osman Balci,et al.  Validation of multivariate response models using Hotelling's two-sample T2 test , 1982 .

[17]  Ma. de la Natividad Jiménez Salas,et al.  The Conduct of Inquiry , 1967 .

[18]  Anders Wall,et al.  Correctness Criteria for Models' Validation- A Philosophical Perspective , 2004, MSV/AMCS.

[19]  Saul I. Gass,et al.  Model accreditation: A rationale and process for determining a numerical rating , 1993 .

[20]  J.S. Carson,et al.  Model verification and validation , 2002, Proceedings of the Winter Simulation Conference.

[21]  Osman Balci,et al.  Validation of Multivariate Response Simulation Models by Using Hotelling's Two-sample T^2 Test , 1981 .

[22]  George B. Kleindorfer,et al.  Validation in Simulation: Various Positions in the Philosophy of Science , 1998 .

[23]  Yaman Barlas,et al.  Model simplification and validation: Illustration with indirect structure validity tests , 2004 .

[24]  Mario R. Garzia,et al.  Network Modeling, Simulation, and Analysis , 1990 .

[25]  Anthony N. Godwin,et al.  Enhancing confidence in discrete event simulations , 2001 .

[26]  Keith Tizzard,et al.  Management System Dynamics , 1977 .

[27]  George P. Richardson,et al.  Introduction to System Dynamics Modeling with DYNAMO , 1981 .

[28]  Shelby D. Hunt,et al.  Marketing Theory: The Philosophy Of Marketing Science , 1983 .

[29]  Jack P. C. Kleijnen,et al.  EUROPEAN JOURNAL OF OPERATIONAL , 1992 .