Verification and validation activities within a new procedure model for V&V in production and logistics simulation

Verification and Validation (V&V) of simulation models have been strongly investigated in the context of defense applications. Significantly less substantial work can be found for applications in production and logistics, which is surprising when taking into account the massive impact that wrong or inadequate simulation results can have on strategic and investment-related decisions for large production and logistics systems. The authors have, therefore, founded an expert group for this specific topic in the year 2003. The major result of this expert group was the development of a specific procedure model for V&V in the context of simulation for production and logistics, which was documented in a book (in German) and summarized in a paper at the WSC'2008. This paper explains details of the approach, discussing the criteria to be applied when assessing the validity of a model, and providing examples how to conduct V&V with reference to these criteria.

[1]  Osman Balci,et al.  Planning for verification, validation, and accreditation of modeling and simulation applications , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[2]  Muhittin Oral,et al.  In search of a valid view of model validation for operations research , 1993 .

[3]  Vikramaditya Dave,et al.  Electrical and Electronics Engineering , 2009 .

[4]  Dirk Brade.  A generalized process for the verification and validation of models and simulation results , 2004 .

[5]  Thomas R. Willemain,et al.  Insights on Modeling from a Dozen Experts , 1994, Oper. Res..

[6]  Paul K. Davis,et al.  Generalizing Concepts and Methods of Verification, Validation, and Accreditation (VV&A) for Military Simulations, , 1992 .

[7]  Barry W. Boehm,et al.  Verifying and Validating Software Requirements and Design Specifications , 1989, IEEE Software.

[8]  Sigrid Wenzel,et al.  Verifikation und Validierung für die Simulation in Produktion und Logistik - Vorgehensmodelle und Techniken , 2008 .

[9]  James D. Arthur,et al.  Improving the model development process: expanding our horizons in verification, validation, and accreditation research and practice , 2002, WSC '02.

[10]  S. J. Williams.  Special Issue on Model Validation , 1990 .

[11]  Sigrid Wenzel,et al.  A new procedure model for verification and validation in production and logistics simulation , 2008, 2008 Winter Simulation Conference.

[12]  J. Banks,et al.  Discrete-Event System Simulation , 1995 .

[13]  Michael Pidd,et al.  Provider and customer expectations of successful simulation projects , 1998, J. Oper. Res. Soc..

[14]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[15]  Jack P. C. Kleijnen,et al.  EUROPEAN JOURNAL OF OPERATIONAL , 1992 .

[16]  Stewart Robinson,et al.  Simulation: The Practice of Model Development and Use , 2004 .

[17]  Averill Law,et al.  Simulation Modeling and Analysis (McGraw-Hill Series in Industrial Engineering and Management) , 2006 .

[18]  Osman Balci,et al.  Guidelines for successful simluation studies (tutorial session) , 1990, WSC' 90.

[19]  Björn Johansson,et al.  A methodology for input data management in discrete event simulation projects , 2008, 2008 Winter Simulation Conference.

[20]  Stewart Robinson,et al.  Conceptual Modeling for Simulation: Issues and Research Requirements , 2006, Proceedings of the 2006 Winter Simulation Conference.

[21]  Ronald F. Perry,et al.  Simulation: A Problem-Solving Approach , 1989 .

[22]  Osman Balci.  Verification, validation, and certification of modeling and simulation applications , 2003, Proceedings of the 2003 Winter Simulation Conference, 2003..

[23]  Jack P. C. Kleijnen,et al.  Validation of models: statistical techniques and data availability , 1999, WSC '99.

[24]  Martin J. Eppler.  Managing Information Quality , 2003 .

[25]  James D. Arthur,et al.  Expanding our horizons in verification, validation, and accreditation research and practice , 2002, Proceedings of the Winter Simulation Conference.

[26]  Osman Balci.  Guidelines for successful simulation studies , 1990, 1990 Winter Simulation Conference Proceedings.

[27]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .