Verification, validation, and certification of modeling and simulation applications

Certifying that a large-scale complex modeling and simulation (M&S) application can be used for a set of specific purposes is an onerous task, which involves complex evaluation processes throughout the entire M&S development life cycle. The evaluation processes consist of verification and validation activities, quality assurance, assessment of qualitative and quantitative elements, assessments by subject matter experts, and integration of disparate measurements and assessments. Planning, managing, and conducting the evaluation processes require a disciplined life-cycle approach and should not be performed in an ad hoc manner. The purpose of this tutorial paper is to present structured evaluation processes throughout the entire M&S development life cycle. Engineers, analysts, and managers can execute the evaluation processes presented herein to be able to formulate a certification decision for a large-scale complex M&S application.

[1]  Jeffrey M. Voas.  Certification: reducing the hidden costs of poor quality , 1999, IEEE Software.

[2]  Osman Balci,et al.  Well-defined intended uses: an explicit requirement for accreditation of modeling and simulation applications , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[3]  P. Sanders,et al.  DoD Modeling and Simulation (M&S) Verification, Validation, and Accreditation (VV&A), , 1996 .

[4]  J. Banks,et al.  Discrete-Event System Simulation , 1995 .

[5]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[6]  James D. Arthur,et al.  Improving the model development process: expanding our horizons in verification, validation, and accreditation research and practice , 2002, WSC '02.

[7]  Andrew Rae,et al.  Software Evaluation for Certification , 1994 .

[8]  James D. Arthur,et al.  Expanding our horizons in verification, validation, and accreditation research and practice , 2002, Proceedings of the Winter Simulation Conference.

[9]  Dale K. Pace.  Naval modeling and simulation verification, validation, and accreditation , 1993, WSC '93.

[10]  Osman Balci,et al.  A methodology for certification of modeling and simulation applications , 2001, TOMC.

[11]  Hans-Ludwig Hausen,et al.  Software evaluation for certification - principles, practice, and legal liability , 1995, International software quality assurance series.

[12]  Osman Balci,et al.  Proposed standard processes for certification of modeling and simulation applications , 2002, Proceedings of the Winter Simulation Conference.

[13]  Osman Balci,et al.  A collaborative evaluation environment for credibility assessment of modeling and simulation applications , 2002, Proceedings of the Winter Simulation Conference.

[14]  Osman Balci,et al.  Principles of simulation model validation, verification, and testing , 1997 .

[15]  Osman Balci,et al.  Verification, validation, and accreditation , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).