Verification and Validation of AI Software

Abstract : This document provides practical advice on how to improve V and V on Al projects. The question we attempt to answer is: How can I apply my knowledge of V and V practice to Al development, which seems very different from the examples from textbooks, and which cannot be easily mapped into the lifecycle models of the DOD standards? Part I lays a firm foundation by defining terms such as verification, validation, and artificial intelligence. Also, a new representation of system lifecycles is presented which we believe you will find useful in analyzing your organization's Al development efforts. In Part II the focus shifts to providing advice, with section addressed to project leaders, system specifiers's, designers, programmers, and documenters. Each role contributes in a different way to the overall V and V process, so we present a set of guidelines specific to each role. Part III is a collection of three appendices: (1) A user's manual for a software tool, ASP, developed under this contract which supports the V and V process by allowing programmers to better integrate formal testing with code development; (2) A glossary of V and V terms; and (3) A guide to commercially available CASE tools.