Verification and validation (V&V) have been defended as necessary and sufficient elements of the process for evaluating the expert system. An expert system is viewed as “verified” to the extent that its output statements describing the system are confirmed to a reasonable degree of strength. It is viewed as “validated” to the extent that it produces situationally relevant, correct answers at the location where it is installed. A gypsum wallboard expert system is evaluated in terms of these definitions. During the system’s development, its elements and inferencing processes were verified through a process of having facility personnel confirm the system’s elements and inferencing. On installation, the system was validated through an experiment that provided the basis for a statistical comparison of diagnoses by personnel and the system. The V&V procedure is offered as a means to improve the acceptability of expert systems to facilities where the system is to be installed.
[1]
J. G. Massey,et al.
A method for measuring wear in veneer chipper and waferizing knives
,
1989
.
[2]
Osman Balci,et al.
Validating Expert System Performance
,
1987,
IEEE Expert.
[3]
J. G. Massey,et al.
Expert System Verification and Validation Part I: Defining the Concepts
,
1991
.
[4]
Jacob Cohen.
A Coefficient of Agreement for Nominal Scales
,
1960
.
[5]
Christopher J. R. Green,et al.
Verification and validation of expert systems
,
1991
.
[6]
Edward H. Shortliffe,et al.
An Approach to Verifying Completeness and Consistency in a Rule-Based Expert System
,
1982,
AI Mag..