Use of metaknowledge in the verification of knowledge-based systems

Knowledge-based systems are modeled as deductive systems. The model indicates that the two primary areas of concern in verification are demonstrating consistency and completeness. A system is inconsistent if it asserts something that is not true of the modeled domain. A system is incomplete if it lacks deductive capability. Two forms of consistency are discussed along with appropriate verification methods. Three forms of incompleteness are discussed. The use of metaknowledge, knowledge about knowledge, is explored in connection to each form of incompleteness.

[1]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[2]  Larry Joe Morell A theory of error-based testing , 1983 .

[3]  Alex Goodall,et al.  The guide to expert systems , 1985 .

[4]  William E. Howden,et al.  Weak Mutation Testing and Completeness of Test Sets , 1982, IEEE Transactions on Software Engineering.

[5]  Lori A. Clarke,et al.  A System to Generate Test Data and Symbolically Execute Programs , 1976, IEEE Transactions on Software Engineering.

[6]  James S Collofello,et al.  Introduction to Software Verification and Validation , 1988 .

[7]  Tin A. Nguyen,et al.  Knowledge base verification , 1987 .

[8]  Frederick Hayes-Roth,et al.  Building expert systems , 1983, Advanced book program.

[9]  Nancy G. Leveson,et al.  Analyzing Software Safety , 1983, IEEE Transactions on Software Engineering.

[10]  Casimir A. Kulikowski,et al.  A Practical Guide to Designing Expert Systems , 1984 .

[11]  Nancy G. Leveson,et al.  Safety Analysis Using Petri Nets , 1987, IEEE Transactions on Software Engineering.

[12]  Richard J. Lipton,et al.  Theoretical and empirical studies on using program mutation to test the functional correctness of programs , 1980, POPL '80.

[13]  William E. Howden,et al.  Symbolic Testing and the DISSECT Symbolic Evaluation System , 1977, IEEE Transactions on Software Engineering.

[14]  Richard G. Hamlet,et al.  Error Propagation and Elimination in Computer Programs. , 1981 .

[15]  Rolf Stachowitz,et al.  Validation of expert systems , 1988 .

[16]  Osman Balci,et al.  Validating Expert System Performance , 1987, IEEE Expert.

[17]  Neil D. Jones,et al.  Program Flow Analysis: Theory and Application , 1981 .

[18]  Leon J. Osterweil,et al.  Data Flow Analysis in Software Reliability , 1976, CSUR.

[19]  Janusz W. Laski,et al.  A Data Flow Oriented Program Testing Strategy , 1983, IEEE Transactions on Software Engineering.

[20]  Larry J Morell,et al.  Unit Testing and Analysis , 1989 .

[21]  Wendell R. Ricks,et al.  Traditional Versus Rule-Based Programming Techniques: Application To The Control Of Optional Flight Information , 1987, Other Conferences.