Approximate declarative semantics for rule base anomalies

Abstract Despite the fact that there has been a surge of publications in verification and validation of knowledge-based systems and expert systems in the past decade, there are still gaps in the study of verification and validation (V&V) of expert systems, not the least of which is the lack of appropriate semantics for expert system programming languages. Without a semantics, it is hard to formally define and analyze knowledge base anomalies such as inconsistency and redundancy, and it is hard to assess the effectiveness of V&V tools, methods and techniques that have been developed or proposed. In this paper, we develop an approximate declarative semantics for rule-based knowledge bases and provide a formal definition and analysis of knowledge base inconsistency, redundancy, circularity and incompleteness in terms of theories in the first order predicate logic. In the paper, we offer classifications of commonly found cases of inconsistency, redundancy, circularity and incompleteness. Finally, general guidelines on how to remedy knowledge base anomalies are given.

[1]  Edward H. Shortliffe,et al.  An Approach to Verifying Completeness and Consistency in a Rule-Based Expert System , 1982, AI Mag..

[2]  Wei-Tek Tsai,et al.  Pragmatic Testing Methods for Expert Systems , 1993, Int. J. Artif. Intell. Tools.

[3]  Chris Culbert,et al.  State-of-the-practice in knowledge-based system verification and validation , 1991 .

[4]  John R. Josephson,et al.  What Are They? Why Do We Need Them? , 1999 .

[5]  A. Terry Bahill,et al.  Interactive verification of knowledge-based systems , 1993, IEEE Expert.

[6]  Alun Preece,et al.  State of the art in automated validation of knowledge-based systems☆ , 1994 .

[7]  T.J. Murray,et al.  Control of inconsistency and redundancy in Prolog-type knowledge bases , 1988, [1988] Proceedings of the Twenty-First Annual Hawaii International Conference on System Sciences. Volume III: Decision Support and Knowledge Based Systems Track.

[8]  Marie-Christine Rousset,et al.  On the consistency of knowledge bases: the COVADIS system , 1988, Comput. Intell..

[9]  Bob J. Wielinga,et al.  CommonKADS: a comprehensive methodology for KBS development , 1994, IEEE Expert.

[10]  Carolien Metselaar,et al.  The commonKADS organization model: Content, usage and computer support , 1996 .

[11]  Alun Preece,et al.  Verifying expert systems: A logical framework and a practical tool , 1992 .

[12]  Frans Coenen,et al.  Validation and Verification of Knowledge Based Systems , 1999, Springer US.

[13]  Gruia-Catalin Roman,et al.  Formal Verification of Pure Production System Programs , 1991, AAAI.

[14]  Uma G. Gupta.  Validating and Verifying Knowledge-Based Systems , 1991 .

[15]  Mark E. Stickel,et al.  Proving Properties of Rule-Based Systems , 1992, Int. J. Softw. Eng. Knowl. Eng..

[16]  Neli P. Zlatareva,et al.  A framework for verification, validation, and refinement of knowledge bases: The VVR system , 1994, Int. J. Intell. Syst..

[17]  Du Zhang,et al.  A TOOL FOR KNOWLEDGE BASE VERIFICATION , 1993 .

[18]  Hector J. Levesque,et al.  The Logic of Incomplete Knowledge Bases , 1982, On Conceptual Modelling.

[19]  Wei-Tek Tsai,et al.  Verification and Validation of Knowledge-Based Systems , 1999, IEEE Trans. Knowl. Data Eng..

[20]  Robert Plant,et al.  On the validation and verification of production systems: a graph reduction approach , 1996, Int. J. Hum. Comput. Stud..

[21]  Derek L. Nazareth,et al.  Investigating the Applicability of Petri Nets for Rule-Based System Verification , 1993, IEEE Trans. Knowl. Data Eng..

[22]  Luqi,et al.  How to Combine Nonmonotonic Logic and Rapid Prototyping to Help Maintain Software , 1995, Int. J. Softw. Eng. Knowl. Eng..

[23]  Henrik Legind Larsen,et al.  Detection of potential inconsistencies in knowledge bases , 1992, Int. J. Intell. Syst..

[24]  R. A. Stachowitz,et al.  A report on the Expert Systems Validation Associate (EVA) , 1990 .

[25]  James D. Kiper.  Structural testing of rule-based expert systems , 1992, TSEM.

[26]  Stewart Tansley,et al.  Knowledge-based systems analysis and design - a KADS developer's handbook , 1993, BCS practitioner series.

[27]  Harold J. Steudel,et al.  A Decision-Table-Based Processor for Checking Completeness and Consistency in Rule-Based Expert Systems , 1987, Int. J. Man Mach. Stud..

[28]  Marc Ayel,et al.  Validation, verification and test of knowledge-based systems , 1991 .

[29]  Keith E. Williamson,et al.  Inconsistency and redundancy checking for quasi-first-order-logic knowledge bases , 1993 .

[30]  Du Zhang.  Perspectives in Knowledge Base Verification , 1993, SEKE.

[31]  Daniel E. O'Leary,et al.  Using AI in Knowledge Management: Knowledge Bases and Ontologies , 1998, IEEE Intell. Syst..

[32]  John Rushby,et al.  Quality Measures and Assurance for AI Software1 , 1988 .

[33]  Tin A. Nguyen,et al.  Knowledge base verification , 1987 .

[34]  Michael R. Genesereth,et al.  Logical foundations of artificial intelligence , 1987 .

[35]  Wei-Tek Tsai,et al.  Evaluation of expert system testing methods , 1994, CACM.

[36]  Balakrishnan Chandrasekaran,et al.  What are ontologies, and why do we need them? , 1999, IEEE Intell. Syst..

[37]  Giovanni Guida,et al.  Design and Development of Knowledge-Based Systems: From Life Cycle to Methodology , 1994 .

[38]  Philippe Corriveau.  Book review: Knowledge-Based Systems Analysis and Design-A KADS Developer's Handbook by Stewart W. Tansley and Clive C. Hayball (Prentice Hall 1993) , 1995 .

[39]  Marc Ayel.  Verification and Validation of Knowledge Based Systems , 1996 .

[40]  James Nga-Kwok Liu,et al.  An approach towards the verification of expert systems using numerical petri nets , 1991, Int. J. Intell. Syst..

[41]  Kim W. Tracy,et al.  Object-oriented artificial intelligence using C++ , 1996 .

[42]  Ranjit Bose,et al.  Intelligent agents framework for developing knowledge-based decision support systems for collaborative organizational processes☆ , 1996 .

[43]  Richard C. T. Lee,et al.  Symbolic logic and mechanical theorem proving , 1973, Computer science classics.

[44]  Allen Ginsberg.  Knowledge-Base Reduction: A New Approach to Checking knowledge Bases for Inconsistency and Redundancy , 1988, AAAI.

[45]  Luqi.  Knowledge-based support for rapid software prototyping , 1988, IEEE Expert.

[46]  Daniel E. O'Leary,et al.  Verification and validation of intelligent systems: Five years of aaai workshops , 1994, Int. J. Intell. Syst..