Validation and verification of knowledge-based systems: A survey

Validation and verification of expert systems or knowledge-based systems is a critical issue in the development and deployment of robust systems. This article is a comprehensive survey of the developments and trends in this field. More than 300 references are included in the References and Additional Readings at the end of article.

[1]  Randall Davis,et al.  Interactive Transfer of Expertise: Acquisition of New Inference Rules , 1993, IJCAI.

[2]  Lawrence M. Fagan,et al.  Antimicrobial selection by a computer. A blinded evaluation by infectious diseases experts. , 1979, JAMA.

[3]  John Gaschnig,et al.  Preliminary Performance Analysis of the PROSPECTOR Consultant System for Mineral Exploration , 1979, IJCAI.

[4]  A. C. Scott,et al.  Evaluating the performance of a computer-based consultant. , 1979, Computer programs in biomedicine.

[5]  Osman Balci,et al.  A methodology for cost-risk analysis in the statistical validation of simulation models , 1981, CACM.

[6]  Roger T. Hartley.  How Expert Should an Expert System Be? , 1981, IJCAI.

[7]  Hector J. Levesque,et al.  The Logic of Incomplete Knowledge Bases , 1982, On Conceptual Modelling.

[8]  John C. Cherniavsky,et al.  Validation, Verification, and Testing of Computer Software , 1982, CSUR.

[9]  Edward H. Shortliffe,et al.  An Approach to Verifying Completeness and Consistency in a Rule-Based Expert System , 1982, AI Mag..

[10]  Frederick Hayes-Roth,et al.  Building expert systems , 1983, Advanced book program.

[11]  Donald W. Loveland,et al.  Detecting Ambiguity: An Example in Knowledge Evaluation , 1983, IJCAI.

[12]  Balakrishnan Chandrasekaran,et al.  On evaluating ai systems for medical diagnosis , 1989 .

[13]  Barry W. Boehm,et al.  Verifying and Validating Software Requirements and Design Specifications , 1989, IEEE Software.

[14]  John P. McDermott,et al.  R1 Revisited: Four Years in the Trenches , 1984, AI Mag..

[15]  R. Sargent,et al.  Validation of Simulation Models via Simultaneous Confidence Intervals , 1984 .

[16]  Sholom M. Weiss,et al.  Using Empirical Analysis to Refine Expert System Knowledge Bases , 1984, Artif. Intell..

[17]  Tom M. Mitchell,et al.  Representation and Use of Explicit Justifications for Knowledge Base Refinements , 1985, IJCAI.

[18]  Michael Z. Bell,et al.  Why Expert Systems Fail , 1985 .

[19]  Johanna D. Moore,et al.  Enhanced Maintenance and Explanation of Expert Systems Through Explicit Models of Their Development , 1984, IEEE Transactions on Software Engineering.

[20]  Gary S. Kahn,et al.  MORE: An Intelligent Knowledge Acquisition Tool , 1985, IJCAI.

[21]  Johanna D. Moore,et al.  Explainable (and Maintainable) Expert Systems , 1985, IJCAI.

[22]  Walton A. Perkins,et al.  Checking an Expert Systems Knowledge Base for Consistency and Completeness , 1985, IJCAI.

[23]  S. K. Goyal,et al.  The COMPASS Expert System: Verification, Technology Transfer, and Expansion , 1985, Conference on Artificial Intelligence Applications.

[24]  Daniel G. Bobrow,et al.  If Prolog is the Answer, What is the Question? or What it Takes to Support AI Programming Paradigms , 1985, IEEE Transactions on Software Engineering.

[25]  Robert G. Sargent,et al.  An expository on verification and validation of simulation models , 1985, WSC '85.

[26]  Edward H. Shortliffe,et al.  The treatment advice of a computer-based cancer chemotherapy protocol advisor. , 1985, Annals of internal medicine.

[27]  Peter G. Politakis,et al.  Empirical analysis for expert systems , 1985 .

[28]  Oskar Dressler.  Assumption-Based Truth Maintenance , 1986, Begründungsverwaltung.

[29]  Timothy W. Finin,et al.  Interactive classification: A technique for acquiring and maintaining knowledge bases , 1984, Proceedings of the IEEE.

[30]  Robert J. K. Jacob,et al.  Developing a Software Engineering Methodology for Knowledge-Based Systems. , 1986 .

[31]  John P. McDermott,et al.  The Taming of R1 , 1986, IEEE Expert.

[32]  Mark H. Richer.  An evaluation of expert system development tools , 1986 .

[33]  B. Chandrasekaran,et al.  Generic Tasks in Knowledge-Based Reasoning: High-Level Building Blocks for Expert System Design , 1986, IEEE Expert.

[34]  Robert J. K. Jacob,et al.  Software engineering for rule-based systems , 1986 .

[35]  Daniel G. Bobrow,et al.  Expert systems: perils and promise , 1986, CACM.

[36]  Robert G. Sargent,et al.  The use of graphical models in model validation , 1986, WSC '86.

[37]  David C. Wilkins,et al.  On Debugging Rule Sets When Reasoning Under Uncertainty , 1986, AAAI.

[38]  Jay Liebowitz,et al.  Useful approach for evaluating expert systems , 1986 .

[39]  Paul Siegel.  Expert systems: A non-programmer's guide to development and applications , 1986 .

[40]  Victor W. Marek,et al.  Completeness and Consistency in Knowledge Base Systems , 1986, Expert Database Conf..

[41]  Valerie Belton,et al.  Experiences with Using Expert Systems in O.R. , 1986 .

[42]  Rayman D. Meservy,et al.  Internal Control Evaluation: A Computational Model of the Review Process , 1986 .

[43]  Douglas B. Lenat,et al.  CYC: Using Common Sense Knowledge to Overcome Brittleness and Knowledge Acquisition Bottlenecks , 1986, AI Mag..

[44]  Randall D. Beer,et al.  Knowledge-Based Validity Maintenance for Production Systems , 1986, AAAI.

[45]  Lawrence M. Fagan,et al.  Using Decision Theory to Justify Heuristics , 1986, AAAI.

[46]  Johan de Kleer,et al.  An Assumption-Based TMS , 1987, Artif. Intell..

[47]  Chris Culbert,et al.  Approaches to the verification of rule-based expert systems , 1987 .

[48]  Mary Ann Goodwin,et al.  Expert system verification concerns in an operations environment , 1987 .

[49]  Rolf Stachowitz,et al.  Validation of knowledge-based systems , 1987 .

[50]  David A. Cleaves,et al.  Cognitive Biases and Corrective Techniques: Proposals for Improving Elicitation Procedures for Knowledge-Based Systems , 1987, Int. J. Man Mach. Stud..

[51]  J. Rothenberg.  Evaluating expert system tools: a framework and methodology , 1987 .

[52]  Rolf Stachowitz,et al.  Building validation tools for knowledge-based systems , 1987 .

[53]  Robert E. Wagner,et al.  Beyond rules: The next generation of expert systems , 1987 .

[54]  Harold J. Steudel,et al.  A Decision-Table-Based Processor for Checking Completeness and Consistency in Rule-Based Expert Systems , 1987, Int. J. Man Mach. Stud..

[55]  Andrew Barton.  Experiences in Expert Systems , 1987 .

[56]  Janos Sztipanovits,et al.  Testing And Validation In Artificial Intelligence Programming , 1987, Other Conferences.

[57]  Larry J. Eshelman,et al.  MOLE: A Tenacious Knowledge-Acquisition Tool , 1987, Int. J. Man Mach. Stud..

[58]  Perry L. Miller,et al.  Knowledge Acquisition and Veritication Tools for Medical Expert Systems , 1987 .

[59]  Manuel Silva Suárez,et al.  Modeling, validation and software implementation of production systems using high level Petri nets , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[60]  Osman Balci,et al.  Validating Expert System Performance , 1987, IEEE Expert.

[61]  Daniel E. O'Leary,et al.  VALIDATION OF EXPERT SYSTEMS- WITH APPLICATIONS TO AUDITING AND ACCOUNTING EXPERT SYSTEMS* , 1987 .

[62]  Janos Sztipanovits,et al.  Methodology for testing and validating knowledge bases , 1987 .

[63]  Izak Benbasat,et al.  Process Tracing Methods in Decision Support Systems Research: Exploring the Black Box , 1987, MIS Q..

[64]  Stephen W. Smoliar,et al.  On making expert systems more like experts , 1987 .

[65]  Elliot Soloway,et al.  Assessing the Maintainability of XCON-in-RIME: Coping with the Problems of a VERY Large Rule-Base , 1987, AAAI.

[66]  K. Richardson,et al.  KBS V and V as related to automation of space station subsystems: Rationale for a KBS lifecycle , 1987 .

[67]  Barry B. Flachsbart,et al.  Using output to evaluate and refine rules in rule-based expert systems , 1987 .

[68]  Shashi Shekhar,et al.  Software Development Support for AI Programs , 1987, Computer.

[69]  David R. Barstow,et al.  Artificial intelligence and software engineering , 1987, ICSE '87.

[70]  John Mingers,et al.  Expert Systems—Rule Induction with Statistical Data , 1987 .

[71]  Paul N. Finlay,et al.  The Validation of Expert Systems — Contrasts with Traditional Methods , 1988 .

[72]  Sholom M. Weiss,et al.  Automatic Knowledge Base Refinement for Classification Systems , 1988, Artif. Intell..

[73]  Raymond T. Yeh,et al.  Specification and verification of liveness properties of cyclic, concurrent processes , 1988, TOPL.

[74]  Marie-Christine Rousset,et al.  On the consistency of knowledge bases: the COVADIS system , 1988, Comput. Intell..

[75]  Pamela K. Coats.  Why Expert Systems Fail , 1988 .

[76]  Daniel E. O'Leary,et al.  Validating the weights in rule-based expert systems: a statistical approach , 1988 .

[77]  Paul Compton,et al.  The Knowledge Dictionary: A Relational Tool for the Maintenance of Expert Systems , 1988, FGCS.

[78]  Paliath Narendran,et al.  Formal Verification of the , 1988 .

[79]  John Rushby,et al.  Quality Measures and Assurance for AI Software1 , 1988 .

[80]  R. Ryan Dupont,et al.  FORMAL EVALUATION OF THE EXPERT SYSTEM DEMOTOX , 1988 .

[81]  W.R. Franklin,et al.  Debugging and tracing expert systems , 1988, [1988] Proceedings of the Twenty-First Annual Hawaii International Conference on System Sciences. Volume III: Decision Support and Knowledge Based Systems Track.

[82]  Alain Beauvieux.  A Method to Check Knowledge Base Consistency , 1988, FSTTCS.

[83]  Alan Bundy,et al.  How to improve the reliability of expert systems , 1988 .

[84]  Barry W. Boehm,et al.  A spiral model of software development and enhancement , 1986, Computer.

[85]  B. Humpert,et al.  Expert systems in finance planning , 1988 .

[86]  Marion G. Sobol,et al.  Systems analysis techniques for the implementation of expert systems , 1988 .

[87]  Rolf Stachowitz,et al.  Validation of expert systems , 1988 .

[88]  Mildred L. G. Shaw,et al.  Validation in a Knowledge Support System: Construing and Consistency with Multiple Experts , 1988, Int. J. Man Mach. Stud..

[89]  Larry J. Morell.  Use of metaknowledge in the verification of knowledge-based systems , 1988, IEA/AIE '88.

[90]  Greg P. Kearsley.  Validation of an expert system: the CBT analyst , 1988 .

[91]  Daniel E. O'Leary.  On the Representation and the Impact of Reliability on Expert System Weights , 1988, Int. J. Man Mach. Stud..

[92]  R. A. Stachowitz,et al.  Testing expert systems , 1988 .

[93]  Allen Ginsberg.  Knowledge-Base Reduction: A New Approach to Checking knowledge Bases for Inconsistency and Redundancy , 1988, AAAI.

[94]  Daniel E. O'Leary,et al.  Methods of Validating Expert Systems , 1988 .

[95]  James R. Slagle,et al.  A Method for Evaluating Candidate Expert System Applications , 1988, AI Mag..

[96]  Lawrence M. Fagan,et al.  Validating the Knowledge Base of a Therapy Planning System , 1989, Methods of Information in Medicine.

[97]  Paul R. Cohen,et al.  Toward AI research methodology: three case studies in evaluation , 1989, IEEE Trans. Syst. Man Cybern..

[98]  Chris Culbert,et al.  An expert system development methodology that supports verification and validation , 1989 .

[99]  J. P. Yoon.  Techniques for data and rule validation in knowledge based systems , 1989, Proceedings of the Fourth Annual Conference on Computer Assurance, 'Systems Integrity, Software Safety and Process Security.

[100]  Paul E. Lehner.  Toward an empirical approach to evaluating the knowledge base of an expert system , 1989, IEEE Trans. Syst. Man Cybern..

[101]  C. V. Ramamoorthy,et al.  Integrating the role of requirements specification into the process of prototyping: the protospec , 1989, [1989] Proceedings of the Twenty-Second Annual Hawaii International Conference on System Sciences. Volume II: Software Track.

[102]  Du Zhang,et al.  A technique for knowledge base verification , 1989, [Proceedings 1989] IEEE International Workshop on Tools for Artificial Intelligence.

[103]  Victor R. Basili,et al.  An Evaluation of Expert Systems for Software Engineering Management , 1989, IEEE Trans. Software Eng..

[104]  Derek L. Nazareth,et al.  Issues in the Verification of Knowledge in Rule-Based Systems , 1989, Int. J. Man Mach. Stud..

[105]  John Rushby,et al.  Formal verification of AI software , 1989 .

[106]  Erik Hollnagel,et al.  Evaluation of Expert Systems , 1989 .

[107]  Bruce W. Porter,et al.  Controlling Search for the Consequences of New Information During Knowledge Integration , 1989, ML.

[108]  Pamela W. Jordan,et al.  A software storming approach to rapid prototyping , 1989, [1989] Proceedings of the Twenty-Second Annual Hawaii International Conference on System Sciences. Volume II: Software Track.

[109]  James C. Hershauer,et al.  A field observation study of an expert system prototype development , 1989, Inf. Manag..

[110]  Yue Kang,et al.  A tool for detecting expert-system errors , 1989 .

[111]  David L. Hall,et al.  The use of simulation techniques for expert system test and evaluation , 1989 .

[112]  Thomas J. Martin,et al.  PFPS-Personal Financial Planning System , 1989, IAAI.

[113]  Andrew Kusiak,et al.  Knowledge bases: Integration, verification, and partitioning , 1989 .

[114]  L. J. McKell,et al.  Planman structure-a strategy for compromise , 1989 .

[115]  Michael Goul,et al.  A verification approach for knowledge-based systems , 1989 .

[116]  B. Oakley.  The problems of validating expert systems , 1989 .

[117]  Brian R. Gaines,et al.  Comparing conceptual structures: consensus, conflict, correspondence and contrast , 1989 .

[118]  Robert M. O’Keefe,et al.  The evaluation of decision-aiding systems: Guidelines and methods , 1989, Inf. Manag..

[119]  Ramón López de Mántaras,et al.  Validation Methods and Tools for Knowledge-Based Systems (VALID) , 1989, Wissensbasierte Systeme.

[120]  L. M. Gearhart,et al.  Managing the development and deployment of expert systems , 1989, Proceedings of the IEEE National Aerospace and Electronics Conference.

[121]  K. Pedersen,et al.  Well-structured knowledge bases, part III , 1989 .

[122]  Izak Benbasat,et al.  A framework for the validation of knowledge acquisition , 1989 .

[123]  Keith Levi,et al.  Expert systems should be more accurate than human experts: evaluation procedures from human judgement and decision making , 1989, IEEE Trans. Syst. Man Cybern..

[124]  K. Adlassnig,et al.  Performance evaluation of medical expert systems using ROC curves. , 1989, Computers and biomedical research, an international journal.

[125]  Pedro Meseguer,et al.  A New Method to Checking Rule Bases for Inconsistency: A Petri Net Approach , 1990, ECAI.

[126]  C.L. Chang,et al.  Validation of nonmonotonic knowledge-based systems , 1990, [1990] Proceedings of the 2nd International IEEE Conference on Tools for Artificial Intelligence.

[127]  Mark S. Fox,et al.  AI and expert system myths, legends, and facts , 1990, IEEE Expert.

[128]  Alun Preece,et al.  Towards a methodology for evaluating expert systems , 1990 .

[129]  Gary S. Kahn,et al.  A Methodology for Validating Large Knowledge Bases , 1990, Int. J. Man Mach. Stud..

[130]  M O'Neil,et al.  Evaluating and validating very large knowledge-based systems. , 1990, Medical informatics = Medecine et informatique.

[131]  Michael Goul,et al.  Validating expert systems , 1990, IEEE Expert.

[132]  Ching Y. Suen,et al.  Verifying, validating, and measuring the performance of expert systems , 1990 .

[133]  Robert J. K. Jacob,et al.  A Software Engineering Methodology for Rule-Based Systems , 1990, IEEE Trans. Knowl. Data Eng..

[134]  John Boardman,et al.  Practical evaluation of an intelligent knowledge-based project control system , 1990 .

[135]  Pedro Meseguer,et al.  Knowledge Based Systems Validation: A State of the Art , 1990, AI Commun..

[136]  Gautam Biswas,et al.  CHECKER: an efficient algorithm for knowledge base verification , 1990, IEA/AIE.

[137]  Thomas E. Pinelli,et al.  National Aeronautics and Space Administration Scientific and Technical Information Programs. , 1990 .

[138]  J.G. McGuire.  Uncovering redundancy and rule-inconsistency in knowledge bases via deduction , 1990, Fifth Annual Conference on Computer Assurance, Systems Integrity, Software Safety and Process Security..

[139]  Stewart N. T. Shen,et al.  The consistency problem of knowledge bases , 1990, IEA/AIE '90.

[140]  Graham F. Forsyth,et al.  Verification of heuristic diagnostic knowledge by comparison with a causal/qualitative model , 1990, IEA/AIE '90.

[141]  R. A. Stachowitz,et al.  A report on the Expert Systems Validation Associate (EVA) , 1990 .

[142]  John Yen,et al.  A Principled Approach to Reasoning About the Specificity ofRules , 1990, AAAI.

[143]  C. Landauer.  Correctness principles for rule-based expert systems☆ , 1990 .

[144]  Lance A. Miller,et al.  Dynamic testing of knowledge bases using the heuristic testing approach , 1990 .

[145]  John Yen,et al.  Designing verifiable expert systems , 1990, [1990] Proceedings of the 2nd International IEEE Conference on Tools for Artificial Intelligence.

[146]  Jay Liebowitz,et al.  Testing and evaluation of expert system prototype: a case study , 1990 .

[147]  S. Bologna,et al.  Dependable knowledge-based systems development and verification: what we can learn from software engineering and what we need , 1990, [1990] Proceedings of the 2nd International IEEE Conference on Tools for Artificial Intelligence.

[148]  Rick Evertsz,et al.  The Automated Analysis of Rule-based Systems, Based on their Procedural Semantics , 1991, IJCAI.

[149]  Carol E. Brown,et al.  Need an expert? Ask a computer , 1991 .

[150]  Eswaran Subrahmanian,et al.  A Methodology for Systematic Verification of OPS5-Based AI Applications , 1991, IJCAI.

[151]  Lewey Gilstrap,et al.  Validation and verification of expert systems , 1991 .

[152]  Uma G. Gupta.  Validating and Verifying Knowledge-Based Systems , 1991 .

[153]  John Rushby.  Validation and Testing of Knowledge-Based Systems - How bad can it get? , 1991 .

[154]  Peter Grogono,et al.  Specifying an expert system , 1991 .

[155]  Ching Y. Suen,et al.  Expert system evaluation techniques: a selected bibliography , 1991 .

[156]  Carol E. Brown,et al.  Expert Systems to Provide Financial Planning Benefits , 1991 .

[157]  Bruce Margot.  Testing your knowledge base , 1991 .

[158]  Christopher J. R. Green,et al.  Verification and validation of expert systems , 1991 .

[159]  A. Terry Bahill,et al.  Verifying and Validating Personal Computer-Based Expert Systems , 1991 .

[160]  Alun Preece,et al.  Practical approach to knowledge base verification , 1991, Defense, Security, and Sensing.

[161]  Chris Culbert,et al.  State-of-the-practice in knowledge-based system verification and validation , 1991 .

[162]  Ching Y. Suen,et al.  A survey of evaluation techniques used for expert systems in telecommunications , 1992 .

[163]  Alun Preece,et al.  Verifying expert systems: A logical framework and a practical tool , 1992 .

[164]  Empirical study of expert system development , 1992, Knowl. Based Syst..

[165]  Alun D. Preece,et al.  Verifying Knowledge Bases by Anomaly Detection: An Experience Report , 1992, ECAI.

[166]  James D. Kiper.  Structural testing of rule-based expert systems , 1992, TSEM.

[167]  Alun D. Preece,et al.  Verifying Knowledge-Based Systems Using the COVER Tool , 1992, IFIP Congress.

[168]  Robert M. O'Keefe,et al.  Knowledge Base Verification , 1997 .

[169]  Marco Valtorta,et al.  Knowledge base refinement: A bibliography , 1991, Applied Intelligence.