Knowledge-based verification of clinical guidelines by detection of anomalies

As shown in numerous studies, a significant part of published clinical guidelines is tainted with different types of semantical errors that interfere with their practical application. The adaptation of generic guidelines, necessitated by circumstances such as resource limitations within the applying organization or unexpected events arising in the course of patient care, further promotes the introduction of defects. Still, most current approaches for the automation of clinical guidelines are lacking mechanisms, which check the overall correctness of their output. In the domain of software engineering in general and in the domain of knowledge-based systems (KBS) in particular, a common strategy to examine a system for potential defects consists in its verification. The focus of this work is to present an approach, which helps to ensure the semantical correctness of clinical guidelines in a three-step process. We use a particular guideline specification language called Asbru to demonstrate our verification mechanism. A scenario-based evaluation of our method is provided based on a guideline for the artificial ventilation of newborn infants. The described approach is kept sufficiently general in order to allow its application to several other guideline representation formats.

[1]  Pedro Meseguer,et al.  On the Terminology of VVT , 1991, EUROVAV.

[2]  Mysore Ramaswamy,et al.  Global Verification of Knowledge Based Systems via Local Verification of Partitions , 1997, EUROVAV.

[3]  M. Field,et al.  Clinical practice guidelines : directions for a new program , 1990 .

[4]  Frank van Harmelen,et al.  Applying rule-base anomalies to KADS inference structures , 1997, Decis. Support Syst..

[5]  M A Musen,et al.  A model for critiquing based on automated medical records. , 1991, Computers and biomedical research, an international journal.

[6]  Barry W. Boehm,et al.  Verifying and Validating Software Requirements and Design Specifications , 1989, IEEE Software.

[7]  Luca Gatti,et al.  Supporting Tools for Guideline Development and Dissemination , 1997, AIME.

[8]  Yuval Shahar,et al.  ASBRU: A TASK-SPECIFIC, INTENTION-BASED, AND TIME-ORIENTED LANGUAGE FOR REPRESENTING SKELETAL PLANS , 1999 .

[9]  McDonald Cj,et al.  Guidelines You Can Follow and Can Trust: An Ideal and an Example , 1994 .

[10]  Lucila Ohno-Machado,et al.  GEODE-CM: A State-Transition Framework for Clinical Management , 1996 .

[11]  Derek L. Nazareth,et al.  Investigating the Applicability of Petri Nets for Rule-Based System Verification , 1993, IEEE Trans. Knowl. Data Eng..

[12]  B. Webber,et al.  Proceedings of the 18th Annual Symposium on Computer Applications in Medical Care , 1994 .

[13]  Yuval Shahar,et al.  Synthesis of Research: EON: A Component-Based Approach to Automation of Protocol-Directed Therapy , 1996, J. Am. Medical Informatics Assoc..

[14]  Alun Preece,et al.  An effective logical framework for knowledge-based systems verification , 1994 .

[15]  R A Greenes,et al.  Representation of clinical practice guidelines through an interactive World-Wide-Web interface. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[16]  Frank van Harmelen,et al.  Validation and Verification of Conceptual Models of Diagnosis , 1997, EUROVAV.

[17]  Lawrence M. Fagan,et al.  Validating the Knowledge Base of a Therapy Planning System , 1989, Methods of Information in Medicine.

[18]  P L Miller,et al.  Using semantic constraints to help verify the completeness of a computer-based clinical guideline for childhood immunization. , 1999, Computer methods and programs in biomedicine.

[19]  Yuval Shahar,et al.  Multi-Level Verification of Clinical Protocols , 1998, EUROVAV.

[20]  G Hripcsak,et al.  The Columbia-Presbyterian Medical Center decision-support system as a model for implementing the Arden Syntax. , 1991, Proceedings. Symposium on Computer Applications in Medical Care.

[21]  Catholijn M. Jonker,et al.  Compositional Verification of Knowledge-based Systems: a Case Study in Diagnostic Reasoning , 1997, EUROVAV.

[22]  Lawrence M. Fagan,et al.  Episodic skeletal-plan refinement on temporal data , 1987 .

[23]  M A Musen,et al.  Domain Ontologies in Software Engineering: Use of Protégé with the EON Architecture , 1998, Methods of Information in Medicine.

[24]  W. Hammond,et al.  Computerized decision support based on a clinical practice guideline improves compliance with care standards. , 1997, The American journal of medicine.

[25]  M. Field,et al.  Medical practice guidelines: current activities and future directions. , 1990, Annals of internal medicine.

[26]  Yuval Shahar,et al.  Intention-based critiquing of guideline-oriented medical care , 1998, AMIA.

[27]  G O Barnett,et al.  An architecture for a distributed guideline server. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[28]  R A Greenes,et al.  Improving Clinical Guidelines with Logic and Decision-table Techniques , 1994, Medical decision making : an international journal of the Society for Medical Decision Making.

[29]  Tin A. Nguyen,et al.  Knowledge base verification , 1987 .

[30]  James F. Allen.  Maintaining knowledge about temporal intervals , 1983, CACM.

[31]  Jean-Pierre H. Laurent.  Proposals for a Valid Terminology in KBS Validation , 1992, ECAI.

[32]  S W Tu,et al.  A temporal-abstraction mediator for protocol-based decision-support systems. , 1994, Proceedings. Symposium on Computer Applications in Medical Care.

[33]  S. Tu,et al.  A Methodology for Determining Patients’ Eligibility for Clinical Trials , 1993, Methods of Information in Medicine.

[34]  Richard G. Hamlet.  Introduction to special section on software testing , 1988, CACM.

[35]  John C. Cherniavsky,et al.  Validation, Verification, and Testing of Computer Software , 1982, CSUR.

[36]  John Yen,et al.  CLASP: Integrating Term Subsumption Systems and Production Systems , 1991, IEEE Trans. Knowl. Data Eng..

[37]  Alun D. Preece,et al.  Validating dynamic properties of rule-based systems , 1996, Int. J. Hum. Comput. Stud..

[38]  Jean-François Rit,et al.  Propagating Temporal Constraints for Scheduling , 1986, AAAI.

[39]  Robert A. Greenes,et al.  Research Paper: The GuideLine Interchange Format: A Model for Representing Guidelines , 1998, J. Am. Medical Informatics Assoc..

[40]  C J McDonald,et al.  Guidelines you can follow and can trust. An ideal and an example. , 1994, JAMA.

[41]  Osman Balci,et al.  Validating Expert System Performance , 1987, IEEE Expert.

[42]  M. Field,et al.  Guidelines for Clinical Practice: From Development to Use , 1992 .

[43]  D. Fridsma,et al.  Making generic guidelines site-specific. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[44]  Robert M. O'Keefe,et al.  Knowledge Base Verification , 1997 .

[45]  Lance A. Miller,et al.  Dynamic testing of knowledge bases using the heuristic testing approach , 1990 .

[46]  Lawrence M. Fagan,et al.  Knowledge engineering for a clinical trial advice system: uncovering errors in protocol specification. , 1987, Bulletin du cancer.

[47]  T A Pryor,et al.  Rationale for the Arden Syntax. , 1994, Computers and biomedical research, an international journal.

[48]  R C Barrows,et al.  A decision-supported outpatient practice system. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[49]  S W Tu,et al.  The EON model of intervention protocols and guidelines. , 1996, Proceedings : a conference of the American Medical Informatics Association. AMIA Fall Symposium.

[50]  Richard N. Shiffman,et al.  Model Formulation: Representation of Clinical Practice Guidelines in Conventional and Augmented Decision Tables , 1997, J. Am. Medical Informatics Assoc..

[51]  Douglas B. Fridsma,et al.  Representing the work of medical protocols for organizational simulation , 1998, AMIA.

[52]  Lawrence M. Fagan,et al.  T-HELPER: automated support for community-based clinical research. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[53]  Edward H. Shortliffe,et al.  Completeness and consistency in a rule-based expert system , 1984 .

[54]  G Hripcsak,et al.  Using intermediate states to improve the ability of the Arden Syntax to implement care plans and reuse knowledge. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[55]  J. Marc Overhage,et al.  Case Report: Computerizing Guidelines to Improve Care and Patient Outcomes: The Example of Heart Failure , 1995, J. Am. Medical Informatics Assoc..

[56]  John Fox,et al.  Protocols for Medical Procedures and Therapies: A Provisional Description of the PROforma Language and Tools , 1997, AIME.

[57]  Stephen B. Johnson,et al.  Design of a clinical event monitor. , 1996, Computers and biomedical research, an international journal.

[58]  George Hripcsak,et al.  Issues and Structures for Sharing Medical Knowledge Among Decision-Making Systems: The 1989 Arden Homestead Retreat , 1989 .

[59]  Mark A. Musen,et al.  Development of a guideline authoring tool with PROTÉGÉ II, based on the DILEMMA Generic Protocol and Guideline Model , 1996 .

[60]  Alun D. Preece,et al.  Principles and practice in verifying rule-based systems , 1992, Knowl. Eng. Rev..

[61]  G Hripcsak,et al.  Writing Arden Syntax Medical Logic Modules. , 1994, Computers in biology and medicine.

[62]  A Jackson-Smale,et al.  Protocols for clinical care. , 1995, Computer methods and programs in biomedicine.

[63]  Marc Ayel,et al.  Validation, verification and test of knowledge-based systems , 1991 .

[64]  Keith E. Williamson,et al.  Inconsistency and redundancy checking for quasi-first-order-logic knowledge bases , 1993 .

[65]  S Uckun,et al.  Instantiating and monitoring skeletal treatment plans. , 1996, Methods of information in medicine.

[66]  Yuval Shahar,et al.  The Asgaard project: a task-specific framework for the application and critiquing of time-oriented clinical guidelines , 1998, Artif. Intell. Medicine.

[67]  La Clarke,et al.  SPECIAL SECTION ON SOFTWARE TESTING - INTRODUCTION , 1988 .

[68]  George Hripcsak,et al.  Requirements of a Sharable Guideline Representation for Computer Applications , 1996 .

[69]  Alun D. Preece,et al.  Foundation and application of knowledge base verification , 1994, Int. J. Intell. Syst..

[70]  Douglas B. Fridsma,et al.  Representing Medical Protocols for Organizational Simulation: An Information-Processing Approach , 1998, Comput. Math. Organ. Theory.