Development and evaluation of an ontology for guiding appropriate antibiotic prescribing

OBJECTIVES To develop and apply formal ontology creation methods to the domain of antimicrobial prescribing and to formally evaluate the resulting ontology through intrinsic and extrinsic evaluation studies. METHODS We extended existing ontology development methods to create the ontology and implemented the ontology using Protégé-OWL. Correctness of the ontology was assessed using a set of ontology design principles and domain expert review via the laddering technique. We created three artifacts to support the extrinsic evaluation (set of prescribing rules, alerts and an ontology-driven alert module, and a patient database) and evaluated the usefulness of the ontology for performing knowledge management tasks to maintain the ontology and for generating alerts to guide antibiotic prescribing. RESULTS The ontology includes 199 classes, 10 properties, and 1636 description logic restrictions. Twenty-three Semantic Web Rule Language rules were written to generate three prescribing alerts: (1) antibiotic-microorganism mismatch alert; (2) medication-allergy alert; and (3) non-recommended empiric antibiotic therapy alert. The evaluation studies confirmed the correctness of the ontology, usefulness of the ontology for representing and maintaining antimicrobial treatment knowledge rules, and usefulness of the ontology for generating alerts to provide feedback to clinicians during antibiotic prescribing. CONCLUSIONS This study contributes to the understanding of ontology development and evaluation methods and addresses one knowledge gap related to using ontologies as a clinical decision support system component-a need for formal ontology evaluation methods to measure their quality from the perspective of their intrinsic characteristics and their usefulness for specific tasks.

[1]  Gloria Gomez,et al.  CmapTools: A Knowledge Modeling and Sharing Environment , 2004 .

[2]  S Bronzwaer,et al.  The European Community strategy against antimicrobial resistance. , 2004, Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin.

[3]  Samson W. Tu,et al.  Writing Rules for the Semantic Web Using SWRL and Jess , 2005 .

[4]  Thomas R. Gruber,et al.  Toward principles for the design of ontologies used for knowledge sharing? , 1995, Int. J. Hum. Comput. Stud..

[5]  J E Rogers,et al.  Quality Assurance of Medical Ontologies , 2006, Methods of Information in Medicine.

[6]  Deborah L. McGuinness,et al.  OWL Web ontology language overview , 2004 .

[7]  Olivier Bodenreider,et al.  Bio-ontologies: current trends and future directions , 2006, Briefings Bioinform..

[8]  James A. Hendler,et al.  The Semantic Web" in Scientific American , 2001 .

[9]  George Hripcsak,et al.  Research Paper: Knowledge-based Approaches to the Maintenance of a Large Controlled Medical Terminology , 1994, J. Am. Medical Informatics Assoc..

[10]  Jay P. Sanford.  The Sanford Guide to Antimicrobial Therapy , 2000 .

[11]  A. Cheng,et al.  Improved susceptibility of Gram-negative bacteria in an intensive care unit following implementation of a computerized antibiotic decision support system. , 2010, The Journal of antimicrobial chemotherapy.

[12]  Wendy Hall,et al.  The Semantic Web Revisited , 2006, IEEE Intelligent Systems.

[13]  Li Li,et al.  Practical experience with the maintenance and auditing of a large medical ontology , 2009, J. Biomed. Informatics.

[14]  J. Cimino.  Desiderata for Controlled Medical Vocabularies in the Twenty-First Century , 1998, Methods of Information in Medicine.

[15]  Henrik Eriksson,et al.  The evolution of Protégé: an environment for knowledge-based systems development , 2003, Int. J. Hum. Comput. Stud..

[16]  Samson W. Tu,et al.  Developing a Web-Based Application using OWL and SWRL , 2008, AAAI Spring Symposium: AI Meets Business Rules and Process Management.

[17]  N. F. Noy,et al.  Ontology Development 101: A Guide to Creating Your First Ontology , 2001 .

[18]  L. Leibovici,et al.  Departmental consumption of antibiotic drugs and subsequent resistance: a quantitative link. , 2001, The Journal of antimicrobial chemotherapy.

[19]  A. Gómez-Pérez,et al.  Evaluation of ontologies , 2001, Int. J. Intell. Syst..

[20]  Timothy G. Ferris,et al.  Adolescents Impact of a Computerized Template on Antibiotic Prescribing for Acute Respiratory Infections in , 2010 .

[21]  Ronald Cornet,et al.  Two DL-based Methods for Auditing Medical Terminological Systems , 2005, AMIA.

[22]  Michael Uschold,et al.  Ontologies: principles, methods and applications , 1996, The Knowledge Engineering Review.

[23]  Marc Lipsitch,et al.  Seasonality of antibiotic-resistant streptococcus pneumoniae that causes acute otitis media: a clue for an antibiotic-restriction policy? , 2008, The Journal of infectious diseases.

[24]  Christopher G Chute,et al.  National Center for Biomedical Ontology: advancing biomedicine through structured organization of scientific knowledge. , 2006, Omics : a journal of integrative biology.

[25]  C. Bantar,et al.  A hospitalwide intervention program to optimize the quality of antibiotic use: impact on prescribing practice, antibiotic consumption, cost savings, and bacterial resistance. , 2003, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[26]  Rogers P Pole.  The GALEN High Level Ontology , 1996 .

[27]  Holger Knublauch,et al.  The Protégé OWL Plugin: An Open Development Environment for Semantic Web Applications , 2004, SEMWEB.

[28]  Huajun Chen,et al.  The Semantic Web , 2011, Lecture Notes in Computer Science.

[29]  Volker Haarslev,et al.  Description of the RACER System and its Applications , 2001, Description Logics.

[30]  Alexander C. Yu,et al.  Methods in biomedical ontology , 2006, J. Biomed. Informatics.

[31]  M. Musen.  Scalable Software Architectures for Decision Support , 1999, Methods of Information in Medicine.

[32]  M. Uschold,et al.  Methods and applications , 1953 .

[33]  Huanying Gu,et al.  Relationship auditing of the FMA ontology , 2009, J. Biomed. Informatics.

[34]  Marko Grobelnik,et al.  A SURVEY OF ONTOLOGY EVALUATION TECHNIQUES , 2005 .

[35]  James J. Cimino,et al.  Research Paper: Auditing the Unified Medical Language System with Semantic Methods , 1998, J. Am. Medical Informatics Assoc..

[36]  Barry Smith,et al.  Biodynamic ontology: applying BFO in the biomedical domain. , 2004, Studies in health technology and informatics.

[37]  Martin J. O'Connor,et al.  SQWRL: A Query Language for OWL , 2009, OWLED.

[38]  Christopher G. Chute,et al.  Viewpoint Paper: Auditing the Semantic Completeness of SNOMED CT Using Formal Concept Analysis , 2009, J. Am. Medical Informatics Assoc..

[39]  Nigel Shadbolt,et al.  Laddering: technique and tool use in knowledge acquisition , 1994 .

[40]  Ida Sim,et al.  An ontology of randomized controlled trials for evidence-based practice: content specification and evaluation using the competency decomposition method , 2007 .

[41]  Eli N. Perencevich,et al.  Impact of a computerized clinical decision support system on reducing inappropriate antimicrobial use: a randomized controlled trial. , 2006, Journal of the American Medical Informatics Association : JAMIA.

[42]  Kent A. Spackman,et al.  SNOMED clinical terms: overview of the development process and project status , 2001, AMIA.

[43]  M. Ashburner,et al.  The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration , 2007, Nature Biotechnology.

[44]  Alan L. Rector,et al.  Editing Description Logic Ontologies with the Protégé OWL Plugin , 2004, Description Logics.

[45]  Ira J. Kalet,et al.  Content-specific auditing of a large scale anatomy ontology , 2009, J. Biomed. Informatics.

[46]  T. Clemmer,et al.  A computer-assisted management program for antibiotics and other antiinfective agents. , 1998, The New England journal of medicine.

[47]  H. Lan,et al.  SWRL : A semantic Web rule language combining OWL and ruleML , 2004 .

[48]  Ross D King,et al.  Are the current ontologies in biology good ontologies? , 2005, Nature Biotechnology.

[49]  Natalya F. Noy,et al.  BioPortal: Ontologies and Integrated Data Resources at the Click of a Mouse , 2009 .