AI Driven Knowledge Extraction from Clinical Practice Guidelines: Turning Research into Practice

Background and Objectives: Clinical Practice Guidelines (CPGs) represent the foremost methodology for sharing state-of-the-art research findings in the healthcare domain with medical practitioners to limit practice variations, reduce clinical cost, improve the quality of care, and provide evidence based treatment. However, extracting relevant knowledge from the plethora of CPGs is not feasible for already burdened healthcare professionals, leading to large gaps between clinical findings and real practices. It is therefore imperative that state-of-the-art Computing research, especially machine learning is used to provide artificial intelligence based solution for extracting the knowledge from CPGs and reducing the gap between healthcare research/guidelines and practice. Methods: This research presents a novel methodology for knowledge extraction from CPGs to reduce the gap and turn the latest research findings into clinical practice. First, our system classifies the CPG sentences into four classes such as condition-action, condition-consequences, action, and not-applicable based on the information presented in a sentence. We use deep learning with state-of-the-art word embedding, improved word vectors technique in classification process. Second, it identifies qualifier terms in the classified sentences, which assist in recognizing the condition and action phrases in a sentence. Finally, the condition and action phrase are processed and transformed into plain rule If Condition(s) Then Action format. Results: We evaluate the methodology on three different domains guidelines including Hypertension, Rhinosinusitis, and Asthma. The deep learning model classifies the CPG sentences with an accuracy of 95%. While rule extraction was validated by user-centric approach, which achieved a Jaccard coefficient of 0.6, 0.7, and 0.4 with three human experts extracted rules, respectively.

[1]  Øystein Nytrø,et al.  Reviewing clinical guideline development tools: features and characteristics , 2017, BMC Medical Informatics and Decision Making.

[2]  Martyn R Partridge,et al.  British Guideline on the Management of Asthma , 2008, Thorax.

[3]  Laurie A. Williams,et al.  TMAP: Discovering relevant API methods through text mining of API documentation , 2017, J. Softw. Evol. Process..

[4]  Abhishek Pandey,et al.  Natural language processing systems for capturing and standardizing unstructured clinical information: A systematic review , 2017, J. Biomed. Informatics.

[5]  Prakash M. Nadkarni,et al.  Overcoming barriers to NLP for clinical text: the role of shared tasks and the need for additional creative solutions , 2011, J. Am. Medical Informatics Assoc..

[6]  Robert A. Greenes,et al.  Research Paper: The GuideLine Interchange Format: A Model for Representing Guidelines , 1998, J. Am. Medical Informatics Assoc..

[7]  Hongfang Liu,et al.  Journal of Biomedical Informatics , 2022 .

[8]  Yuval Shahar,et al.  The Asgaard project: a task-specific framework for the application and critiquing of time-oriented clinical guidelines , 1998, Artif. Intell. Medicine.

[9]  Ross Upshur,et al.  Do Clinical Guidelines Still Make Sense? No , 2014, The Annals of Family Medicine.

[10]  Richard N. Shiffman,et al.  Model Formulation: GEM: A Proposal for a More Comprehensive Guideline Document Model Using XML , 2000, J. Am. Medical Informatics Assoc..

[11]  Frank Puppe,et al.  UIMA Ruta: Rapid development of rule-based information extraction applications , 2014, Natural Language Engineering.

[12]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[13]  James R. Campbell,et al.  Synthesis of Research Paper: The SAGE Guideline Model: Achievements and Overview , 2007, J. Am. Medical Informatics Assoc..

[14]  Maria T. Pazienza,et al.  Information Extraction , 2002, Lecture Notes in Computer Science.

[15]  Peter J. F. Lucas Computer-based Medical Guidelines and Protocols: A Primer and Current Trends , 2008 .

[16]  Martijn J. Schuemie,et al.  Rewriting and suppressing UMLS terms for improved biomedical term identification , 2010, J. Biomed. Semant..

[17]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[19]  Jorge Bernardino,et al.  Information Extraction Applications for Clinical Trials: A Survey , 2019, 2019 14th Iberian Conference on Information Systems and Technologies (CISTI).

[20]  Evelina Lamma,et al.  Computer-based Medical Guidelines and Protocols: A Primer and Current Trends , 2008, Computer-based Medical Guidelines and Protocols.

[21]  Roberto A. Rocha,et al.  Modeling the Arden Syntax for medical decisions in XML , 2008, Int. J. Medical Informatics.

[22]  Haolin Wang,et al.  Automated Encoding of Clinical Guidelines into Computer-interpretable Format , 2018, ICBCB 2018.

[23]  Youngjun Kim,et al.  Ensemble method-based extraction of medication and related information from clinical texts , 2019, J. Am. Medical Informatics Assoc..

[24]  John Fox,et al.  Application of Information Technology: The Syntax and Semantics of the PROforma Guideline Modeling Language , 2003, J. Am. Medical Informatics Assoc..

[25]  P. Jacobsen,et al.  Clinical practice guidelines for the psychosocial care of cancer survivors , 2009, Cancer.

[26]  Fusheng Wang,et al.  Effective Information Extraction Framework for Heterogeneous Clinical Reports Using Online Machine Learning and Controlled Vocabularies , 2017, JMIR medical informatics.

[27]  J. Korevaar,et al.  Adherence to cancer treatment guidelines: influence of general and cancer-specific guideline characteristics , 2016, European journal of public health.

[28]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[29]  Paola Mello,et al.  Analysis of the GLARE and GPROVE Approaches to Clinical Guidelines , 2009, KR4HC.

[30]  Marisa A. Ryan Adherence to Clinical Practice Guidelines , 2017, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[31]  Anna Rumshisky,et al.  Evaluating temporal relations in clinical text: 2012 i2b2 Challenge , 2013, J. Am. Medical Informatics Assoc..

[32]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[33]  Sungyoung Lee,et al.  A Multimodal Deep Log-Based User Experience (UX) Platform for UX Evaluation , 2018, Sensors.

[34]  Hongbin Lu,et al.  Associative attention networks for temporal relation extraction from electronic health records , 2019, J. Biomed. Informatics.

[35]  Srinivas Chiravuri,et al.  Clinical Practice Guidelines: the More, the Better? , 2015 .

[36]  V. Preedy,et al.  Scottish Intercollegiate Guidelines Network , 2010 .

[37]  Jackson T. Wright,et al.  2014 evidence-based guideline for the management of high blood pressure in adults: report from the panel members appointed to the Eighth Joint National Committee (JNC 8). , 2014, JAMA.

[38]  Hadi Veisi,et al.  Sentiment analysis based on improved pre-trained word embeddings , 2019, Expert Syst. Appl..

[39]  Ying Liu,et al.  Deep learning for drug-drug interaction extraction from the literature: a review , 2020, Briefings Bioinform..

[40]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[41]  Fang Liu,et al.  Data Processing and Text Mining Technologies on Electronic Medical Records: A Review , 2018, Journal of healthcare engineering.

[42]  Ingo Mierswa,et al.  YALE: rapid prototyping for complex data mining tasks , 2006, KDD '06.

[43]  Sharon G. Small,et al.  Review of information extraction technologies and applications , 2013, Neural Computing and Applications.

[44]  Eunice Y Pyon Primer on Clinical Practice Guidelines , 2013, Journal of pharmacy practice.

[45]  Itzhak Brook,et al.  IDSA clinical practice guideline for acute bacterial rhinosinusitis in children and adults. , 2012, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[46]  Marcos André Gonçalves,et al.  CluWords: Exploiting Semantic Word Clustering Representation for Enhanced Topic Modeling , 2019, WSDM.

[47]  Arie Hasman,et al.  Approaches for creating computer-interpretable guidelines that facilitate decision support , 2004, Artif. Intell. Medicine.