Automatic indexing and retrieval of encounter-specific evidence for point-of-care support

Evidence-based medicine relies on repositories of empirical research evidence that can be used to support clinical decision making for improved patient care. However, retrieving evidence from such repositories at local sites presents many challenges. This paper describes a methodological framework for automatically indexing and retrieving empirical research evidence in the form of the systematic reviews and associated studies from The Cochrane Library, where retrieved documents are specific to a patient-physician encounter and thus can be used to support evidence-based decision making at the point of care. Such an encounter is defined by three pertinent groups of concepts - diagnosis, treatment, and patient, and the framework relies on these three groups to steer indexing and retrieval of reviews and associated studies. An evaluation of the indexing and retrieval components of the proposed framework was performed using documents relevant for the pediatric asthma domain. Precision and recall values for automatic indexing of systematic reviews and associated studies were 0.93 and 0.87, and 0.81 and 0.56, respectively. Moreover, precision and recall for the retrieval of relevant systematic reviews and associated studies were 0.89 and 0.81, and 0.92 and 0.89, respectively. With minor modifications, the proposed methodological framework can be customized for other evidence repositories.

[1]  Zhenyu Liu,et al.  Knowledge-based query expansion to support scenario-specific retrieval of medical free text , 2005, SAC '05.

[2]  David J Hunter,et al.  Diseases of comfort: primary cause of death in the 22nd century , 2005, Journal of Epidemiology and Community Health.

[3]  Gerard Salton,et al.  Term-Weighting Approaches in Automatic Text Retrieval , 1988, Inf. Process. Manag..

[4]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[5]  George Hripcsak,et al.  Automated encoding of clinical documents based on natural language processing. , 2004, Journal of the American Medical Informatics Association : JAMIA.

[6]  Mario Gómez,et al.  MELISA. An ontology-based agent for information retrieval in medicine , 2000 .

[7]  George R. Thoma,et al.  Preliminary Comparison of Three Search Engines for Point of Care Access to MEDLINE® Citations , 2006, AMIA.

[8]  Wesley W. Chu,et al.  Free-text medical document retrieval via phrase-based vector space model , 2002, AMIA.

[9]  George Hripcsak,et al.  Development, implementation, and a cognitive evaluation of a definitional question answering system for physicians , 2007, J. Biomed. Informatics.

[10]  Fernando Pereira,et al.  Identifying gene and protein mentions in text using conditional random fields , 2005, BMC Bioinformatics.

[11]  Alan R. Aronson,et al.  Semi-Automatic Indexing of Full Text Biomedical Articles , 2005, AMIA.

[12]  Lawrence M. Fagan,et al.  Research Paper: Methods for Semi-automated Indexing for High Precision Information Retrieval , 2002, J. Am. Medical Informatics Assoc..

[13]  Frank van Harmelen,et al.  Using C-OWL for the alignment and merging of medical ontologies , 2004, KR-MED.

[14]  David Moher,et al.  Effect of point of care information on inpatient management of bronchiolitis , 2007, BMC pediatrics.

[15]  M. Chambliss,et al.  Answering clinical questions. , 1996, The Journal of family practice.

[16]  Syed Sibte Raza Abidi,et al.  BiRD: A Strategy to Autonomously Supplement Clinical Practice Guidelines with Related Clinical Studies , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[17]  Craig A. Morioka,et al.  IndexFinder: A Method of Extracting Key Concepts from Clinical Texts for Indexing , 2003, AMIA.

[18]  G Hripcsak,et al.  Evaluating Natural Language Processors in the Clinical Domain , 1998, Methods of Information in Medicine.

[19]  Randolph A. Miller,et al.  Identifying UMLS concepts from ECG Impressions using Knowledge Map , 2005, AMIA.

[20]  Henry J. Lowe,et al.  Selective Automated Indexing of Findings and Diagnoses in Radiology Reports , 2001, J. Biomed. Informatics.

[21]  Marcelo Fiszman,et al.  The interaction of domain knowledge and linguistic structure in natural language processing: interpreting hypernymic propositions in biomedical text , 2003, J. Biomed. Informatics.

[22]  Randolph A. Miller,et al.  Identifying QT prolongation from ECG impressions using a general-purpose Natural Language Processor , 2009, Int. J. Medical Informatics.

[23]  Susanne M. Humphrey,et al.  A recent advance in the automatic indexing of the biomedical literature , 2009, J. Biomed. Informatics.

[24]  Stéfan Jacques Darmoni,et al.  Evaluation of French and English MeSH Indexing Systems with a Parallel Corpus , 2005, AMIA.

[25]  Bernard C K Choi Understanding the basic principles of knowledge translation. , 2005, Journal of epidemiology and community health.

[26]  Vladimir G. Voiskunskii,et al.  Boolean Search: Current State and Perspectives , 1999, J. Am. Soc. Inf. Sci..

[27]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[28]  Suzanne Bakken,et al.  Integrating evidence into clinical information systems for nursing decision support , 2008, Int. J. Medical Informatics.

[29]  Dan Klein,et al.  Improved Identification of Noun Phrases in Clinical Radiology Reports Using a High-Performance Statistical Natural Language Parser Augmented with the UMLS Specialist Lexicon , 2005 .

[30]  George R. Thoma,et al.  Research Paper: Using Wireless Handheld Computers to Seek Information at the Point of Care: An Evaluation by Clinicians , 2007, J. Am. Medical Informatics Assoc..

[31]  Peter L. Elkin,et al.  UMLS Concept Indexing for Production Databases: A Feasibility Study , 2001, J. Am. Medical Informatics Assoc..

[32]  Christopher G. Chute,et al.  A randomized controlled trial of concept based indexing of Web page content , 2000, AMIA.

[33]  George R. Thoma,et al.  A Prototype System to Support Evidence-based Practice , 2008, AMIA.

[34]  Alan R. Aronson,et al.  Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program , 2001, AMIA.

[35]  Fabio Ciravegna,et al.  Challenges in Information Extraction from Text for Knowledge Management , 2001 .

[36]  Johanna I. Westbrook,et al.  Do online information retrieval systems help experienced clinicians answer clinical questions? , 2005, Journal of the American Medical Informatics Association : JAMIA.

[37]  Stan Matwin,et al.  Engineering of a Clinical Decision Support Framework for the Point of Care Use , 2008, AMIA.

[38]  William R. Hersh,et al.  Information Retrieval in Medicine: The SAPHIRE Experience , 1995, J. Am. Soc. Inf. Sci..

[39]  Daniel C. Berrios Automated indexing for full text information retrieval , 2000, AMIA.