Overview of the TREC 2014 Clinical Decision Support Track

Abstract : In making clinical decisions, physicians often seek out information about how to best care for their patients. Information relevant to a physician can be related to a variety of clinical tasks such as determining a patient s most likely diagnosis given a list of symptoms, deciding on the most effective treatment plan for a patient having a known condition, and determining if a particular test is indicated for a given situation. In some cases, physicians can find the information they seek in published biomedical literature. However, given the volume of the existing literature and the rapid pace at which new research is published, locating the most relevant and timely information for a particular clinical need can be a daunting and time-consuming task. To make biomedical information more accessible and to meet the requirements for the meaningful use of electronic health records, a goal of modern clinical decision support systems is to anticipate the needs of physicians by linking electronic health records with information relevant for patient care. The Clinical Decision Support Track aims to simulate the requirements of such systems and to encourage the creation of tools and resources necessary for their implementation. The focus of the 2014 track was the retrieval of biomedical articles relevant for answering generic clinical questions about medical records. In the absence of a reusable, de-identified collection of medical records, we used short case reports, such as those published in biomedical articles, as idealized representations of actual medical records. A case report typically describes a challenging medical case, and it is often organized as a well-formed narrative summarizing the portions of a patient s medical record that are pertinent to the case. Participants of the track were challenged with retrieving, for a given case report, full-text biomedical articles relevant for answering questions related to several types of clinical information needs.

[1]  Henning Müller,et al.  Overview of the ImageCLEF 2013 Medical Tasks , 2013, CLEF.

[2]  Alan R. Aronson,et al.  An overview of MetaMap: historical perspective and recent advances , 2010, J. Am. Medical Informatics Assoc..

[3]  Peter Szolovits,et al.  MIMIC-III, a freely accessible critical care database , 2016, Scientific Data.

[4]  Ellen M. Voorhees,et al.  Variations in relevance judgments and the measurement of retrieval effectiveness , 1998, SIGIR '98.

[5]  P. Gorman,et al.  A taxonomy of generic clinical questions: classification study , 2000, BMJ : British Medical Journal.

[6]  Kalpana Raja,et al.  Concept based Information Retrieval for Clinical Case Summaries , 2015, TREC.

[7]  Yang Song,et al.  ECNU at 2015 CDS Track: Two Re-ranking Methods in Medical Information Retrieval , 2015, TREC.

[8]  Ben Carterette,et al.  University of Delaware at TREC 2014 , 2014, TREC.

[9]  Allan Hanbury,et al.  TUW @ TREC Clinical Decision Support Track 2015 , 2015, TREC.

[10]  Jerome A Osheroff,et al.  Research Paper: Answering Physicians' Clinical Questions: Obstacles and Potential Solutions , 2005, J. Am. Medical Informatics Assoc..

[11]  Shanfeng Zhu,et al.  FDUMedSearch at TREC 2015 Clinical Decision Support Track , 2015, TREC.

[12]  Asma Ben Abacha,et al.  LIST at TREC 2015 Clinical Decision Support Track: Question Analysis and Unsupervised Result Fusion , 2015, TREC.

[13]  Ellen M. Voorhees,et al.  TREC genomics special issue overview , 2009, Information Retrieval.

[14]  Alexander Kotov,et al.  WSU-IR at TREC 2015 Clinical Decision Support Track: Joint Weighting of Explicit and Latent Medical Query Concepts from Diverse Sources , 2015, TREC.

[15]  Ronan Cummins.  Clinical Decision Support with the SPUD Language Model , 2015, TREC.

[16]  Ellen M. Voorhees,et al.  The effect of sampling strategy on inferred measures , 2014, SIGIR.

[17]  Stéfan Jacques Darmoni,et al.  LIMSI @ 2015 Clinical Decision Support Track , 2015, TREC.

[18]  Emine Yilmaz,et al.  A simple and efficient sampling method for estimating AP and NDCG , 2008, SIGIR '08.

[19]  Allan Hanbury,et al.  TUW @ TREC Clinical Decision Support Track , 2014, TREC.