Natural Language Processing in Radiology: A Systematic Review.

Radiological reporting has generated large quantities of digital content within the electronic health record, which is potentially a valuable source of information for improving clinical care and supporting research. Although radiology reports are stored for communication and documentation of diagnostic imaging, harnessing their potential requires efficient and automated information extraction: they exist mainly as free-text clinical narrative, from which it is a major challenge to obtain structured data. Natural language processing (NLP) provides techniques that aid the conversion of text into a structured representation, and thus enables computers to derive meaning from human (ie, natural language) input. Used on radiology reports, NLP techniques enable automatic identification and extraction of information. By exploring the various purposes for their use, this review examines how radiology benefits from NLP. A systematic literature search identified 67 relevant publications describing NLP methods that support practical applications in radiology. This review takes a close look at the individual studies in terms of tasks (ie, the extracted information), the NLP methodology and tools used, and their application purpose and performance results. Additionally, limitations, future challenges, and requirements for advancing NLP in radiology will be discussed.

[1]  L A Lenert,et al.  Monitoring free-text data using medical language processing. , 1993, Computers and biomedical research, an international journal.

[2]  Peter J. Haug,et al.  Automatic extraction of PIOPED interpretations from ventilation/perfusion lung scan reports , 1998, AMIA.

[3]  Marti A. Hearst.  Untangling Text Data Mining , 1999, ACL.

[4]  Peter J. Haug,et al.  Automatic identification of pneumonia related concepts on chest x-ray reports , 1999, AMIA.

[5]  H Kangarloo,et al.  Interactive software for generation and visualization of structured findings in radiology reports. , 2000, AJR. American journal of roentgenology.

[6]  Peter J. Haug,et al.  Research Paper: Automatic Detection of Acute Bacterial Pneumonia from Chest X-ray Reports , 2000, J. Am. Medical Informatics Assoc..

[7]  Peter J. Haug,et al.  A Comparison of Classification Algorithms to Automatically Identify Chest X-Ray Reports That Support Pneumonia , 2001, J. Biomed. Informatics.

[8]  Henry J. Lowe,et al.  Selective Automated Indexing of Findings and Diagnoses in Radiology Reports , 2001, J. Biomed. Informatics.

[9]  J. Austin,et al.  Use of natural language processing to translate clinical information from a database of 889,921 chest radiographic reports. , 2002, Radiology.

[10]  N. Obuchowski.  Receiver operating characteristic curves and their use in radiology. , 2003, Radiology.

[11]  Mary F. Wisniewski,et al.  Electronic Interpretation of Chest Radiograph Reports to Detect Central Venous Catheters , 2003, Infection Control & Hospital Epidemiology.

[12]  Clement J. McDonald,et al.  Automated Extraction and Normalization of Findings from Cancer-Related Free-Text Radiology Reports , 2003, AMIA.

[13]  James H Thrall,et al.  Application of Recently Developed Computer Algorithm for Automatic Classification of Unstructured Radiology Reports: Validation Study 1 , 2004 .

[14]  Alberto F. Goldszal,et al.  Development and Validation of Queries Using Structured Query Language (SQL) to Determine the Utilization of Comparison Imaging in Radiology Reports Stored on PACS , 2005, Journal of Digital Imaging.

[15]  Eneida A. Mendonça,et al.  Use of computerized surveillance to detect nosocomial pneumonia in neonatal intensive care unit patients. , 2004, American journal of infection control.

[16]  Carol Friedman,et al.  Extracting Information on Pneumonia in Infants Using Natural Language Processing of Radiology Reports , 2003, BioNLP@ACL.

[17]  Clement J. McDonald,et al.  A Natural Language Processing System to Extract and Code Concepts Relating to Congestive Heart Failure from Chest Radiology Reports , 2006, AMIA.

[18]  Anne Kao,et al.  Natural Language Processing and Text Mining , 2006 .

[19]  M. Stella Atkins,et al.  Improving the Utility of Speech Recognition Through Error Detection , 2008, Journal of Digital Imaging.

[20]  Matthew H Samore,et al.  Hospital electronic medical record-based public health surveillance system deployed during the 2002 Winter Olympic Games. , 2007, American journal of infection control.

[21]  K. Bretonnel Cohen,et al.  A shared task involving multi-label classification of clinical free text , 2007, BioNLP@ACL.

[22]  Pragya A. Dang,et al.  Extraction of recommendation features in radiology with natural language processing: exploratory study. , 2008, AJR. American journal of roentgenology.

[23]  Richárd Farkas,et al.  Automatic construction of rule-based ICD-9-CM coding systems , 2008, BMC Bioinformatics.

[24]  Keith J Dreyer,et al.  Natural language processing using online analytic processing for assessing recommendations in radiology reports. , 2008, Journal of the American College of Radiology : JACR.

[25]  John F. Hurdle,et al.  Extracting Information from Textual Documents in the Electronic Health Record: A Review of Recent Research , 2008, Yearbook of Medical Informatics.

[26]  S. Trent Rosenbloom,et al.  NLP-based Identification of Pneumonia Cases from Free-Text Radiological Reports , 2008, AMIA.

[27]  Imre Solti1,et al.  Automated classification of radiology reports for acute lung injury: Comparison of keyword and machine learning based natural language processing approaches , 2009, 2009 IEEE International Conference on Bioinformatics and Biomedicine Workshop.

[28]  James H Thrall,et al.  Recommendations for additional imaging in radiology reports: multifactorial analysis of 5.9 million examinations. , 2009, Radiology.

[29]  Guergana K. Savova,et al.  Discerning Tumor Status from Unstructured MRI Reports—Completeness of Information in Existing Reports and Utility of Automated Natural Language Processing , 2009, Journal of Digital Imaging.

[30]  Clement J. McDonald,et al.  What can natural language processing do for clinical decision support? , 2009, J. Biomed. Informatics.

[31]  Curtis P. Langlotz,et al.  Automated Detection of Radiology Reports that Document Non-routine Communication of Critical or Significant Results , 2009, Journal of Digital Imaging.

[32]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement , 2009, BMJ.

[33]  Keith J Dreyer,et al.  Informatics in radiology: Render: an online searchable radiology study repository. , 2009, Radiographics : a review publication of the Radiological Society of North America, Inc.

[34]  Brett R South,et al.  Natural language processing for lines and devices in portable chest x-rays. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[35]  A. Doney,et al.  Automated data capture from free‐text radiology reports to enhance accuracy of hospital inpatient stroke codes , 2010, Pharmacoepidemiology and drug safety.

[36]  Christopher G Chute,et al.  Discovering peripheral arterial disease cases from radiology notes using natural language processing. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[37]  Robert A. Jenders,et al.  A systematic literature review of automated clinical coding and classification systems , 2010, J. Am. Medical Informatics Assoc..

[38]  Aya Kamaya,et al.  Informatics in radiology: RADTF: a semantic search-enabled, natural language processor-generated radiology teaching file. , 2010, Radiographics : a review publication of the Radiological Society of North America, Inc.

[39]  Curtis P. Langlotz,et al.  Automated Detection of Critical Results in Radiology Reports , 2012, Journal of Digital Imaging.

[40]  Matthew Scotch,et al.  The Yale cTAKES extensions for document classification: architecture and application , 2011, J. Am. Medical Informatics Assoc..

[41]  Rob C. van Ommering,et al.  Automatically Correlating Clinical Findings and Body Locations in Radiology Reports Using MedLEE , 2012, Journal of Digital Imaging.

[42]  R. Khorasani,et al.  Critical finding capture in the impression section of radiology reports. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[43]  Ramin Khorasani,et al.  Focal cystic pancreatic lesions: assessing variation in radiologists' management recommendations. , 2011, Radiology.

[44]  William W. Boonn,et al.  Development of Automated Detection of Radiology Reports Citing Adrenal Findings , 2011, Journal of Digital Imaging.

[45]  Ramin Khorasani,et al.  Leveraging terminologies for retrieval of radiology reports with critical imaging findings. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[46]  Fei Xia,et al.  Automatic identification of critical follow-up recommendation sentences in radiology reports. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[47]  Bethany Percha,et al.  Automatic classification of mammography reports by BI-RADS breast tissue composition class , 2012, J. Am. Medical Informatics Assoc..

[48]  Ramin Khorasani,et al.  Effect of computerized clinical decision support on the use and yield of CT pulmonary angiography in the emergency department. , 2012, Radiology.

[49]  Paras Lakhani,et al.  Automated extraction of critical test values and communications from unstructured radiology reports: an analysis of 9.3 million reports from 1990 to 2011. , 2012, Radiology.

[50]  Bao H. Do,et al.  Automatic Retrieval of Bone Fracture Knowledge Using Natural Language Processing , 2013, Journal of Digital Imaging.

[51]  Michael Nossal,et al.  Physician documentation deficiencies in abdominal ultrasound reports: frequency, characteristics, and financial impact. , 2012, Journal of the American College of Radiology : JACR.

[52]  S. Brunak,et al.  Mining electronic health records: towards better research applications and clinical care , 2012, Nature Reviews Genetics.

[53]  Ramin Khorasani,et al.  Information from Searching Content with an Ontology-Utilizing Toolkit (iSCOUT) , 2012, Journal of Digital Imaging.

[54]  Jun'ichi Tsujii,et al.  Named entity recognition of follow-up and time information in 20 000 radiology reports , 2012, J. Am. Medical Informatics Assoc..

[55]  Ramin Khorasani,et al.  Repeat abdominal imaging examinations in a tertiary care hospital. , 2012, The American journal of medicine.

[56]  Sanda M. Harabagiu,et al.  A Machine Learning Approach for Identifying Anatomical Locations of Actionable Findings in Radiology Reports , 2012, AMIA.

[57]  M. Schuemie,et al.  Automating classification of free‐text electronic health records for epidemiological studies , 2012, Pharmacoepidemiology and drug safety.

[58]  Katherine P Andriole,et al.  Factors associated with radiologists' adherence to Fleischner Society guidelines for management of pulmonary nodules. , 2012, Journal of the American College of Radiology : JACR.

[59]  Chengyi Zheng,et al.  Automated Identification of Patients With Pulmonary Nodules in an Integrated Health System Using Administrative Health Plan Data, Radiology Reports, and Natural Language Processing , 2012, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[60]  Philipp Daumke,et al.  Intelligent image retrieval based on radiology reports , 2012, European Radiology.

[61]  Sunghwan Sohn,et al.  Identifying Abdominal Aortic Aneurysm Cases and Controls using Natural Language Processing of Radiology Reports , 2013, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[62]  J. Craig.  Extracting Actionable Findings of Appendicitis from Radiology Reports Using Natural Language Processing , 2013 .

[63]  Andrea Esuli,et al.  An enhanced CRFs-based system for information extraction from radiology reports , 2013, J. Biomed. Informatics.

[64]  Lee M. Christensen,et al.  Natural Language Processing to identify pneumonia from radiology reports , 2013, Pharmacoepidemiology and drug safety.

[65]  Sayon Dutta,et al.  Automated detection using natural language processing of radiologists recommendations for additional imaging of incidental findings. , 2013, Annals of emergency medicine.

[66]  Cynthia Brandt,et al.  Semi-supervised clinical text classification with Laplacian SVMs: An application to cancer case management , 2013, J. Biomed. Informatics.

[67]  S. Silverman,et al.  Simple cyst-appearing renal masses at unenhanced CT: can they be presumed to be benign? , 2013, Radiology.

[68]  L. Penberthy,et al.  Automated determination of metastases in unstructured radiology reports for eligibility screening in oncology clinical trials , 2013, Experimental biology and medicine.

[69]  Thomas H. Payne,et al.  A text processing pipeline to extract recommendations from radiology reports , 2013, J. Biomed. Informatics.

[70]  Ramin Khorasani,et al.  Automated Extraction of BI-RADS Final Assessment Categories from Radiology Reports with Natural Language Processing , 2013, Journal of Digital Imaging.

[71]  Vincent Liu,et al.  Automated identification of pneumonia in chest radiograph reports in critically ill patients , 2013, BMC Medical Informatics and Decision Making.

[72]  Merlijn Sevenster,et al.  Automatically Pairing Measured Findings across Narrative Abdomen CT Reports , 2013, AMIA.

[73]  Fang Yu,et al.  Automated Classification of Radiology Reports to Facilitate Retrospective Study in Radiology , 2014, Journal of Digital Imaging.

[74]  Sheng Yu,et al.  Classification of CT pulmonary angiography reports by presence, chronicity, and location of pulmonary embolism with natural language processing , 2014, J. Biomed. Informatics.

[75]  Selen Bozkurt,et al.  Automated detection of ambiguity in BI-RADS assessment categories in mammography reports. , 2014, Studies in health technology and informatics.

[76]  Thomas Lavergne,et al.  Natural language processing of radiology reports for the detection of thromboembolic diseases and clinically relevant incidental findings , 2014, BMC Bioinformatics.