Assessing the Feasibility of an Automated Suggestion System for Communicating Critical Findings from Chest Radiology Reports to Referring Physicians

Time-sensitive communication of critical imaging findings like pneumothorax or pulmonary embolism to referring physicians is important for patient safety. However, radiology findings are recorded in free-text format, relying on verbal communication that is not always successful. Natural language processing can provide automated suggestions to radiologists that new critical findings be added to a followup list. We present a pilot assessment of the feasibility of an automated critical finding suggestion system for radiology reporting by assessing suggestions made by the pyConTextNLP algorithm. Our evaluation focused on the false alarm rate to determine feasibility of deployment without increasing alert fatigue. pyConTextNLP identified 77 critical findings from 1,370 chest exams. Review of the suggested findings demonstrated a 7.8% false alarm rate. We discuss the errors, which would be challenging to address, and compare pyConTextNLP’s false alarm rate to false alarm rates of similar systems from the literature.

[1]  Mathieu Lafourcade,et al.  Semantic Relation Extraction with Semantic Patterns Experiment on Radiology Reports , 2016, LREC.

[2]  Katherine P Andriole,et al.  Retrieval of Radiology Reports Citing Critical Findings with Disease-Specific Customization , 2012, The open medical informatics journal.

[3]  Thomas H. Payne,et al.  A text processing pipeline to extract recommendations from radiology reports , 2013, J. Biomed. Informatics.

[4]  Curtis P. Langlotz,et al.  Automated Detection of Critical Results in Radiology Reports , 2012, Journal of Digital Imaging.

[5]  Wendy W. Chapman,et al.  Document-level classification of CT pulmonary angiography reports based on an extension of the ConText algorithm , 2011, J. Biomed. Informatics.

[6]  Charles E Kahn,et al.  Actionable findings and the role of IT support: report of the ACR Actionable Reporting Work Group. , 2014, Journal of the American College of Radiology : JACR.

[7]  Andrea Esuli,et al.  An enhanced CRFs-based system for information extraction from radiology reports , 2013, J. Biomed. Informatics.

[8]  Thomas Lavergne,et al.  Natural language processing of radiology reports for the detection of thromboembolic diseases and clinically relevant incidental findings , 2014, BMC Bioinformatics.

[9]  Wendy W. Chapman,et al.  ConText: An algorithm for determining negation, experiencer, and temporal status from clinical reports , 2009, J. Biomed. Informatics.

[10]  Wendy W. Chapman,et al.  A Simple Algorithm for Identifying Negated Findings and Diseases in Discharge Summaries , 2001, J. Biomed. Informatics.