Frequency and analysis of non-clinical errors made in radiology reports using the National Integrated Medical Imaging System voice recognition dictation software

BackgroundVoice recognition (VR) dictation of radiology reports has become the mainstay of reporting in many institutions worldwide. Despite benefit, such software is not without limitations, and transcription errors have been widely reported.AimEvaluate the frequency and nature of non-clinical transcription error using VR dictation software.MethodsRetrospective audit of 378 finalised radiology reports. Errors were counted and categorised by significance, error type and sub-type. Data regarding imaging modality, report length and dictation time was collected.Results67 (17.72 %) reports contained ≥1 errors, with 7 (1.85 %) containing ‘significant’ and 9 (2.38 %) containing ‘very significant’ errors. A total of 90 errors were identified from the 378 reports analysed, with 74 (82.22 %) classified as ‘insignificant’, 7 (7.78 %) as ‘significant’, 9 (10 %) as ‘very significant’. 68 (75.56 %) errors were ‘spelling and grammar’, 20 (22.22 %) ‘missense’ and 2 (2.22 %) ‘nonsense’. ‘Punctuation’ error was most common sub-type, accounting for 27 errors (30 %). Complex imaging modalities had higher error rates per report and sentence. Computed tomography contained 0.040 errors per sentence compared to plain film with 0.030. Longer reports had a higher error rate, with reports >25 sentences containing an average of 1.23 errors per report compared to 0–5 sentences containing 0.09.ConclusionThese findings highlight the limitations of VR dictation software. While most error was deemed insignificant, there were occurrences of error with potential to alter report interpretation and patient management. Longer reports and reports on more complex imaging had higher error rates and this should be taken into account by the reporting radiologist.

[1]  K A Duncan,et al.  The effect of voice recognition software on comparative error rates in radiology reports. , 2008, The British journal of radiology.

[2]  Damien Jolley,et al.  Non-Clinical Errors Using Voice Recognition Dictation Software for Radiology Reports: A Retrospective Audit , 2011, Journal of Digital Imaging.

[3]  L. Kelley,et al.  Improving satisfaction performance through faster turnaround times. , 2011, Radiology management.

[4]  A. D. Elster Frequency and Spectrum of Errors in Final Radiology Reports Generated With Automatic Speech Recognition Technology , 2009 .

[5]  M. Schneider-Kolsky,et al.  Voice recognition versus transcriptionist: Error rates and productivity in MRI reporting , 2010, Journal of medical imaging and radiation oncology.

[6]  L. Shepstone,et al.  Voice recognition for radiology reporting: is it good enough? , 2005, Clinical radiology.

[7]  Theresa C McLoud,et al.  Voice Recognition , 2009, Encyclopedia of Biometrics.

[8]  Arjun Kalyanpur,et al.  Voice recognition is here comma like it or not period , 2013, Indian Journal of Radiology and Imaging.

[9]  Seth Hall,et al.  Prepopulated Radiology Report Templates: A Prospective Analysis of Error Rate and Turnaround Time , 2012, Journal of Digital Imaging.

[10]  Lawrence M. Davis,et al.  Voice Recognition Dictation: Radiologist as Transcriptionist , 2008, Journal of Digital Imaging.

[11]  Bruce I. Reiner,et al.  Innovation Strategies for Combating Occupational Stress and Fatigue in Medical Imaging , 2012, Journal of Digital Imaging.

[12]  Bin Zhang,et al.  Creation and Implementation of Department-Wide Structured Reports: An Analysis of the Impact on Error Rate in Radiology Reports , 2014, Journal of Digital Imaging.

[13]  Tomi Kauppinen,et al.  Improvement of Report Workflow and Productivity Using Speech Recognition—A Follow-up Study , 2008, Journal of Digital Imaging.

[14]  Tomi Kauppinen,et al.  Improvement of Report Workflow and Productivity Using Speech Recognition—A Follow-up Study , 2008, Journal of Digital Imaging.

[15]  K. Mankad,et al.  Risk management in radiology departments. , 2015, World journal of radiology.

[16]  Robert D. Rodman,et al.  Voice Recognition , 2011, Encyclopedia of Cryptography and Security.

[17]  Kevin M. Schartz,et al.  Long radiology workdays reduce detection and accommodation accuracy. , 2010, Journal of the American College of Radiology : JACR.

[18]  D M Horowitz,et al.  Speech-controlled generation of radiology reports. , 1987, Radiology.

[19]  Y. F. Chen,et al.  The Effectiveness of Service Delivery Initiatives at Improving Patients’ Waiting Times in Clinical Radiology Departments: A Systematic Review , 2014, Journal of Digital Imaging.

[20]  Sheila M Sferrella,et al.  Success with voice recognition. , 2003, Radiology management.

[21]  Bruce I. Reiner,et al.  Expanding the Functionality of Speech Recognition in Radiology: Creating a Real-Time Methodology for Measurement and Analysis of Occupational Stress and Fatigue , 2013, Journal of Digital Imaging.

[22]  Arun Krishnaraj,et al.  Voice recognition software: effect on radiology report turnaround time at an academic medical center. , 2010, AJR. American journal of roentgenology.

[23]  P Kijewski,et al.  Voice recognition in radiology reporting. , 1997, AJR. American journal of roentgenology.

[24]  Bradley J. Erickson,et al.  Evaluation of the accuracy of a continuous speech recognition software system in radiology , 2009, Journal of Digital Imaging.

[25]  Bruce I. Reiner,et al.  Real-Time Occupational Stress and Fatigue Measurement in Medical Imaging Practice , 2012, Journal of Digital Imaging.

[26]  H L Bleich,et al.  Computerized radiologic reporting with voice data-entry. , 1981, Radiology.

[27]  Dennis R Williams,et al.  Journal Club: Voice recognition dictation: analysis of report volume and use of the send-to-editor function. , 2013, AJR. American journal of roentgenology.

[28]  Bruce I. Reiner,et al.  The Insidious Problem of Fatigue in Medical Imaging Practice , 2012, Journal of Digital Imaging.

[29]  Curtis P. Langlotz,et al.  Improving language models for radiology speech recognition , 2009, J. Biomed. Informatics.