Efficiency and safety of speech recognition for documentation in the electronic health record

Abstract Objective To compare the efficiency and safety of using speech recognition (SR) assisted clinical documentation within an electronic health record (EHR) system with use of keyboard and mouse (KBM). Methods Thirty-five emergency department clinicians undertook randomly allocated clinical documentation tasks using KBM or SR on a commercial EHR system. Tasks were simple or complex, and with or without interruption. Outcome measures included task completion times and observed errors. Errors were classed by their potential for patient harm. Error causes were classified as due to IT system/system integration, user interaction, comprehension, or as typographical. User-related errors could be by either omission or commission. Results Mean task completion times were 18.11% slower overall when using SR compared to KBM (P = .001), 16.95% slower for simple tasks (P = .050), and 18.40% slower for complex tasks (P = .009). Increased errors were observed with use of SR (KBM 32, SR 138) for both simple (KBM 9, SR 75; P < 0.001) and complex (KBM 23, SR 63; P < 0.001) tasks. Interruptions did not significantly affect task completion times or error rates for either modality. Discussion For clinical documentation, SR was slower and increased the risk of documentation errors, including errors with the potential to cause clinical harm compared to KBM. Some of the observed increase in errors may be due to suboptimal SR to EHR integration and workflow. Conclusion Use of SR to drive interactive clinical documentation in the EHR requires careful evaluation. Current generation implementations may require significant development before they are safe and effective. Improving system integration and workflow, as well as SR accuracy and user-focused error correction strategies, may improve SR performance.

[1]  Mari Ostendorf,et al.  Asynchronous Speech Recognition Affects Physician Editing of Notes , 2018, Applied Clinical Informatics.

[2]  J. Milbrandt,et al.  Typed Versus Voice Recognition for Data Entry in Electronic Health Records: Emergency Physician Time Use and Interruptions , 2014, The western journal of emergency medicine.

[3]  George Hripcsak,et al.  Accelerating the use of electronic health records in physician practices. , 2010, The New England journal of medicine.

[4]  Barbara Sheehan,et al.  Natural Language Processing–Enabled and Conventional Data Capture Methods for Input to Electronic Health Records: A Comparative Usability Study , 2016, JMIR medical informatics.

[5]  A. O’Connor,et al.  Communication loads on clinical staff in the emergency department , 2002, The Medical journal of Australia.

[6]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[7]  Christoph U. Lehmann,et al.  Electronic Health Record Interactions through Voice: A Review , 2018, Applied Clinical Informatics.

[8]  W. Dunsmuir,et al.  The impact of interruptions on clinical task completion , 2010, Quality and Safety in Health Care.

[9]  Enrico Coiera.  Guide to health informatics , 2015 .

[10]  Michael A. Barnes,et al.  Comparison of accuracy of physical examination findings in initial progress notes between paper charts and a newly implemented electronic health record , 2017, J. Am. Medical Informatics Assoc..

[11]  E. Coiera.  The science of interruption , 2012, BMJ quality & safety.

[12]  Daniel C. Tu,et al.  Evaluation of electronic health record implementation in ophthalmology at an academic medical center (an American Ophthalmological Society thesis). , 2013, Transactions of the American Ophthalmological Society.

[13]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[14]  David W. Bates,et al.  Analysis of Errors in Dictated Clinical Documents Assisted by Speech Recognition Software and Professional Transcriptionists , 2018, JAMA network open.

[15]  Farah Magrabi,et al.  Errors and electronic prescribing: a controlled laboratory study to examine task complexity and interruption effects , 2010, J. Am. Medical Informatics Assoc..

[16]  Enrico W. Coiera,et al.  Risks and benefits of speech recognition for clinical documentation: a systematic review , 2016, J. Am. Medical Informatics Assoc..

[17]  Geoffrey Zweig,et al.  Achieving Human Parity in Conversational Speech Recognition , 2016, ArXiv.

[18]  Enrico Coiera,et al.  The digital scribe , 2018, npj Digital Medicine.