Physician use of speech recognition versus typing in clinical documentation: A controlled observational study

IMPORTANCE Speech recognition (SR) is increasingly used directly by clinicians for electronic health record (EHR) documentation. Its usability and effect on quality and efficiency versus other documentation methods remain unclear. OBJECTIVE To study usability and quality of documentation with SR versus typing. DESIGN In this controlled observational study, each subject participated in two of five simulated outpatient scenarios. Sessions were recorded with Morae® usability software. Two notes were documented into the EHR per encounter (one dictated, one typed) in randomized order. Participants were interviewed about each method's perceived advantages and disadvantages. Demographics and documentation habits were collected via survey. Data collection occurred between January 8 and February 8, 2019, and data analysis was conducted from February through September of 2019. SETTING Brigham and Women's Hospital, Boston, Massachusetts, USA. PARTICIPANTS Ten physicians who had used SR for at least six months. MAIN OUTCOMES AND MEASURES Documentation time, word count, vocabulary size, number of errors, number of corrections and quality (clarity, completeness, concision, information sufficiency and prioritization). RESULTS Dictated notes were longer than typed notes (320.6 vs. 180.8 words; p = 0.004) with more unique words (170.9 vs. 120.4; p = 0.01). Documentation time was similar between methods, with dictated notes taking slightly less time to complete than typed notes. Typed notes had more uncorrected errors per note than dictated notes (2.9 vs. 1.5), although most were minor misspellings. Dictated notes had a higher mean quality score (7.7 vs. 6.6; p = 0.04), were more complete and included more sufficient information. CONCLUSIONS AND RELEVANCE Participants felt that SR saves them time, increases their efficiency and allows them to quickly document more relevant details. Quality analysis supports the perception that SR allows for more detailed notes, but whether dictation is objectively faster than typing remains unclear, and participants described some scenarios where typing is still preferred. Dictation can be effective for creating comprehensive documentation, especially when physicians like and feel comfortable using SR. Research is needed to further improve integration of SR with EHR systems and assess its impact on clinical practice, workflows, provider and patient experience, and costs.

[1]  Shuichi Kawada,et al.  Radiological reporting that combine continuous speech recognition with error correction by transcriptionists. , 2007, The Tokai journal of experimental and clinical medicine.

[2]  Steven R. Brown,et al.  EHR Overtime: An Analysis of Time Spent After Hours by Family Physicians. , 2020, Family medicine.

[3]  Christoph U. Lehmann,et al.  Electronic Health Record Interactions through Voice: A Review , 2018, Applied Clinical Informatics.

[4]  Dominique Estival,et al.  Capturing patient information at nursing shift changes: methodological evaluation of speech recognition and information extraction , 2015, J. Am. Medical Informatics Assoc..

[5]  Linda Dawson,et al.  A systematic review of speech recognition technology in health care , 2014, BMC Medical Informatics and Decision Making.

[6]  Ryan T Lewinson,et al.  Effects of medical scribes on physician productivity in a Canadian emergency department: a pilot study. , 2018, CMAJ open.

[7]  R. G. Zick,et al.  Voice recognition software versus a traditional transcription service for physician charting in the ED. , 2001, The American journal of emergency medicine.

[8]  A. Bank,et al.  Annual impact of scribes on physician productivity and revenue in a cardiology clinic , 2015, ClinicoEconomics and outcomes research : CEOR.

[9]  Edward R Melnick,et al.  The Association Between Perceived Electronic Health Record Usability and Professional Burnout Among US Physicians. , 2019, Mayo Clinic proceedings.

[10]  Dominick L. Frosch,et al.  Frontline Perspectives on Physician Burnout and Strategies to Improve Well-Being: Interviews with Physicians and Health System Leaders , 2019, Journal of General Internal Medicine.

[11]  S J Herman Accuracy of a voice-to-text personal dictation system in the generation of radiology reports. , 1995, AJR. American journal of roentgenology.

[12]  H L Bleich,et al.  Computerized radiologic reporting with voice data-entry. , 1981, Radiology.

[13]  O. Buckley,et al.  Frequency and analysis of non-clinical errors made in radiology reports using the National Integrated Medical Imaging System voice recognition dictation software , 2016, Irish Journal of Medical Science (1971 -).

[14]  Andrew A White,et al.  Using voice to create inpatient progress notes: effects on note timeliness, quality, and physician satisfaction , 2018, JAMIA open.

[15]  R. Wassmuth,et al.  Analysis of Documentation Speed Using Web-Based Medical Speech Recognition Technology: Randomized Controlled Trial , 2015, Journal of medical Internet research.

[16]  J. Milbrandt,et al.  Typed Versus Voice Recognition for Data Entry in Electronic Health Records: Emergency Physician Time Use and Interruptions , 2014, The western journal of emergency medicine.

[17]  Marc N. Elliott,et al.  Using Pooled Kappa to Summarize Interrater Agreement across Many Items , 2008 .

[18]  Liqin Wang,et al.  Speech recognition for clinical documentation from 1990 to 2018: a systematic review , 2019, J. Am. Medical Informatics Assoc..

[19]  Min Soon Kim,et al.  Toward Successful Implementation of Speech Recognition Technology: A Survey of SRT Utilization Issues in Healthcare Settings , 2015, Southern medical journal.

[20]  Sima Ajami Use of speech-to-text technology for documentation by healthcare providers. , 2016, The National medical journal of India.

[21]  Martin Westhofen,et al.  Free-Text Data Entry by Speech Recognition Software and its Impact on Clinical Routine , 2006, Ear, nose, & throat journal.

[22]  Michael A. Barnes,et al.  Comparison of accuracy of physical examination findings in initial progress notes between paper charts and a newly implemented electronic health record , 2017, J. Am. Medical Informatics Assoc..

[23]  Li Zhou,et al.  Incidence of speech recognition errors in the emergency department , 2013, Int. J. Medical Informatics.

[24]  ATIF ZAFAR,et al.  Technology Evaluation: Continuous Speech Recognition for Clinicians , 1999, J. Am. Medical Informatics Assoc..

[25]  Christian Bellemare,et al.  Speech Recognition in the Radiology Department: A Systematic Review , 2015, Health information management : journal of the Health Information Management Association of Australia.

[26]  Enrico W. Coiera,et al.  Risks and benefits of speech recognition for clinical documentation: a systematic review , 2016, J. Am. Medical Informatics Assoc..

[27]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[28]  Mark W Friedberg,et al.  Factors Affecting Physician Professional Satisfaction and Their Implications for Patient Care, Health Systems, and Health Policy. , 2013, Rand health quarterly.

[29]  David W. Bates,et al.  An Error Analysis of Dictated Clinical Documents at Different Processing Stages , 2016, AMIA.

[30]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[31]  Farah Magrabi,et al.  Efficiency and safety of speech recognition for documentation in the electronic health record , 2017, J. Am. Medical Informatics Assoc..

[32]  J S O'Keefe,et al.  Status of Voicetype Dictation for Windows for the emergency physician. , 1996, The Journal of emergency medicine.

[33]  Kshitij Saxena,et al.  Provider Adoption of Speech Recognition and its Impact on Satisfaction, Documentation Quality, Efficiency, and Cost in an Inpatient EHR , 2018, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[34]  D. Elbourne,et al.  Systematic review of the Hawthorne effect: New concepts are needed to study research participation effects☆ , 2014, Journal of clinical epidemiology.

[35]  Fang Liu,et al.  QNOTE: an instrument for measuring the quality of EHR clinical notes , 2014, J. Am. Medical Informatics Assoc..

[36]  Christoph Ahlgrim,et al.  Introduction of digital speech recognition in a specialised outpatient department: a case study , 2016, BMC Medical Informatics and Decision Making.

[37]  Thomas G. Poder,et al.  Speech Recognition for Medical Dictation: Overview in Quebec and Systematic Review , 2018, Journal of Medical Systems.

[38]  Arthur C. Curtis,et al.  Technology Evaluation: Comparative Evaluation of Three Continuous Speech Recognition Software Packages in the Generation of Medical Reports , 2000, J. Am. Medical Informatics Assoc..

[39]  Suzanne V. Blackley,et al.  A clinician survey of using speech recognition for clinical documentation in the electronic health record , 2019, Int. J. Medical Informatics.