Comparing Electronic Health Record Usability of Primary Care Physicians by Clinical Year

Objectives: To examine usability gaps among primary care resident physicians by clinical year: year 1 (Y1), year 2 (Y2), and year 3 (Y3) when using electronic health record (EHR). Methods: Twenty-nine usability tests with video analysis were conducted involving triangular method approach. Performance metrics of percent task success rate, time on task, and mouse activities were compared along with subtask analysis among the three physician groups. Results: Our findings showed comparable results for physicians of all three years in mean performance measures, specifically task success rate (Y1: 95%, Y2: 98%, Y3: 95%). However, varying usability issues were identified among physicians from all three clinical years. Twenty-nine common usability issues across five themes emerged during sub task analysis: inconsistencies, user interface issues, structured data issues, ambiguous terminologies, and workarounds. Discussion and Conclusion: This study identified varying usability issues for users of the EHR with different experience level, which may be used to potentially increase physicians’ performance when using an EHR. While three physician groups showed comparable performance metrics, these groups encountered numerous usability issues that should be addressed for effective EHR training and patient care.

[1]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[2]  Nancy M. Lorenzi,et al.  How to successfully select and implement electronic health records (EHR) in small ambulatory practice settings , 2009, BMC Medical Informatics Decis. Mak..

[3]  Peter D. Stetson,et al.  Cognitive Analysis of Decision Support for Antibiotic Prescribing at the Point of Ordering in a Neonatal Intensive Care Unit , 2009, AMIA.

[4]  Vickie Nguyen,et al.  Detection and characterization of usability problems in structured data entry interfaces in dentistry , 2013, Int. J. Medical Informatics.

[5]  Gerald P. Douglas,et al.  Touchscreen Task Efficiency and Learnability in an Electronic Medical Record at the Point-of-Care , 2010, MedInfo.

[6]  Jeffery L. Belden,et al.  A Diabetes Dashboard and Physician Efficiency and Accuracy in Accessing Data Needed for High-Quality Diabetes Care , 2011, The Annals of Family Medicine.

[7]  Dennis Wixon,et al.  User performance with command, menu, and iconic interfaces , 1985, CHI '85.

[8]  Richard E. Cordes.  The effects of running fewer subjects on time-on-task measures , 1993, Int. J. Hum. Comput. Interact..

[9]  James P. Turley,et al.  One Size Does Not Fit All: EHR Clinical Summary Design Requirements for Nurses , 2012, Nursing Informatics.

[10]  P. Shekelle,et al.  Systematic Review: Impact of Health Information Technology on Quality, Efficiency, and Costs of Medical Care , 2006, Annals of Internal Medicine.

[11]  E. Keeler,et al.  Costs and benefits of health information technology. , 2006, Evidence report/technology assessment.

[12]  Lisa A. Grabenbauer,et al.  Adoption of Electronic Health Records , 2011, Applied Clinical Informatics.

[13]  E. Jones,et al.  A grounded theory approach to modelling learnability of hypermedia authoring tools , 2002, Interact. Comput..

[14]  Gavriel Salvendy,et al.  A proposed index of usability: A method for comparing the relative usability of different software systems , 1997, Behav. Inf. Technol..

[15]  Joi L. Moore,et al.  Addressing Human Computer Interaction Issues of Electronic Health Record in Clinical Encounters , 2013, HCI.

[16]  Elizabeth M Borycki,et al.  Technology induced error and usability: The relationship between usability problems and prescription errors when using a handheld application , 2005, Int. J. Medical Informatics.

[17]  Steven R. Simon,et al.  Are physicians' perceptions of healthcare quality and practice satisfaction affected by errors associated with electronic health record use? , 2012, J. Am. Medical Informatics Assoc..

[18]  Joseph L. Kannry,et al.  Integrating usability testing and think-aloud protocol analysis with "near-live" clinical simulations in evaluating clinical decision support , 2012, Int. J. Medical Informatics.

[19]  N. Menachemi,et al.  Benefits and drawbacks of electronic health record systems , 2011 .

[20]  Christopher E. West,et al.  The value of electronic health records in solo or small group practices. , 2005, Health affairs.

[21]  Martina A. Clarke,et al.  What Learnability Issues Do Primary Care Physicians Experience When Using CPOE? , 2015, HCI.

[22]  G. Kuperman,et al.  A qualitative analysis of an electronic health record (EHR) implementation in an academic ambulatory setting. , 2008, Informatics in primary care.

[23]  A. A. Whittaker,et al.  Barriers and facilitators to electronic documentation in a rural hospital. , 2009, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[24]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[25]  C. Goldzweig,et al.  Costs and benefits of health information technology: new trends from the literature. , 2009, Health affairs.

[26]  Tinja Lääveri,et al.  National questionnaire study on clinical ICT systems proofs: Physicians suffer from poor usability , 2011, Int. J. Medical Informatics.

[27]  E. Hing,et al.  Use and characteristics of electronic health record systems among office-based physician practices: United States, 2001-2012. , 2012, NCHS data brief.

[28]  M. Stewart,et al.  Implementing electronic health records: Key factors in primary care. , 2008, Canadian family physician Medecin de famille canadien.

[29]  K. Baumlin,et al.  A Pilot Study on Usability Analysis of Emergency Department Information System by Nurses , 2012, Applied Clinical Informatics.