Development of a Tool to Measure User Experience Following Electronic Health Record Implementation

OBJECTIVE: The aim of this study was to develop a survey tool to assess electronic health record (EHR) implementation to guide improvement initiatives. BACKGROUND: Survey tools are needed for ongoing improvement and have not been developed for aspects of EHR implementation. METHODS: The Baylor EHR User Experience (UX) survey was developed to capture 5 concept domains: training and competency, usability, infrastructure, usefulness, and end-user support. Validation efforts included content validity assessment, a pilot study, and analysis of 606 nurse respondents. The revised tool was sent to randomly sampled EHR nurse-users in 11 acute care facilities. RESULTS: A total of 1,301 nurses responded (37%). Internal consistency of the survey tool was excellent (Cronbach’s &agr; = .892). Survey responses including 1,819 open comments were used to identify and prioritize improvement efforts in areas such as education, support, optimization of EHR functions, and vendor change requests. CONCLUSION: The Baylor EHR UX survey was a valid tool that can be useful for prioritizing improvement efforts in relation to EHR implementation.

[1]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[2]  Patricia C. Dykes,et al.  Research Paper: Development and Psychometric Evaluation of the Impact of Health Information Technology (I-HIT) Scale , 2007, J. Am. Medical Informatics Assoc..

[3]  Tanjala S. Purnell,et al.  Clinician Perceptions of an Electronic Medical Record During the First Year of Implementaton in Emergency Services , 2010, Pediatric emergency care.

[4]  Kathy Smith,et al.  Evaluating the Impact of Computerized Clinical Documentation , 2005, Computers, informatics, nursing : CIN.

[5]  Eric G Poon,et al.  Nurses' Satisfaction With Medication Administration Point-of-Care Technology , 2007, The Journal of nursing administration.

[6]  J. Merrill,et al.  An Information Systems Model of the Determinants of Electronic Health Record Use , 2013, Applied Clinical Informatics.

[7]  Jonathan M. Teich,et al.  Research Paper: Implementation of Physician Order Entry: User Satisfaction and Self-Reported usage Patterns , 1996, J. Am. Medical Informatics Assoc..

[8]  N Staggers,et al.  Debunking Health IT Usability Myths , 2013, Applied Clinical Informatics.

[9]  Carolyn E Aydin,et al.  Nursing Documentation Time During Implementation of an Electronic Medical Record , 2003, The Journal of nursing administration.

[10]  N. Albert,et al.  Nursing Satisfaction With Implementation of Electronic Medication Administration Record , 2012, Computers, informatics, nursing : CIN.

[11]  Ross Koppel,et al.  Healthcare IT usability and suitability for clinical needs: challenges of design, workflow, and contractual relations. , 2010, Studies in health technology and informatics.

[12]  George Ochieng Otieno,et al.  Measuring effectiveness of electronic medical records systems: Towards building a composite index for benchmarking hospitals , 2008, Int. J. Medical Informatics.

[13]  Constance M. Johnson,et al.  Safety Issues Related to the Electronic Medical Record (EMR): Synthesis of the Literature from the Last Decade, 2000‐2009 , 2011, Journal of healthcare management / American College of Healthcare Executives.

[14]  Peter Hoonakker,et al.  Changes in end-user satisfaction with Computerized Provider Order Entry over time among nurses and providers in intensive care units , 2013, J. Am. Medical Informatics Assoc..

[15]  Charlotte A. Weaver,et al.  Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[16]  Jennifer Lai,et al.  Unintended Consequences of Information Technologies in Health Care—An Interactive Sociotechnical Analysis , 2007 .

[17]  Ming-Huei Lu,et al.  The Multimethod Evaluation of a Nursing Information System in Taiwan , 2009, Computers, informatics, nursing : CIN.

[18]  Robert L Edsall,et al.  An EHR user-satisfaction survey: advice from 408 family physicians. , 2005, Family practice management.

[19]  R. Edsall,et al.  The 2012 EHR User Satisfaction Survey: responses from 3,088 family physicians. , 2012, Family practice management.

[20]  Michael I. Harrison,et al.  Viewpoint Paper: Unintended Consequences of Information Technologies in Health Care - An Interactive Sociotechnical Analysis , 2007, J. Am. Medical Informatics Assoc..

[21]  Philip Darbyshire,et al.  'Rage against the machine?': nurses' and midwives' experiences of using Computerized Patient Information Systems for clinical information. , 2004, Journal of clinical nursing.