Usability Evaluation of An Electronic Medication Administration Record (eMAR) Application

BACKGROUND Electronic medication administration records (eMARs) have been widely used in recent years. However, formal usability evaluations are not yet available for these vendor applications, especially from the perspective of nurses, the largest group of eMAR users. OBJECTIVE To conduct a formal usability evaluation of an implemented eMAR. METHODS Four evaluators examined a commercial vendor eMAR using heuristic evaluation techniques. The evaluators defined seven tasks typical of eMAR use and independently evaluated the application. Consensus techniques were used to obtain 100% agreement of identified usability problems and severity ratings. Findings were reviewed with 5 clinical staff nurses and the Director of Clinical Informatics who verified findings with a small group of clinical nurses. RESULTS Evaluators found 60 usability problems categorized into 233 heuristic violations. Match, Error, and Visibility heuristics were the most frequently violated. Administer Medication and Order and Modify Medications tasks had the highest number of heuristic violations and usability problems rated as major or catastrophic. CONCLUSION The high number of usability problems could impact the effectiveness, efficiency and satisfaction of nurses' medication administration activities and may include concerns about patient safety. Usability is a joint responsibility between sites and vendors. We offer a call to action for usability evaluations at all sites and eMAR application redesign as necessary to improve the user experience and promote patient safety.

[1]  Julie A. Jacko,et al.  Human–Computer Interaction , 2012 .

[2]  G J Kuperman,et al.  A randomized trial of a computer-based intervention to reduce utilization of redundant laboratory tests. , 1999, The American journal of medicine.

[3]  L. Cordero,et al.  Impact of Computerized Physician Order Entry on Clinical Practice in a Newborn Intensive Care Unit , 2004, Journal of Perinatology.

[4]  J. Marc Overhage,et al.  Research Paper: Controlled Trial of Direct Physician Order Entry: Effects on Physicians' Time Utilization in Ambulatory Primary Care Internal Medicine Practices , 2001, J. Am. Medical Informatics Assoc..

[5]  L. Kohn,et al.  To Err Is Human : Building a Safer Health System , 2007 .

[6]  C. Marano,et al.  To err is human. Building a safer health system , 2005 .

[7]  Arie Hasman,et al.  Review Paper: Determinants of Success of Inpatient Clinical Information Systems: A Literature Review , 2003, J. Am. Medical Informatics Assoc..

[8]  Kai Zheng,et al.  Research Article: An Interface-driven Analysis of User Interactions with an Electronic Health Records System , 2009, J. Am. Medical Informatics Assoc..

[9]  Jeffery L. Belden,et al.  Defining and testing EMR usability: Principles and proposed methods of EMR usability evaluation and rating. , 2009 .

[10]  Joan S. Ash,et al.  The unintended consequences of computerized provider order entry: Findings from a mixed methods exploration , 2009, Int. J. Medical Informatics.

[11]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005, JAMA.

[12]  Andrew Sears,et al.  Human-Computer Interaction Fundamentals , 2009 .

[13]  A. Wall,et al.  Book ReviewTo Err is Human: building a safer health system Kohn L T Corrigan J M Donaldson M S Washington DC USA: Institute of Medicine/National Academy Press ISBN 0 309 06837 1 $34.95 , 2000 .

[14]  Ting-Ting Lee,et al.  Evaluation of ICU Nurses' Use of the Clinical Information System in Taiwan , 2011, Computers, informatics, nursing : CIN.

[15]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[16]  J. Barletta,et al.  Effect of bar-code-assisted medication administration on medication error rates in an adult medical intensive care unit. , 2009, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[17]  R. Hughes.  Patient Safety and Quality: An Evidence-Based Handbook for Nurses , 2008 .

[18]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[19]  Patrice Degoulet,et al.  A usability study of CPOE's medication administration functions: impact on physiciannurse cooperation , 2004, MedInfo.

[20]  Bradley A. Evanoff,et al.  An Analysis of Nurses' Cognitive Work: A New Perspective for Understanding Medical Errors , 2005 .

[21]  T. Brennan,et al.  The nature of adverse events in hospitalized patients. Results of the Harvard Medical Practice Study II. , 1991, The New England journal of medicine.

[22]  N. Staggers,et al.  Nurses' Evaluations of a Novel Design for an Electronic Medication Administration Record , 2007, Computers, informatics, nursing : CIN.

[23]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[24]  Shobha Phansalkar,et al.  The state of the evidence for computerized provider order entry: A systematic review and analysis of the quality of the literature , 2009, Int. J. Medical Informatics.

[25]  Jakob Nielsen,et al.  Chapter 4 – The Usability Engineering Lifecycle , 1993 .

[26]  Abha Agrawal.  Medication errors: prevention using information technology systems. , 2009, British journal of clinical pharmacology.

[27]  J. Wreathall,et al.  Human errors and disasters , 1992, Conference Record for 1992 Fifth Conference on Human Factors and Power Plants.

[28]  David W Bates,et al.  Quantifying Nursing Workflow in Medication Administration , 2008, The Journal of nursing administration.

[29]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[30]  Jakob Nielsen,et al.  Heuristic Evaluation of Prototypes (individual) , 2022 .

[31]  Abha Agrawal,et al.  Medication errors: problems and recommendations from a consensus meeting. , 2009, British journal of clinical pharmacology.

[32]  J. Nielsen.  Usability inspection methods , 1994, CHI Conference Companion.

[33]  Monique W. M. Jaspers,et al.  Usability Evaluation of a Computerized Physician Order Entry for Medication Ordering , 2009, MIE.

[34]  Bruce L. Lambert,et al.  Recent Developments in the Prevention and Detection of Drug Name Confusion: MEDMARX data report. A report on the relationship of drug names and medication errors in response to the Institute of Medicine’s call for action , 2008 .

[35]  David W. Bates,et al.  Information technology and patient safety in nursing practice: an international perspective , 2004, International Journal of Medical Informatics.

[36]  Shobha Phansalkar,et al.  Patient Safety and Health Information Technology: Role of the Electronic Health Record , 2008 .

[37]  D. Bates,et al.  Relationship between medication errors and adverse drug events , 1995, Journal of General Internal Medicine.

[38]  R. Wachter,et al.  Safe but sound: patient safety meets evidence-based medicine. , 2002, JAMA.

[39]  R. Bal,et al.  Evaluation of the Impact of a CPOE System on Nurse-physician Communication , 2009, Methods of Information in Medicine.

[40]  A. Barton,et al.  Patient Safety and Quality: An Evidence-Based Handbook for Nurses , 2009 .

[41]  David W. Bates,et al.  Health information exchange and patient safety , 2007, J. Biomed. Informatics.

[42]  D. Bates,et al.  Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. , 2003, Archives of internal medicine.

[43]  Jeffrey Rubin,et al.  Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests , 1994 .

[44]  Eric G Poon,et al.  Nurses' Satisfaction With Medication Administration Point-of-Care Technology , 2007, The Journal of nursing administration.

[45]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[46]  Vimla L. Patel,et al.  Using usability heuristics to evaluate patient safety of medical devices , 2003, J. Biomed. Informatics.