Evidence-based usability design principles for medication alerting systems

BackgroundUsability flaws in medication alerting systems may have a negative impact on clinical use and patient safety. In order to prevent the release of alerting systems that contain such flaws, it is necessary to provide designers and evaluators with evidence-based usability design principles. The objective of the present study was to develop a comprehensive, structured list of evidence-based usability design principles for medication alerting systems.MethodsNine sets of design principles for medication alerting systems were analyzed, summarized, and structured. We then matched the summarized principles with a list of usability flaws in order to determine the level of underlying evidence.ResultsFifty-eight principles were summarized from the literature and two additional principles were defined, so that each flaw was matched with a principle. We organized the 60 summarized usability design principles into 6 meta-principles, 38 principles, and 16 sub-principles. Only 15 principles were not matched with a usability flaw. The 6 meta-principles respectively covered the improvement of the signal-to-noise ratio, the support for collaborative working, the fit with a clinician’s workflow, the data display, the transparency of the alerting system, and the actionable tools to be provided within an alert.ConclusionsIt is possible to develop an evidence-based, structured, comprehensive list of usability design principles that are specific to medication alerting systems and are illustrated by the corresponding usability flaws. This list represents an improvement over the current literature. Each principle is now associated with the best available evidence of its violation. This knowledge may help to improve the usability of medication alerting systems and, ultimately, decrease the harmful consequences of the systems’ usability flaws.

[1]  Davide Bolchini,et al.  A successful model and visual design for creating context-aware drug-drug interaction alerts. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[2]  Dominique L. Scapin,et al.  Ergonomic criteria for evaluating the ergonomic quality of interactive systems , 1997, Behav. Inf. Technol..

[3]  E Ammenwerth,et al.  Usability Flaws in Medication Alerting Systems: Impact on Usage and Work System , 2015, Yearbook of Medical Informatics.

[4]  Mary K Goldstein,et al.  Evaluation of the acceptability and usability of a decision support system to encourage safe and effective use of opioid therapy for chronic, noncancer pain by primary care providers. , 2010, Pain medicine.

[5]  Emily S. Patterson,et al.  Research Paper: Human Factors Barriers to the Effective Use of Ten HIV Clinical Reminders , 2004, J. Am. Medical Informatics Assoc..

[6]  Joan S. Ash,et al.  Some Unintended Consequences of Clinical Decision Support Systems , 2007, AMIA.

[7]  Elske Ammenwerth,et al.  Usability flaws of medication-related alerting functions: A systematic qualitative review , 2015, J. Biomed. Informatics.

[8]  Jakob Nielsen,et al.  Chapter 6 – Usability Testing , 1993 .

[9]  David W. Bates,et al.  Development and preliminary evidence for the validity of an instrument assessing implementation of human-factors principles in medication-related decision-support systems - I-MeDeSA , 2011, J. Am. Medical Informatics Assoc..

[10]  Alissa L. Russ,et al.  A Human Factors Investigation of Medication Alerts: Barriers to Prescriber Decision-Making and Clinical Workflow , 2009, AMIA.

[11]  Christopher Pearce,et al.  Computers, Patients, and Doctors—Theoretical and Practical Perspectives , 2017 .

[12]  Emilie M. Roth,et al.  Research Paper: Impact of Clinical Reminder Redesign on Learnability, Efficiency, Usability, and Workload for Ambulatory Clinic Nurses , 2007, J. Am. Medical Informatics Assoc..

[13]  Emily S. Patterson,et al.  Exploring barriers and facilitators to the use of computerized clinical reminders. , 2005, Journal of the American Medical Informatics Association : JAMIA.

[14]  Kaveh G Shojania,et al.  Usability evaluation of order sets in a computerised provider order entry system , 2011, BMJ quality & safety.

[15]  Brian Bjørn,et al.  Computerised Physician Order Entry (CPOE). , 2009, Studies in health technology and informatics.

[16]  L. Hayden,et al.  Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality , 2011 .

[17]  Ilkka Kunnamo,et al.  Clinical decision support must be useful, functional is not enough: a qualitative study of computer-based clinical decision support in primary care , 2012, BMC Health Services Research.

[18]  Martin Jung,et al.  RESEARCH ARTICLE Open Access Development of a context model to prioritize drug safety alerts in CPOE systems , 2022 .

[19]  Alissa L. Russ,et al.  Prescribers' interactions with medication alerts at the point of prescribing: A multi-method, in situ investigation of the human-computer interaction , 2012, Int. J. Medical Informatics.

[20]  Gilad J. Kuperman,et al.  Alert Override Reasons: A Failure to Communicate , 2008, AMIA.

[21]  Dean F. Sittig,et al.  Clinician's assessments of outpatient electronic medical record alert and reminder usability and usefulness requirements , 2002, AMIA.

[22]  K. J. Vicente,et al.  Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work , 1999 .

[23]  Johanna I. Westbrook,et al.  The influence of computerized decision support on prescribing during ward-rounds: are the decision-makers targeted? , 2011, J. Am. Medical Informatics Assoc..

[24]  Marc Berg,et al.  Research Paper: Turning Off Frequently Overridden Drug Alerts: Limited Opportunities for Doing It Safely , 2008, J. Am. Medical Informatics Assoc..

[25]  Stéphanie Bernonville,et al.  Human Factors Based Recommendations for the Design of Medication Related Clinical Decision Support Systems (CDSS) , 2011, MIE.

[26]  Ann M. Bisantz,et al.  Cognitive Work Analysis , 2013 .

[27]  Thomas H. Payne,et al.  Review Paper: Medication-related Clinical Decision Support in Computerized Provider Order Entry Systems: A Review , 2007, J. Am. Medical Informatics Assoc..

[28]  David W. Bates,et al.  Synthesis of Research Paper: Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality , 2003, J. Am. Medical Informatics Assoc..

[29]  Kent Nakamoto,et al.  Is patient empowerment the key to promote adherence? A systematic review of the relationship between self-efficacy, health locus of control and medication adherence , 2017, PloS one.

[30]  Monique W. M. Jaspers,et al.  Effects of clinical decision-support systems on practitioner performance and patient outcomes: a synthesis of high-quality systematic review findings , 2011, J. Am. Medical Informatics Assoc..

[31]  Dean F Sittig,et al.  How to design computerized alerts to safe prescribing practices. , 2004, Joint Commission journal on quality and safety.

[32]  Helen Monkman,et al.  How to Present Evidence-Based Usability Design Principles Dedicated to Medication-Related Alerting Systems to Designers and Evaluators? Results from a Workshop , 2016, MIE.

[33]  Monique W. M. Jaspers,et al.  Usability Evaluation of a Computerized Physician Order Entry for Medication Ordering , 2009, MIE.

[34]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005, JAMA.

[35]  Elske Ammenwerth,et al.  Seeking Evidence to Support Usability Principles for Medication-Related Clinical Decision Support (CDS) Functions , 2013, MedInfo.

[36]  Marc Berg,et al.  Understanding handling of drug safety alerts: a simulation study , 2010, Int. J. Medical Informatics.

[37]  Diane L. Seger,et al.  A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems , 2010, J. Am. Medical Informatics Assoc..

[38]  Alissa L. Russ,et al.  The Workflow of Computerized Medication Ordering in Primary Care is Not Prescriptive , 2010 .

[39]  Douglas S. Bell,et al.  Interface design principles for usable decision support: A targeted review of best practices for clinical prescribing interventions , 2012, J. Biomed. Informatics.

[40]  Daniel Z. Sands,et al.  Assessing the value of electronic prescribing in ambulatory care: A focus group study , 2009, Int. J. Medical Informatics.

[41]  Jakob Nielsen,et al.  Enhancing the explanatory power of usability heuristics , 1994, CHI '94.

[42]  Dean F. Sittig,et al.  How to Design Computerized Alerts to Ensure Safe Prescribing Practices , 2004 .

[43]  Dean F. Sittig,et al.  Computerized Provider Order Entry Adoption: Implications for Clinical Workflow , 2008, Journal of General Internal Medicine.

[44]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[45]  Alissa L. Russ,et al.  Computerized Medication Alerts and Prescriber Mental Models: Observing Routine Patient Care , 2009 .

[46]  Marie-Catherine Beuscart-Zephir,et al.  From Usability Engineering to Evidence-based Usability in Health IT. , 2016, Studies in health technology and informatics.

[47]  Vimla L. Patel,et al.  Computer-based drug ordering: evaluation of interaction with a decision-support system , 2004, MedInfo.

[48]  Monique W. M. Jaspers,et al.  Effect of predefined order sets and usability problems on efficiency of computerized medication ordering , 2010, Int. J. Medical Informatics.

[49]  Alissa L. Russ,et al.  Recommendations to improve the usability of drug-drug interaction clinical decision support alerts , 2015, J. Am. Medical Informatics Assoc..

[50]  Shobha Phansalkar,et al.  Design of decision support interventions for medication prescribing , 2013, Int. J. Medical Informatics.

[51]  Annie Y. S. Lau,et al.  The influence of social networking sites on health behavior change: a systematic review and meta-analysis , 2015, J. Am. Medical Informatics Assoc..

[52]  Jonathan M. Teich,et al.  Grand challenges in clinical decision support , 2008, J. Biomed. Informatics.

[53]  Christian Lovis,et al.  A Qualitative Analysis of Prescription Activity and Alert Usage in a Computerized Physician Order Entry System , 2011, MIE.