The design of decisions: Matching clinical decision support recommendations to Nielsen's design heuristics

OBJECTIVE While general design heuristics exist for graphic user interfaces, it remains a challenge to facilitate the implementation of these heuristics for the design of clinical decision support. Our goals were to map a set of recommendations for clinical decision support design found in current literature to Jakob Nielsen's traditional usability heuristics and to suggest usability areas that need more investigation. MATERIALS AND METHODS Using a modified nominal group process, the research team discussed, classified, and mapped recommendations, organized as interface, information, and interaction, to design heuristics. A previous narrative review identified 42 recommendations from the literature to define the design and functional characteristics that impact the performance of CDS in terms of provider preference, process of care, and patient outcomes. MAIN FINDINGS We matched 20 out of 42 recommendations to heuristics. The mapping reveals gaps in both heuristics and recommendations, identifying a set of Nielsen's heuristics that are underrepresented in the literature and subsets of recommendations important to design not covered in Nielsen's heuristics. We attributed this, in part, to the evolution of technology since the inception of Nielsen's heuristics. The team created a new interaction heuristic: Integration into real-time workflow to consider the needs of the end-user in the clinical space. DISCUSSION Clinical decision support has enabled clinicians to better address arising information needs; however there remains a lack of evidence-based guidelines in terms of functional and design requirements. CONCLUSION Results from this review suggest that interaction design principles were not fully satisfied by the current literature of clinical decision support.

[1]  Alain Venot,et al.  Comparison of two kinds of interface, based on guided navigation or usability principles, for improving the adoption of computerized decision support systems: application to the prescription of antibiotics. , 2014, Journal of the American Medical Informatics Association : JAMIA.

[2]  Alan Morris Developing and Implementing Computerized Protocols for Standardization of Clinical Decisions , 2000, Annals of Internal Medicine.

[3]  Jakob Nielsen,et al.  Heuristic evaluation of user interfaces , 1990, CHI '90.

[4]  Blackford Middleton,et al.  Documentation-based clinical decision support to improve antibiotic prescribing for acute respiratory infections in primary care: a cluster randomised controlled trial. , 2009, Informatics in primary care.

[5]  David W. Bates,et al.  Synthesis of Research Paper: Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality , 2003, J. Am. Medical Informatics Assoc..

[6]  Dominique L. Scapin,et al.  Ergonomic criteria for the evaluation of human-computer interfaces , 1993 .

[7]  Peter J. Haug,et al.  Methods Paper: Evaluation of a Computerized Diagnostic Decision Support System for Patients with Pneumonia: Study Design Considerations , 2001, J. Am. Medical Informatics Assoc..

[8]  Jonathan M. Teich,et al.  Application of Information Technology: Automating Complex Guidelines for Chronic Disease: Lessons Learned , 2003, J. Am. Medical Informatics Assoc..

[9]  Nadine B. Sarter,et al.  Display Clutter , 2015, Hum. Factors.

[10]  Juan Miguel García-Gómez,et al.  Mobile Clinical Decision Support Systems and Applications: A Literature and Commercial Review , 2013, Journal of Medical Systems.

[11]  Bonnie Kaplan,et al.  Evaluating informatics applications - some alternative approaches: theory, social interactionism, and call for methodological pluralism , 2001, Int. J. Medical Informatics.

[12]  Bonnie Kaplan,et al.  Clinical decision support systems for the practice of evidence-based medicine. , 2001, Journal of the American Medical Informatics Association : JAMIA.

[13]  Muge Capan,et al.  Interface, information, interaction: a narrative review of design and functional requirements for clinical decision support , 2018, J. Am. Medical Informatics Assoc..

[14]  R. Brook,et al.  Consensus methods: characteristics and guidelines for use. , 1984, American journal of public health.

[15]  Joseph L. Kannry,et al.  Usability Evaluation of a Clinical Decision Support System for Geriatric ED Pain Treatment , 2016, Applied Clinical Informatics.

[16]  A. Iusem,et al.  Set-valued mappings and enlargements of monotone operators , 2008 .

[17]  Vimla L. Patel,et al.  Using usability heuristics to evaluate patient safety of medical devices , 2003, J. Biomed. Informatics.

[18]  David A Jaffray,et al.  Applying usability heuristics to radiotherapy systems. , 2012, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[19]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[20]  J. Geoffrey Chase,et al.  Impact of Human Factors on Clinical Protocol Performance: A Proposed Assessment Framework and Case Examples , 2008, Journal of diabetes science and technology.

[21]  P. Glasziou,et al.  Computerised reminders and feedback in medication management: a systematic review of randomised controlled trials , 2003, The Medical journal of Australia.

[22]  Anne Holbrook,et al.  Features predicting the success of computerized decision support for prescribing: a systematic review of randomized controlled trials , 2009, BMC Medical Informatics Decis. Mak..

[23]  Frederick S. Hillier,et al.  Introduction of Operations Research , 1967 .

[24]  Charlotte A. Weaver,et al.  Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[25]  Jeffery L. Belden,et al.  Defining and testing EMR usability: Principles and proposed methods of EMR usability evaluation and rating. , 2009 .

[26]  W. Hersh Medical informatics: improving health care through information. , 2002, JAMA.

[27]  Monique W. M. Jaspers,et al.  CPOE System Design Aspects and Their Qualitative Effect on Usability , 2008, MIE.

[28]  H A Heathfield,et al.  Philosophies for the Design and Development of Clinical Decision-Support Systems , 1993, Methods of Information in Medicine.

[29]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.

[30]  Douglas S. Bell,et al.  Interface design principles for usable decision support: A targeted review of best practices for clinical prescribing interventions , 2012, J. Biomed. Informatics.

[31]  Elizabeth M Borycki,et al.  Using heuristic evaluations to assess the safety of health information systems. , 2009, Studies in health technology and informatics.

[32]  Andrew Sears,et al.  Heuristic Walkthroughs: Finding the Problems Without the Noise , 1997, Int. J. Hum. Comput. Interact..

[33]  Diane L. Seger,et al.  A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems , 2010, J. Am. Medical Informatics Assoc..

[34]  Anne Miller,et al.  Integrating computerized clinical decision support systems into clinical work: A meta-synthesis of qualitative research , 2015, Int. J. Medical Informatics.

[35]  Marc-Oliver Wright,et al.  Clinical decision support systems and infection prevention: to know is not enough. , 2015, American journal of infection control.

[36]  P. Embí,et al.  Clinical decision support systems in the pediatric intensive care unit* , 2009, Pediatric critical care medicine : a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies.

[37]  T. Payne Computer decision support systems. , 2000, Chest.

[38]  R Khajouei,et al.  The Impact of CPOE Medication Systems’ Design Aspects on Usability, Workflow and Medication Orders , 2010, Methods of Information in Medicine.

[39]  Richard N. Shiffman,et al.  Review: Computer-based Guideline Implementation Systems: A Systematic Review of Functionality and Effectiveness , 1999, J. Am. Medical Informatics Assoc..

[40]  Rosa Yáñez Gómez,et al.  Heuristic Evaluation on Mobile Interfaces: A New Checklist , 2014, TheScientificWorldJournal.

[41]  Thomas Wetter,et al.  Lessons learnt from bringing knowledge-based decision support into routine use , 2002, Artif. Intell. Medicine.

[42]  Charlene R. Weir,et al.  Adapting Nielsen's Design Heuristics to Dual Processing for Clinical Decision Support , 2016, AMIA.

[43]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[44]  William M. Tierney,et al.  Improving clinical decisions and outcomes with information: a review , 2001, Int. J. Medical Informatics.

[45]  Stéphanie Bernonville,et al.  Human Factors Based Recommendations for the Design of Medication Related Clinical Decision Support Systems (CDSS) , 2011, MIE.

[46]  A Winter,et al.  Decision support in medicine: a survey of problems of user acceptance. , 2000, Studies in health technology and informatics.

[47]  M H Trivedi,et al.  Development and Implementation of Computerized Clinical Guidelines: Barriers and Solutions , 2002, Methods of Information in Medicine.

[48]  T. Bright,et al.  Transforming User Needs into Functional Requirements for an Antibiotic Clinical Decision Support System , 2013, Applied Clinical Informatics.

[49]  T. Bodenheimer,et al.  Electronic technology: a spark to revitalize primary care? , 2003, JAMA.

[50]  Peter Tarczy-Hornoch,et al.  Usability evaluation of pharmacogenomics clinical decision support aids and clinical knowledge resources in a computerized provider order entry system: A mixed methods approach , 2014, Int. J. Medical Informatics.

[51]  Kensaku Kawamoto,et al.  Clinical Decision Support Provided within Physician Order Entry Systems: A Systematic Review of Features Effective for Changing Clinician Behavior , 2003, AMIA.

[52]  S. Studer,et al.  The Use of an Early Alert System to Improve Compliance with Sepsis Bundles and to Assess Impact on Mortality , 2012, Critical care research and practice.

[53]  Patrice Degoulet,et al.  Determinants of Success for Computerized Clinical Decision Support Systems Integrated into CPOE Systems: a Systematic Review , 2006, AMIA.