Interface, information, interaction: a narrative review of design and functional requirements for clinical decision support

Objective Provider acceptance and associated patient outcomes are widely discussed in the evaluation of clinical decision support systems (CDSSs), but critical design criteria for tools have generally been overlooked. The objective of this work is to inform electronic health record alert optimization and clinical practice workflow by identifying, compiling, and reporting design recommendations for CDSS to support the efficient, effective, and timely delivery of high-quality care. Material and Methods A narrative review was conducted from 2000 to 2016 in PubMed and The Journal of Human Factors and Ergonomics Society to identify papers that discussed/recommended design features of CDSSs that are associated with the success of these systems. Results Fourteen papers were included as meeting the criteria and were found to have a total of 42 unique recommendations; 11 were classified as interface features, 10 as information features, and 21 as interaction features. Discussion Features are defined and described, providing actionable guidance that can be applied to CDSS development and policy. To our knowledge, no reviews have been completed that discuss/recommend design features of CDSS at this scale, and thus we found that this was important for the body of literature. The recommendations identified in this narrative review will help to optimize design, organization, management, presentation, and utilization of information through presentation, content, and function. The designation of 3 categories (interface, information, and interaction) should be further evaluated to determine the critical importance of the categories. Future work will determine how to prioritize them with limited resources for designers and developers in order to maximize the clinical utility of CDSS. Conclusion This review will expand the field of knowledge and provide a novel organization structure to identify key recommendations for CDSS.

[1]  V. Mohan,et al.  Frequency of Passive EHR Alerts in the ICU: Another Form of Alert Fatigue? , 2016, Journal of patient safety.

[2]  Shobha Phansalkar,et al.  Evaluation of medication alerts in electronic health records for compliance with human factors principles. , 2014, Journal of the American Medical Informatics Association : JAMIA.

[3]  J M Teich,et al.  Clinical decision support systems come of age. , 2000, M.D. computing : computers in medical practice.

[4]  Hien Nguyen,et al.  From vital signs to clinical outcomes for patients with sepsis: a machine learning basis for a clinical decision support system , 2014, J. Am. Medical Informatics Assoc..

[5]  Jean-Baptiste Lamy,et al.  Design of an original interface that facilitates the use of clinical practice guidelines of infection by physicians in primary care , 2012, MIE.

[6]  Jonathan M. Teich,et al.  Application of Information Technology: Automating Complex Guidelines for Chronic Disease: Lessons Learned , 2003, J. Am. Medical Informatics Assoc..

[7]  R. Miller.  Taking Inventory of Medical Decision Support Software Development , 1993, Methods of Information in Medicine.

[8]  Bonnie Kaplan,et al.  Evaluating informatics applications - some alternative approaches: theory, social interactionism, and call for methodological pluralism , 2001, Int. J. Medical Informatics.

[9]  Stéphanie Bernonville,et al.  Human Factors Based Recommendations for the Design of Medication Related Clinical Decision Support Systems (CDSS) , 2011, MIE.

[10]  Stephen P. Boyd,et al.  A Mathematical Model for Interpretable Clinical Decision Support with Applications in Gynecology , 2012, PloS one.

[11]  N. Wilczynski,et al.  Computerized clinical decision support systems for acute care management: A decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes , 2011, Implementation science : IS.

[12]  Stephen B. Johnson,et al.  Review: An Object-oriented Taxonomy of Medical Data Presentations , 2000, J. Am. Medical Informatics Assoc..

[13]  A Winter,et al.  Decision support in medicine: a survey of problems of user acceptance. , 2000, Studies in health technology and informatics.

[14]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[15]  Marc Berg,et al.  Overriding of drug safety alerts in computerized physician order entry. , 2006, Journal of the American Medical Informatics Association : JAMIA.

[16]  William M. Tierney,et al.  Improving clinical decisions and outcomes with information: a review , 2001, Int. J. Medical Informatics.

[17]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.

[18]  Douglas S. Bell,et al.  Interface design principles for usable decision support: A targeted review of best practices for clinical prescribing interventions , 2012, J. Biomed. Informatics.

[19]  Alan Morris.  Developing and Implementing Computerized Protocols for Standardization of Clinical Decisions , 2000, Annals of Internal Medicine.

[20]  David W. Bates,et al.  Clinical decision support systems could be modified to reduce 'alert fatigue' while still minimizing the risk of litigation. , 2011, Health affairs.

[21]  Seonah Lee,et al.  Features of Computerized Clinical Decision Support Systems Supportive of Nursing Practice: A Literature Review , 2013, Computers, informatics, nursing : CIN.

[22]  M. Morris,et al.  Clinical Reporting to Primary Care Physicians Leads to Increased Use and Understanding of Bone Densitometry and Affects the Management of Osteoporosis , 1998, Annals of Internal Medicine.

[23]  R Brian Haynes,et al.  Computerized clinical decision support systems for primary preventive care: A decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes , 2011, Implementation science : IS.

[24]  Marc-Oliver Wright,et al.  Clinical decision support systems and infection prevention: to know is not enough. , 2015, American journal of infection control.

[25]  Jennifer A. Byrne.  Improving the peer review of narrative literature reviews , 2016, Research Integrity and Peer Review.

[26]  Dean F Sittig,et al.  Notifications received by primary care practitioners in electronic health records: a taxonomy and time analysis. , 2012, The American journal of medicine.

[27]  Alain Venot,et al.  Comparison of two kinds of interface, based on guided navigation or usability principles, for improving the adoption of computerized decision support systems: application to the prescription of antibiotics. , 2014, Journal of the American Medical Informatics Association : JAMIA.

[28]  Heimar F. Marin,et al.  Artificial intelligence techniques applied to the development of a decision-support system for diagnosing celiac disease , 2011, Int. J. Medical Informatics.

[29]  William Marsh,et al.  Combining data and meta-analysis to build Bayesian networks for clinical decision support , 2014, J. Biomed. Informatics.

[30]  M H Trivedi,et al.  Development and Implementation of Computerized Clinical Guidelines: Barriers and Solutions , 2002, Methods of Information in Medicine.

[31]  Peter J. Haug,et al.  Methods Paper: Evaluation of a Computerized Diagnostic Decision Support System for Patients with Pneumonia: Study Design Considerations , 2001, J. Am. Medical Informatics Assoc..

[32]  P. Glasziou,et al.  Computerised reminders and feedback in medication management: a systematic review of randomised controlled trials , 2003, The Medical journal of Australia.

[33]  T. Bright,et al.  Transforming User Needs into Functional Requirements for an Antibiotic Clinical Decision Support System , 2013, Applied Clinical Informatics.

[34]  T. Bodenheimer,et al.  Electronic technology: a spark to revitalize primary care? , 2003, JAMA.

[35]  Roger B. Davis,et al.  Physicians' decisions to override computerized drug alerts in primary care. , 2003, Archives of internal medicine.

[36]  Anne Holbrook,et al.  Features predicting the success of computerized decision support for prescribing: a systematic review of randomized controlled trials , 2009, BMC Medical Informatics Decis. Mak..

[37]  T. Payne.  Computer decision support systems. , 2000, Chest.

[38]  Blackford Middleton,et al.  Documentation-based clinical decision support to improve antibiotic prescribing for acute respiratory infections in primary care: a cluster randomised controlled trial. , 2009, Informatics in primary care.

[39]  Thomas Wetter,et al.  Lessons learnt from bringing knowledge-based decision support into routine use , 2002, Artif. Intell. Medicine.

[40]  Marc Berg,et al.  Viewpoint Paper: Some Unintended Consequences of Information Technology in Health Care: The Nature of Patient Care Information System-related Errors , 2003, J. Am. Medical Informatics Assoc..

[41]  R Khajouei,et al.  The Impact of CPOE Medication Systems’ Design Aspects on Usability, Workflow and Medication Orders , 2010, Methods of Information in Medicine.

[42]  P. Shekelle,et al.  Systematic Review: Impact of Health Information Technology on Quality, Efficiency, and Costs of Medical Care , 2006, Annals of Internal Medicine.

[43]  W. Hersh.  Medical informatics: improving health care through information. , 2002, JAMA.

[44]  Juan Miguel García-Gómez,et al.  Mobile Clinical Decision Support Systems and Applications: A Literature and Commercial Review , 2013, Journal of Medical Systems.

[45]  J. Noyes,et al.  Alarm systems: a guide to design, management and procurement , 1999 .

[46]  Jean-Baptiste Lamy,et al.  Design of a graphical and interactive interface for facilitating access to drug contraindications, cautions for use, interactions and adverse effects , 2008, BMC Medical Informatics Decis. Mak..

[47]  Ben Shneiderman,et al.  Tree-maps: a space-filling approach to the visualization of hierarchical information structures , 1991, Proceeding Visualization '91.

[48]  Alissa L. Russ,et al.  Prescribers' interactions with medication alerts at the point of prescribing: A multi-method, in situ investigation of the human-computer interaction , 2012, Int. J. Medical Informatics.

[49]  D. Coplen.  Types of Unintended Consequences Related to Computerized Provider Order Entry , 2007 .

[50]  Jeffery L. Belden,et al.  Defining and testing EMR usability: Principles and proposed methods of EMR usability evaluation and rating. , 2009 .

[51]  H. Lehmann,et al.  Clinical Decision Support Systems (cdsss) Have Been Hailed for Their Potential to Reduce Medical Errors Clinical Decision Support Systems for the Practice of Evidence-based Medicine , 2022 .

[52]  R Brian Haynes,et al.  Computerized clinical decision support systems for chronic disease management: A decision-maker-researcher partnership systematic review , 2011, Implementation science : IS.

[53]  L. Moja,et al.  Effectiveness of computerized decision support systems linked to electronic health records: a systematic review and meta-analysis. , 2014, American journal of public health.

[54]  Charlotte A. Weaver,et al.  Enhancing patient safety and quality of care by improving the usability of electronic health record systems: recommendations from AMIA. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[55]  L. Hayden,et al.  Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality , 2011 .

[56]  J. Geoffrey Chase,et al.  Impact of Human Factors on Clinical Protocol Performance: A Proposed Assessment Framework and Case Examples , 2008, Journal of diabetes science and technology.

[57]  Peter Tarczy-Hornoch,et al.  Usability evaluation of pharmacogenomics clinical decision support aids and clinical knowledge resources in a computerized provider order entry system: A mixed methods approach , 2014, Int. J. Medical Informatics.

[58]  Kensaku Kawamoto,et al.  Clinical Decision Support Provided within Physician Order Entry Systems: A Systematic Review of Features Effective for Changing Clinician Behavior , 2003, AMIA.

[59]  Andrew Q. Ninh.  DocBot: A novel clinical decision support algorithm , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[60]  Randolph A. Miller,et al.  The anatomy of decision support during inpatient care provider order entry (CPOE): Empirical observations from a decade of CPOE experience at Vanderbilt , 2005, J. Biomed. Informatics.

[61]  Richard N. Shiffman,et al.  Review: Computer-based Guideline Implementation Systems: A Systematic Review of Functionality and Effectiveness , 1999, J. Am. Medical Informatics Assoc..

[62]  Lina Fatima Soualmia,et al.  Validating the semantics of a medical iconic language using ontological reasoning , 2013, J. Biomed. Informatics.

[63]  Christian Nøhr,et al.  Four principles for user interface design of computerised clinical decision support systems. , 2011, Studies in health technology and informatics.

[64]  Régis Beuscart,et al.  Using Treemaps to represent medical data , 2006, MIE.

[65]  Monique W. M. Jaspers,et al.  CPOE System Design Aspects and Their Qualitative Effect on Usability , 2008, MIE.

[66]  H A Heathfield,et al.  Philosophies for the Design and Development of Clinical Decision-Support Systems , 1993, Methods of Information in Medicine.

[67]  Alain Venot,et al.  An iconic language for the graphical representation of medical concepts , 2008, BMC Medical Informatics Decis. Mak..

[68]  P. Embí,et al.  Clinical decision support systems in the pediatric intensive care unit* , 2009, Pediatric critical care medicine : a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies.

[69]  R Brian Haynes,et al.  Features of effective computerised clinical decision support systems: meta-regression of 162 randomised trials , 2013, BMJ : British Medical Journal.

[70]  Patrice Degoulet,et al.  Determinants of Success for Computerized Clinical Decision Support Systems Integrated into CPOE Systems: a Systematic Review , 2006, AMIA.