Effects of clinical decision-support systems on practitioner performance and patient outcomes: a synthesis of high-quality systematic review findings

OBJECTIVE To synthesize the literature on clinical decision-support systems' (CDSS) impact on healthcare practitioner performance and patient outcomes. DESIGN Literature search on Medline, Embase, Inspec, Cinahl, Cochrane/Dare and analysis of high-quality systematic reviews (SRs) on CDSS in hospital settings. Two-stage inclusion procedure: (1) selection of publications on predefined inclusion criteria; (2) independent methodological assessment of preincluded SRs by the 11-item measurement tool, AMSTAR. Inclusion of SRs with AMSTAR score 9 or above. SRs were thereafter rated on level of evidence. Each stage was performed by two independent reviewers. RESULTS 17 out of 35 preincluded SRs were of high methodological quality and further analyzed. Evidence that CDSS significantly impacted practitioner performance was found in 52 out of 91 unique studies of the 16 SRs examining this effect (57%). Only 25 out of 82 unique studies of the 16 SRs reported evidence that CDSS positively impacted patient outcomes (30%). CONCLUSIONS Few studies have found any benefits on patient outcomes, though many of these have been too small in sample size or too short in time to reveal clinically important effects. There is significant evidence that CDSS can positively impact healthcare providers' performance with drug ordering and preventive care reminder systems as most clear examples. These outcomes may be explained by the fact that these types of CDSS require a minimum of patient data that are largely available before the advice is (to be) generated: at the time clinicians make the decisions.

[1]  L. Trinquart,et al.  Computerized advice on drug dosage to improve prescribing practice. , 2008, The Cochrane database of systematic reviews.

[2]  John Concato,et al.  Use of computer decision support interventions to improve medication prescribing in older adults: a systematic review. , 2008, The American journal of geriatric pharmacotherapy.

[3]  R. Haynes,et al.  Effects of Computer-based Clinical Decision Support Systems on Clinician Performance and Patient Outcome: A Critical Appraisal of Research , 1994, Annals of Internal Medicine.

[4]  Anne Holbrook,et al.  Features predicting the success of computerized decision support for prescribing: a systematic review of randomized controlled trials , 2009, BMC Medical Informatics Decis. Mak..

[5]  Jeremy Grimshaw,et al.  AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. , 2009, Journal of clinical epidemiology.

[6]  Nicolette de Keizer,et al.  The impact of computerized physician medication order entry in hospitalized patients - A systematic review , 2008, Int. J. Medical Informatics.

[7]  I. Wong,et al.  Interventions to Reduce Dosing Errors in Children , 2013, Drug safety.

[8]  Jeremy M. Grimshaw,et al.  Increasing the demand for childhood vaccination in developing countries: a systematic review , 2009, BMC international health and human rights.

[9]  R. Haynes,et al.  Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review. , 1998, JAMA.

[10]  Bonnie Kaplan,et al.  Evaluating informatics applications - clinical decision support systems literature review , 2001, Int. J. Medical Informatics.

[11]  Andrew J. Rohm,et al.  Just what the doctor ordered: The role of information sensitivity and trust in reducing medical information privacy concern , 2004 .

[12]  Richard N. Shiffman,et al.  Review: Computer-based Guideline Implementation Systems: A Systematic Review of Functionality and Effectiveness , 1999, J. Am. Medical Informatics Assoc..

[13]  A. Egberts,et al.  The Effect of Computerized Physician Order Entry on Medication Prescription Errors and Clinical Outcome in Pediatric and Intensive Care: A Systematic Review , 2009, Pediatrics.

[14]  J. Grimshaw,et al.  From best evidence to best practice: effective implementation of change in patients' care , 2003, The Lancet.

[15]  E. Balas,et al.  Computerized Knowledge Management in Diabetes Care , 2004, Medical care.

[16]  Patrice Degoulet,et al.  Determinants of Success for Computerized Clinical Decision Support Systems Integrated into CPOE Systems: a Systematic Review , 2006, AMIA.

[17]  D. Bates,et al.  Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. , 2003, Archives of internal medicine.

[18]  R B Haynes,et al.  A critical appraisal of the literature on the effects of computer-based clinical decision support systems on clinician performance and patient outcomes. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[19]  David Moher,et al.  Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews , 2007, BMC medical research methodology.

[20]  Alastair Baker,et al.  Crossing the Quality Chasm: A New Health System for the 21st Century , 2001, BMJ : British Medical Journal.

[21]  Dominik Aronsky,et al.  Review Paper: Biomedical Informatics Applications for Asthma Care: A Systematic Review , 2006, J. Am. Medical Informatics Assoc..

[22]  R Khajouei,et al.  The Impact of CPOE Medication Systems’ Design Aspects on Usability, Workflow and Medication Orders , 2010, Methods of Information in Medicine.

[23]  Wei Wu,et al.  The Effect of Computerized Physician Order Entry with Clinical Decision Support on the Rates of Adverse Drug Events: A Systematic Review , 2008, Journal of General Internal Medicine.

[24]  P. Shekelle,et al.  Systematic Review: Impact of Health Information Technology on Quality, Efficiency, and Costs of Medical Care , 2006, Annals of Internal Medicine.

[25]  Ferdinand T. Velasco,et al.  Improving Outcomes with Clinical Decision Support: An Implementer's Guide , 2012 .

[26]  Margaret Williamson,et al.  The impact of computerised physician order entry systems on pathology services: A systematic review , 2007, Int. J. Medical Informatics.

[27]  R. Kane,et al.  Just what the doctor ordered. Review of the evidence of the impact of computerized physician order entry system on medication errors. , 2007, Health services research.

[28]  ELSKE AMMENWERTH,et al.  Review Paper: The Effect of Electronic Prescribing on Medication Errors and Adverse Drug Events: A Systematic Review , 2008, J. Am. Medical Informatics Assoc..

[29]  C. Jackson,et al.  A systematic review of interactive computer-assisted technology in diabetes care: interactive information technology in diabetes care , 2006 .

[30]  Patrice Degoulet,et al.  An overview of the effect of computer-assisted management of anticoagulant therapy on the quality of anticoagulation , 1998, Int. J. Medical Informatics.

[31]  P. Embí,et al.  Clinical decision support systems in the pediatric intensive care unit* , 2009, Pediatric critical care medicine : a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies.

[32]  Bryony Dean Franklin,et al.  Clinical decision support systems and antibiotic use , 2007, Pharmacy World & Science.

[33]  L. Trinquart,et al.  Computerized advice on drug dosage to improve prescribing practice. , 2013, The Cochrane database of systematic reviews.

[34]  R Smith,et al.  Information in practice , 1996, BMJ.

[35]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[36]  K. Tan,et al.  Clinical decision support systems for neonatal care. , 2005, The Cochrane database of systematic reviews.

[37]  H. Guchelaar,et al.  Preventing adverse drug events in hospital practice: an overview , 2007, Pharmacoepidemiology and drug safety.

[38]  Nick Freemantle,et al.  Computer support for determining drug dose: systematic review and meta-analysis , 1999, BMJ.

[39]  David W. Bates,et al.  Review Paper: What Evidence Supports the Use of Computerized Alerts and Prompts to Improve Clinicians' Prescribing Behavior? , 2009, J. Am. Medical Informatics Assoc..

[40]  Rebecca Randell,et al.  Effects of computerized decision support systems on nursing performance and patient outcomes: a systematic review , 2007, Journal of health services research & policy.

[41]  V. Sintchenko,et al.  Are we measuring the right end-points? Variables that affect the impact of computerised decision support on patient outcomes: A systematic review , 2007, Medical informatics and the Internet in medicine.

[42]  D G Altman,et al.  Systematic reviews of clinical decision tools for acute abdominal pain. , 2006, Health technology assessment.

[43]  M Greaves,et al.  Screening for thrombophilia in high-risk situations: systematic review and cost-effectiveness analysis. The Thrombosis: Risk and Economic Assessment of Thrombophilia Screening (TREATS) study. , 2006, Health technology assessment.

[44]  T. Fahey,et al.  A systematic review of the use of computers in the management of hypertension. , 1998, Journal of epidemiology and community health.

[45]  G. d’Annunzio,et al.  Meta-analysis of the effect of the use of computer-based systems on the metabolic control of patients with diabetes mellitus. , 2001, Diabetes technology & therapeutics.

[46]  Peter Szolovits,et al.  The coming of age of artificial intelligence in medicine , 2009, Artif. Intell. Medicine.

[47]  R. Haynes,et al.  Optimal search strategies for retrieving systematic reviews from Medline: analytical survey , 2004, BMJ : British Medical Journal.

[48]  D. Sackett,et al.  Evidence based medicine: what it is and what it isn't , 1996, BMJ.

[49]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.