Features predicting the success of computerized decision support for prescribing: a systematic review of randomized controlled trials

BackgroundComputerized decision support systems (CDSS) are believed to have the potential to improve the quality of health care delivery, although results from high quality studies have been mixed. We conducted a systematic review to evaluate whether certain features of prescribing decision support systems (RxCDSS) predict successful implementation, change in provider behaviour, and change in patient outcomes.MethodsA literature search of Medline, EMBASE, CINAHL and INSPEC databases (earliest entry to June 2008) was conducted to identify randomized controlled trials involving RxCDSS. Each citation was independently assessed by two reviewers for outcomes and 28 predefined system features. Statistical analysis of associations between system features and success of outcomes was planned.ResultsOf 4534 citations returned by the search, 41 met the inclusion criteria. Of these, 37 reported successful system implementations, 25 reported success at changing health care provider behaviour, and 5 noted improvements in patient outcomes. A mean of 17 features per study were mentioned. The statistical analysis could not be completed due primarily to the small number of studies and lack of diversity of outcomes. Descriptive analysis did not confirm any feature to be more prevalent in successful trials relative to unsuccessful ones for implementation, provider behaviour or patient outcomes.ConclusionWhile RxCDSSs have the potential to change health care provider behaviour, very few high quality studies show improvement in patient outcomes. Furthermore, the features of the RxCDSS associated with success (or failure) are poorly described, thus making it difficult for system design and implementation to improve.

[1]  J. Vilaseca,et al.  Cost Effectiveness of a Clinical Decision Support System Based on the Recommendations of the European Society of Cardiology and Other Societies for the Management of Hypercholesterolemia , 2005 .

[2]  R. Wears,et al.  Computer technology and clinical work: still waiting for Godot. , 2005, JAMA.

[3]  Alessandro Filippi,et al.  Effects of an automated electronic reminder in changing the antiplatelet drug-prescribing behavior among Italian general practitioners in diabetic patients: an intervention trial. , 2003, Diabetes care.

[4]  K. Lees,et al.  The prognostic value of the components of the Glasgow Coma Scale following acute stroke. , 2003, QJM : monthly journal of the Association of Physicians.

[5]  Anne Holbrook,et al.  What Factors Determine The Success of Clinical Decision Support Systems? , 2003, AMIA.

[6]  D. Bates,et al.  Improving safety with information technology. , 2003, The New England journal of medicine.

[7]  Anne Holbrook,et al.  E-Health Interventions as Complex Interventions: Improving the Quality of Methods of Assessment , 2006, AMIA.

[8]  C J McDonald,et al.  Physician response to computer reminders. , 1980, JAMA.

[9]  Jonathan M. Teich,et al.  AMIA Position Paper: Clinical Decision Support in Electronic Prescribing: Recommendations and an Action Plan: Report of the Joint Clinical Decision Support Workgroup , 2005, J. Am. Medical Informatics Assoc..

[10]  W M Tierney,et al.  Work patterns of ambulatory care pharmacists with access to electronic guideline-based treatment suggestions. , 1999, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[11]  J. Holmen,et al.  IMPLEMENTING CLINICAL GUIDELINES IN THE TREATMENT OF DIABETES MELLITUS IN GENERAL PRACTICE , 2000, International Journal of Technology Assessment in Health Care.

[12]  Patrice Degoulet,et al.  Determinants of Success for Computerized Clinical Decision Support Systems Integrated into CPOE Systems: a Systematic Review , 2006, AMIA.

[13]  J van der Lei,et al.  Computed Critiquing Integrated into Daily Clinical Practice Affects Physicians’ Behavior , 2006, Methods of Information in Medicine.

[14]  Marsha A. Raebel,et al.  Research Paper: Randomized Trial to Improve Prescribing Safety During Pregnancy , 2007, J. Am. Medical Informatics Assoc..

[15]  R G Neville,et al.  Lessons from a randomized controlled trial designed to evaluate computer decision support software to improve the management of asthma , 2001, Medical informatics and the Internet in medicine.

[16]  et al.,et al.  The Regenstrief Medical Record System: a quarter century experience , 1999, Int. J. Medical Informatics.

[17]  Paul A. Heidenreich,et al.  Improving Guideline Adherence: A Randomized Trial Evaluating Strategies to Increase &bgr;-Blocker Use in Heart Failure , 2003, Circulation.

[18]  C. Mc Donald,et al.  Use of a computer to detect and respond to clinical events: its effect on clinician behavior. , 1976, Annals of internal medicine.

[19]  W. Elliott,et al.  Improving Blood Pressure Control through Provider Education, Provider Alerts, and Patient Education: A Cluster Randomized TrialRoumie CL, Elasy TA, Greevy R, et al (Vanderbilt Univ, Nashville, Tenn; VA Med Ctr, Nashville, Tenn): Ann Intern Med 145:165–175, 2006§ , 2007 .

[20]  C. McDonald,et al.  Failure of Computerized Treatment Suggestions to Improve Health Outcomes of Outpatients with Uncomplicated Hypertension: Results of a Randomized Controlled Trial , 2004, Pharmacotherapy.

[21]  Steven H. Brown,et al.  VistA - U.S. Department of Veterans Affairs national-scale HIS , 2003, Int. J. Medical Informatics.

[22]  Henry J. Lowe,et al.  A randomized trial using computerized decision support to improve treatment of major depression in primary care , 2002, Journal of General Internal Medicine.

[23]  Paul A. de Clercq,et al.  The effect of computer reminders on GPs' prescribing behaviour: A cluster-randomised trial , 2007, Int. J. Medical Informatics.

[24]  R. Macwalter,et al.  Cluster-randomized, controlled trial of computer-based decision support for selecting long-term anti-thrombotic therapy after acute ischaemic stroke. , 2003, QJM : monthly journal of the Association of Physicians.

[25]  F P Rivara,et al.  A randomized controlled trial of point-of-care evidence to improve the antibiotic prescribing practices for otitis media in children. , 2001, Pediatrics.

[26]  J. Hanley,et al.  The medical office of the 21st century (MOXXI): effectiveness of computerized decision-making support in reducing inappropriate prescribing in primary care. , 2003, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[27]  David W. Bates,et al.  Impact of Computerized Decision Support on Blood Pressure Management and Control: A Randomized Controlled Trial , 2008, Journal of General Internal Medicine.

[28]  G. Barnett,et al.  Randomized controlled trial of an informatics-based intervention to increase statin prescription for secondary prevention of coronary disease , 2007, Journal of General Internal Medicine.

[29]  N. Laue,et al.  The epidemiology of preventable adverse drug events: A review of the literature , 2003, Wiener Klinische Wochenschrift.

[30]  D. Cohen,et al.  Influence of Simple Computerized Feedback on Prescription Charges in an Ambulatory Clinic: A Randomized Clinical Trial , 1986, Medical care.

[31]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005 .

[32]  E. Shortliffe.  Clinical decision-support systems , 1990 .

[33]  Charles Young,et al.  A randomized controlled trial of a computer-based physician workstation in an outpatient setting: implementation barriers to outcome evaluation. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[34]  F D Hobbs,et al.  Can computerised decision support systems deliver improved quality in primary care? , 1999, BMJ.

[35]  F D Hobbs,et al.  A prospective controlled trial of computerized decision support for lipid management in primary care. , 1996, Family practice.

[36]  C. McDonald,et al.  Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. , 1993, JAMA.

[37]  N Freemantle,et al.  Developing and implementing clinical practice guidelines. , 1995, Quality in health care : QHC.

[38]  MPH Ralph A. Rossi MD,et al.  A computerized intervention to decrease the use of calcium channel blockers in hypertension , 2007, Journal of General Internal Medicine.

[39]  Lonny Reisman,et al.  Using a claims data-based sentinel system to improve compliance with clinical guidelines: results of a randomized prospective study. , 2005, The American journal of managed care.

[40]  Maarten J. Postma,et al.  Cost-Benefit Analysis of the Detection of Prescribing Errors by Hospital Pharmacy Staff , 2002, Drug safety.

[41]  J. Marc Overhage,et al.  Research Paper: A Randomized Trial of "Corollary Orders" to Prevent Errors of Omission , 1997, J. Am. Medical Informatics Assoc..

[42]  Matthew H Samore,et al.  Clinical decision support and appropriateness of antimicrobial prescribing: a randomized trial. , 2005, JAMA.

[43]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[44]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.

[45]  P. Sandercock,et al.  Framework for design and evaluation of complex interventions to improve health , 2000, BMJ : British Medical Journal.

[46]  Steen Andreassen,et al.  Improving empirical antibiotic treatment using TREAT, a computerized decision support system: cluster randomized trial. , 2006, The Journal of antimicrobial chemotherapy.

[47]  H. Covvey,et al.  Randomised controlled trial of computer assisted management of hypertension in primary care. , 1986, British medical journal.

[48]  David Parkin,et al.  Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial , 2002, BMJ : British Medical Journal.

[49]  Marilyn D Paterno,et al.  Electronic alerts to prevent venous thromboembolism among hospitalized patients. , 2005, The New England journal of medicine.

[50]  Mikel Aickin,et al.  Electronic Medical Record Reminder Improves Osteoporosis Management After a Fracture: A Randomized, Controlled Trial , 2006, Journal of the American Geriatrics Society.

[51]  C. McDonald,et al.  Effects of computerized guidelines for managing heart disease in primary care , 2003, Journal of General Internal Medicine.

[52]  D. Bates,et al.  Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. , 2003, Archives of internal medicine.

[53]  David W. Bates,et al.  Computerized physician order entry and medication errors: Finding a balance , 2005, J. Biomed. Informatics.

[54]  Robert L Davis,et al.  A Cluster Randomized Clinical Trial to Improve Prescribing Patterns in Ambulatory Pediatrics , 2007, PLoS clinical trials.

[55]  C. McDonald,et al.  A computerized reminder system to increase the use of preventive care for hospitalized patients. , 2001, The New England journal of medicine.

[56]  Charles P. Friedman,et al.  Evaluation Methods in Medical Informatics , 1997, Computers and Medicine.

[57]  J Marc Overhage,et al.  Can computer-generated evidence-based care suggestions enhance evidence-based management of asthma and chronic obstructive pulmonary disease? A randomized, controlled trial. , 2005, Health services research.

[58]  Eta S Berner,et al.  Improving ambulatory prescribing safety with a handheld decision support system: a randomized controlled trial. , 2006, Journal of the American Medical Informatics Association : JAMIA.

[59]  A. Localio,et al.  Role of computerized physician order entry systems in facilitating medication errors. , 2005, JAMA.

[60]  Kensaku Kawamoto,et al.  Clinical Decision Support Provided within Physician Order Entry Systems: A Systematic Review of Features Effective for Changing Clinician Behavior , 2003, AMIA.

[61]  J. Griffith,et al.  Use of the Electrocardiograph-Based Thrombolytic Predictive Instrument To Assist Thrombolytic and Reperfusion Therapy for Acute Myocardial Infarction: A Multicenter, Randomized, Controlled, Clinical Effectiveness Trial , 2002, Annals of Internal Medicine.

[62]  W. Tierney,et al.  A controlled trial of including symptom data in computer-based care suggestions for managing patients with chronic heart failure. , 2004, The American journal of medicine.