Do computerised clinical decision support systems for prescribing change practice? A systematic review of the literature (1990-2007)

BackgroundComputerised clinical decision support systems (CDSSs) are used widely to improve quality of care and patient outcomes. This systematic review evaluated the impact of CDSSs in targeting specific aspects of prescribing, namely initiating, monitoring and stopping therapy. We also examined the influence of clinical setting (institutional vs ambulatory care), system- or user-initiation of CDSS, multi-faceted vs stand alone CDSS interventions and clinical target on practice changes in line with the intent of the CDSS.MethodsWe searched Medline, Embase and PsychINFO for publications from 1990-2007 detailing CDSS prescribing interventions. Pairs of independent reviewers extracted the key features and prescribing outcomes of methodologically adequate studies (experiments and strong quasi-experiments).Results56 studies met our inclusion criteria, 38 addressing initiating, 23 monitoring and three stopping therapy. At the time of initiating therapy, CDSSs appear to be somewhat more effective after, rather than before, drug selection has occurred (7/12 versus 12/26 studies reporting statistically significant improvements in favour of CDSSs on = 50% of prescribing outcomes reported). CDSSs also appeared to be effective for monitoring therapy, particularly using laboratory test reminders (4/7 studies reporting significant improvements in favour of CDSSs on the majority of prescribing outcomes). None of the studies addressing stopping therapy demonstrated impacts in favour of CDSSs over comparators. The most consistently effective approaches used system-initiated advice to fine-tune existing therapy by making recommendations to improve patient safety, adjust the dose, duration or form of prescribed drugs or increase the laboratory testing rates for patients on long-term therapy. CDSSs appeared to perform better in institutional compared to ambulatory settings and when decision support was initiated automatically by the system as opposed to user initiation. CDSSs implemented with other strategies such as education were no more successful in improving prescribing than stand alone interventions. Cardiovascular disease was the most studied clinical target but few studies demonstrated significant improvements on the majority of prescribing outcomes.ConclusionOur understanding of CDSS impacts on specific aspects of the prescribing process remains relatively limited. Future implementation should build on effective approaches including the use of system-initiated advice to address safety issues and improve the monitoring of therapy.

[1]  J. Hanley,et al.  The medical office of the 21st century (MOXXI): effectiveness of computerized decision-making support in reducing inappropriate prescribing in primary care. , 2003, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[2]  J. Vilaseca,et al.  Cost Effectiveness of a Clinical Decision Support System Based on the Recommendations of the European Society of Cardiology and Other Societies for the Management of Hypercholesterolemia , 2005 .

[3]  Steen Andreassen,et al.  Improving empirical antibiotic treatment using TREAT, a computerized decision support system: cluster randomized trial. , 2006, The Journal of antimicrobial chemotherapy.

[4]  L. Trinquart,et al.  Computerized advice on drug dosage to improve prescribing practice. , 2008, The Cochrane database of systematic reviews.

[5]  N. Freemantle,et al.  Computerised advice on drug dosage to improve prescribing practice. , 2001, The Cochrane database of systematic reviews.

[6]  Mikel Aickin,et al.  Electronic Medical Record Reminder Improves Osteoporosis Management After a Fracture: A Randomized, Controlled Trial , 2006, Journal of the American Geriatrics Society.

[7]  S. Soumerai,et al.  Changing medication use in managed care: a critical review of the available evidence. , 2003, The American journal of managed care.

[8]  C J McDonald,et al.  Computer reminders to implement preventive care guidelines for hospitalized patients. , 1996, Archives of internal medicine.

[9]  C. McDonald,et al.  Failure of Computerized Treatment Suggestions to Improve Health Outcomes of Outpatients with Uncomplicated Hypertension: Results of a Randomized Controlled Trial , 2004, Pharmacotherapy.

[10]  Gina Pugliese,et al.  Reducing Vancomycin Use Utilizing a Computer Guideline , 1999, Infection Control & Hospital Epidemiology.

[11]  R G Neville,et al.  Lessons from a randomized controlled trial designed to evaluate computer decision support software to improve the management of asthma , 2001, Medical informatics and the Internet in medicine.

[12]  C. McDonald,et al.  A computerized reminder system to increase the use of preventive care for hospitalized patients. , 2001, The New England journal of medicine.

[13]  J Marc Overhage,et al.  Can computer-generated evidence-based care suggestions enhance evidence-based management of asthma and chronic obstructive pulmonary disease? A randomized, controlled trial. , 2005, Health services research.

[14]  G. Barnett,et al.  Randomized controlled trial of an informatics-based intervention to increase statin prescription for secondary prevention of coronary disease , 2007, Journal of General Internal Medicine.

[15]  T. Koepsell,et al.  Association of lower continuity of care with greater risk of emergency department use and hospitalization in children. , 2001, Pediatrics.

[16]  S. Soumerai,et al.  A retrospective data analysis of the impact of the New York triplicate prescription program on benzodiazepine use in medicaid patients with chronic psychiatric and neurologic disorders. , 2004, Clinical therapeutics.

[17]  Andrew D Oxman,et al.  Rational Prescribing in Primary Care (RaPP): A Cluster Randomized Trial of a Tailored Intervention , 2006, PLoS medicine.

[18]  M. Raebel,et al.  Evaluation of laboratory monitoring alerts within a computerized physician order entry system for medication orders. , 2006, The American journal of managed care.

[19]  J van der Lei,et al.  Computed Critiquing Integrated into Daily Clinical Practice Affects Physicians’ Behavior , 2006, Methods of Information in Medicine.

[20]  Dean F Sittig,et al.  Reducing warfarin medication interactions: an interrupted time series evaluation. , 2006, Archives of internal medicine.

[21]  C. McDonald,et al.  Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. , 1993, JAMA.

[22]  J M Grimshaw,et al.  Effectiveness and efficiency of guideline dissemination and implementation strategies , 2004, International Journal of Technology Assessment in Health Care.

[23]  L. Poller,et al.  Prospective comparative study of computer programs used for management of warfarin. , 1993, Journal of clinical pathology.

[24]  J. Parinaud,et al.  A computerized decision support system for ovarian stimulation by gonadotropins. , 2002, Fertility and sterility.

[25]  Paul A. Heidenreich,et al.  Improving Guideline Adherence: A Randomized Trial Evaluating Strategies to Increase &bgr;-Blocker Use in Heart Failure , 2003, Circulation.

[26]  Stephan D. Fihn,et al.  A computerized intervention to improve timing of outpatient follow-up , 1994, Journal of General Internal Medicine.

[27]  C Safran,et al.  Guidelines for management of HIV infection with computer-based patient's record , 1995, The Lancet.

[28]  M. Leaning,et al.  Evaluation of a decision support system for initiation and control of oral anticoagulation in a randomised trial , 1997, BMJ.

[29]  M. Moia,et al.  Effect of computer-aided management on the quality of treatment in anticoagulated patients: a prospective, randomized, multicenter trial of APROAT (Automated PRogram for Oral Anticoagulant Treatment). , 2001, Haematologica.

[30]  Alessandro Filippi,et al.  Effects of an automated electronic reminder in changing the antiplatelet drug-prescribing behavior among Italian general practitioners in diabetic patients: an intervention trial. , 2003, Diabetes care.

[31]  Robert L Davis,et al.  A Cluster Randomized Clinical Trial to Improve Prescribing Patterns in Ambulatory Pediatrics , 2007, PLoS clinical trials.

[32]  Sallie-Anne Pearson,et al.  Interventions designed to improve the quality and efficiency of medication use in managed care: A critical review of the literature – 2001–2007 , 2008, BMC health services research.

[33]  W. Ageno,et al.  A Computer Generated Induction System for Hospitalized Patients Starting on Oral Anticoagulant Therapy , 2000, Thrombosis and Haemostasis.

[34]  V. Sintchenko,et al.  Are we measuring the right end-points? Variables that affect the impact of computerised decision support on patient outcomes: A systematic review , 2007, Medical informatics and the Internet in medicine.

[35]  Paul C. Tang,et al.  Research Paper: Measuring the Effects of Reminders for Outpatient Influenza Immunizations at the Point of Clinical Opportunity , 1999, J. Am. Medical Informatics Assoc..

[36]  David Parkin,et al.  Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial , 2002, BMJ : British Medical Journal.

[37]  J. Marc Overhage,et al.  Research Paper: A Randomized Trial of "Corollary Orders" to Prevent Errors of Omission , 1997, J. Am. Medical Informatics Assoc..

[38]  W. Ageno,et al.  A randomized comparison of a computer-based dosing program with a manual system to monitor oral anticoagulant therapy. , 1998, Thrombosis research.

[39]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.

[40]  C. McDonald,et al.  Effects of computerized guidelines for managing heart disease in primary care , 2003, Journal of General Internal Medicine.

[41]  S. Soumerai,et al.  Racial disparities in access after regulatory surveillance of benzodiazepines. , 2006, Archives of internal medicine.

[42]  Steven R Simon,et al.  Improved therapeutic monitoring with several interventions: a randomized trial. , 2006, Archives of internal medicine.

[43]  D. Bates,et al.  Improving response to critical laboratory results with automation: results of a randomized controlled trial. , 1999, Journal of the American Medical Informatics Association : JAMIA.

[44]  Kazuhiko Ohe,et al.  Computerized reminders to monitor liver function to improve the use of etretinate , 2000, Int. J. Medical Informatics.

[45]  Jeremy M. Grimshaw,et al.  Changing Provider Behavior: An Overview of Systematic Reviews of Interventions , 2001, Medical care.

[46]  P. Casner,et al.  A randomized controlled trial of computerized pharmacokinetic theophylline dosing versus empiric physician dosing , 1993, Clinical pharmacology and therapeutics.

[47]  Andrew D Oxman,et al.  Cluster randomised controlled trial of tailored interventions to improve the management of urinary tract infections in women and sore throat , 2002, BMJ : British Medical Journal.

[48]  S. T. Rosenbloom,et al.  Oral quinolones in hospitalized patients: an evaluation of a computerized decision support intervention * , 2004, Journal of internal medicine.

[49]  D. Stevens,et al.  Evaluation of an Intervention Designed to Decrease the Rate of Nosocomial Methicillin-Resistant Staphylococcus aureus Infection by Encouraging Decreased Fluoroquinolone Use , 2006, Infection Control & Hospital Epidemiology.

[50]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[51]  Michael A. Krall,et al.  Effectiveness of an Electronic Medical Record Clinical Quality Alert Prepared by Off-line Data Analysis , 2004, MedInfo.

[52]  H. Halkin,et al.  Computer assisted design of a theophylline dosing regimen in acute bronchospasm: Serum concentrations and clinical outcome , 2005, European Journal of Clinical Pharmacology.

[53]  D. Bates,et al.  Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. , 2003, Archives of internal medicine.

[54]  Bradley N. Doebbeling,et al.  Randomized study of online vaccine reminders in adult primary care , 1999, AMIA.

[55]  Dean F. Sittig,et al.  The impact of prescribing safety alerts for elderly persons in an electronic medical record: an interrupted time series evaluation. , 2006, Archives of internal medicine.

[56]  J. Jespersen,et al.  Multicentre randomised study of computerised anticoagulant dosage , 1998, The Lancet.

[57]  Randolph A. Miller,et al.  Physicians' Response to Guided Geriatric Dosing: Initial Results from a Randomized Trial , 2007, MedInfo.

[58]  M. Marciello,et al.  Efficacy of Computer-Aided Dosing of Warfarin Among Patients in a Rehabilitation Hospital , 2005, American journal of physical medicine & rehabilitation.

[59]  J. Stockman,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[60]  Tom Fahey,et al.  Evaluation of computer based clinical decision support system and risk chart for management of hypertension in primary care: randomised controlled trial , 2000, BMJ : British Medical Journal.

[61]  H. Bloomfield,et al.  A trial of education, prompts, and opinion leaders to improve prescription of lipid modifying therapy by primary care physicians for patients with ischemic heart disease , 2005, Quality and Safety in Health Care.

[62]  Harlan M Krumholz,et al.  A randomized outpatient trial of a decision-support information technology tool. , 2005, Archives of internal medicine.

[63]  M E Burton,et al.  A controlled trial of the cost benefit of computerized bayesian aminoglycoside administration , 1991, Clinical pharmacology and therapeutics.

[64]  F P Rivara,et al.  A randomized controlled trial of point-of-care evidence to improve the antibiotic prescribing practices for otitis media in children. , 2001, Pediatrics.

[65]  Emily S. Patterson,et al.  Identifying barriers to the effective use of clinical reminders: Bootstrapping multiple methods , 2005, J. Biomed. Informatics.

[66]  Minna Kaila,et al.  What may help or hinder the implementation of computerized decision support systems (CDSSs): a focus group study with physicians. , 2008, Family practice.

[67]  P. Glasziou,et al.  Computerised reminders and feedback in medication management: a systematic review of randomised controlled trials , 2003, The Medical journal of Australia.

[68]  W G Henderson,et al.  Improving residents' compliance with standards of ambulatory care: results from the VA Cooperative Study on Computerized Reminders. , 2000, JAMA.

[69]  Anne Holbrook,et al.  Features predicting the success of computerized decision support for prescribing: a systematic review of randomized controlled trials , 2009, BMC Medical Informatics Decis. Mak..

[70]  Fredrick D. Ashbury,et al.  The Impact of Computerized Clinical Reminders on Physician Prescribing Behavior: Evidence From Community Oncology Practice , 2003, American journal of medical quality : the official journal of the American College of Medical Quality.

[71]  W. Elliott,et al.  Improving Blood Pressure Control through Provider Education, Provider Alerts, and Patient Education: A Cluster Randomized TrialRoumie CL, Elasy TA, Greevy R, et al (Vanderbilt Univ, Nashville, Tenn; VA Med Ctr, Nashville, Tenn): Ann Intern Med 145:165–175, 2006§ , 2007 .

[72]  Paul A. de Clercq,et al.  The effect of computer reminders on GPs' prescribing behaviour: A cluster-randomised trial , 2007, Int. J. Medical Informatics.

[73]  Marilyn D Paterno,et al.  Electronic alerts to prevent venous thromboembolism among hospitalized patients. , 2005, The New England journal of medicine.