Changes in Performance After Implementation of a Multifaceted Electronic-Health-Record-Based Quality Improvement System

Background:Electronic health record (EHR) systems have the potential to revolutionize quality improvement (QI) methods by enhancing quality measurement and integrating multiple proven QI strategies. Objectives:To implement and evaluate a multifaceted QI intervention using EHR tools to improve quality measurement (including capture of contraindications and patient refusals), make point-of-care reminders more accurate, and provide more valid and responsive clinician feedback (including lists of patients not receiving essential medications) for 16 chronic disease and preventive service measures. Design:Time series analysis at a large internal medicine practice using a commercial EHR. Subjects:All adult patients eligible for each measure (range approximately 100–7500). Measures:The proportion of eligible patients who satisfied each measure after removing those with exceptions from the denominator. Results:During the year before the intervention, performance improved significantly for 8 measures. During the year after the intervention, performance improved significantly for 14 measures. For 9 measures, the primary outcome improved more rapidly during the intervention year than during the previous year (P < 0.001 for 8 measures, P = 0.02 for 1). Four other measures improved at rates that were not significantly different from the previous year. Improvements resulted from increases in patients receiving the service, documentation of exceptions, or a combination of both. For 5 drug-prescribing measures, more than half of physicians achieved 100% performance. Conclusions:Implementation of a multifaceted QI intervention using EHR tools to improve quality measurement and the accuracy and timeliness of clinician feedback improved performance and/or accelerated the rate of improvement for multiple measures simultaneously.

[1]  Tim Doran,et al.  Exclusion of patients from pay-for-performance targets by English physicians. , 2008, The New England journal of medicine.

[2]  Paul C Tang,et al.  Research Paper: Comparison of Methodologies for Calculating Quality Measures Based on Administrative Data versus Clinical Data from an Electronic Health Record System: Implications for Performance Measures , 2007, J. Am. Medical Informatics Assoc..

[3]  Anil K. Bera,et al.  Efficient tests for normality, homoscedasticity and serial independence of regression residuals , 1980 .

[4]  Stephen D. Persell,et al.  Frequency of Inappropriate Medical Exceptions to Quality Measures , 2010, Annals of Internal Medicine.

[5]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[6]  R. Gnanadesikan,et al.  Probability plotting methods for the analysis of data. , 1968, Biometrika.

[7]  Roger B. Davis,et al.  Physicians' decisions to override computerized drug alerts in primary care. , 2003, Archives of internal medicine.

[8]  Stephen D. Persell,et al.  Automated Review of Electronic Health Records to Assess Quality of Care for Outpatients with Heart Failure , 2007, Annals of Internal Medicine.

[9]  S. Shapiro,et al.  An Analysis of Variance Test for Normality (Complete Samples) , 1965 .

[10]  C. McDonald,et al.  Regenstrief Medical Informatics: Experiences with Clinical Decision Support Systems , 2007 .

[11]  David Parkin,et al.  Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial , 2002, BMJ : British Medical Journal.

[12]  William M. Tierney,et al.  Requiring physicians to respond to computerized reminders improves their compliance with preventive care protocols , 1993, Journal of General Internal Medicine.

[13]  Emily S. Patterson,et al.  Exploring barriers and facilitators to the use of computerized clinical reminders. , 2005, Journal of the American Medical Informatics Association : JAMIA.

[14]  C. McDonald,et al.  Reminders to physicians from an introspective computer medical record. A two-year randomized trial. , 1984, Annals of internal medicine.

[15]  C. McDonald,et al.  Effects of computerized guidelines for managing heart disease in primary care , 2003, Journal of General Internal Medicine.

[16]  Stephen D. Persell,et al.  Assessing the validity of national quality measures for coronary artery disease using an electronic health record. , 2006, Archives of internal medicine.

[17]  J. Grimshaw,et al.  From best evidence to best practice: effective implementation of change in patients' care , 2003, The Lancet.

[18]  Emily S. Patterson,et al.  Research Paper: Human Factors Barriers to the Effective Use of Ten HIV Clinical Reminders , 2004, J. Am. Medical Informatics Assoc..

[19]  H. Akaike.  A new look at the statistical model identification , 1974 .

[20]  Emily S. Patterson,et al.  Identifying barriers to the effective use of clinical reminders: Bootstrapping multiple methods , 2005, J. Biomed. Informatics.

[21]  L. Hayden,et al.  Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality , 2011 .

[22]  Emily Patterson,et al.  An Evaluation of the Veterans Health Administration’s Clinical Reminders System: A National Survey of Generalists , 2007, Journal of General Internal Medicine.

[23]  W G Henderson,et al.  Improving residents' compliance with standards of ambulatory care: results from the VA Cooperative Study on Computerized Reminders. , 2000, JAMA.

[24]  A D Oxman,et al.  Changing physician performance. A systematic review of the effect of continuing medical education strategies. , 1995, JAMA.

[25]  Diane L. Seger,et al.  Research Paper: Impact of Non-interruptive Medication Laboratory Monitoring Alerts in Ambulatory Care , 2009, J. Am. Medical Informatics Assoc..

[26]  David W. Bates,et al.  Synthesis of Research Paper: Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality , 2003, J. Am. Medical Informatics Assoc..

[27]  Thomas Bodenheimer,et al.  Improving primary care for patients with chronic illness: the chronic care model, Part 2. , 2002, JAMA.

[28]  Rodney A Hayward,et al.  Comparing clinical automated, medical record, and hybrid data sources for diabetes quality measures. , 2002, The Joint Commission journal on quality improvement.

[29]  William M. Tierney,et al.  Physicians’ reasons for failing to comply with computerized preventive care guidelines , 1996, Journal of General Internal Medicine.

[30]  P. Shekelle,et al.  Systematic Review: Impact of Health Information Technology on Quality, Efficiency, and Costs of Medical Care , 2006, Annals of Internal Medicine.

[31]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.

[32]  C. McDonald,et al.  Failure of Computerized Treatment Suggestions to Improve Health Outcomes of Outpatients with Uncomplicated Hypertension: Results of a Randomized Controlled Trial , 2004, Pharmacotherapy.

[33]  D. Berlowitz,et al.  Can we use automated data to assess quality of hypertension care? , 2004, The American journal of managed care.

[34]  Miriam C.J.M. Sturkenboom,et al.  Electronic Alerts Versus On-Demand Decision Support to Improve Dyslipidemia Treatment: A Cluster Randomized Controlled Trial , 2008, Circulation.