Effectiveness of electronic point-of-care reminders versus monthly feedback to improve adherence to 10 clinical recommendations in primary care: a cluster randomized clinical trial

BackgroundNumerous studies have analyzed the effectiveness of electronic reminder interventions to improve different clinical conditions, and most have reported a small to moderate effect. Few studies, however, have analyzed reminder systems targeting multiple conditions, and fewer still have compared electronic point-of-care reminders systems with other forms of feedback designed to improve delivery of care.MethodsWe performed an unblinded cluster randomized clinical trial to compare the effectiveness of an electronic point-of-care reminder system with that of a well-established system providing monthly feedback on adherence to clinical recommendations. The control group received monthly feedback only while the intervention group received monthly feedback in addition to on-screen point-of-care reminders for 10 clinical conditions. The study targeted all physicians and nurses at the 283 primary care centers managed by the Institut Català de la Salut (approximately 6600 professionals).ResultsFollowing exclusions and randomization, 132 primary care centers (328,728 patients with reminders) were assigned to the intervention group while 137 centers (317,117 patients with reminders) were randomized to the control group. A 20.6% improvement (OR 1.29, 95% CI: 1.25–1.34) in reminder resolution rates was observed in the intervention group. Results varied according to the clinical condition. The most effective reminder was screening for diabetic retinopathy (OR 1.51, 95% CI:1.46–1.57) while the least effective reminders were measurement of glycated hemoglobin (OR: 1.10, 95% CI: 1.07–1.13) and smoking cessation encouragement (OR 1.12, 95% CI: 1.09–1.16).ConclusionsElectronic point-of-care reminders were more effective than the existing monthly feedback system at resolving the 10 clinical situations. However, more studies are needed to investigate the variations of the effect observed.Trial registrationCurrent Controlled Trials ISRCTN42391639, 08/10/2012. Retrospectively registered.

[1]  Jane M. Young,et al.  Audit and feedback: effects on professional practice and healthcare outcomes. , 2012, The Cochrane database of systematic reviews.

[2]  Roger B. Davis,et al.  Electronic medical record reminders and panel management to improve primary care of elderly patients. , 2011, Archives of internal medicine.

[3]  P. Torán,et al.  Alerts in electronic medical records to promote a colorectal cancer screening programme: a cluster randomised controlled trial in primary care. , 2016, The British journal of general practice : the journal of the Royal College of General Practitioners.

[4]  C. Mc Donald,et al.  Use of a computer to detect and respond to clinical events: its effect on clinician behavior. , 1976, Annals of internal medicine.

[5]  Emily S. Patterson,et al.  Exploring barriers and facilitators to the use of computerized clinical reminders. , 2005, Journal of the American Medical Informatics Association : JAMIA.

[6]  D J Balaban,et al.  The Effect Of Microcomputer-Generated Reminders On Influenza Vaccination Rates In A University-Based Family Practice Center , 1991, The Journal of the American Board of Family Medicine.

[7]  C J McDonald,et al.  Computer reminders to implement preventive care guidelines for hospitalized patients. , 1996, Archives of internal medicine.

[8]  Oliver Frank,et al.  Opportunistic electronic reminders. Improving performance of preventive care in general practice. , 2004, Australian family physician.

[9]  Philip Ryan.  RALLOC: Stata module to design randomized controlled trials , 1997 .

[10]  David Parkin,et al.  Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial , 2002, BMJ : British Medical Journal.

[11]  W G Henderson,et al.  Improving residents' compliance with standards of ambulatory care: results from the VA Cooperative Study on Computerized Reminders. , 2000, JAMA.

[12]  Alessandro Filippi,et al.  Effects of an automated electronic reminder in changing the antiplatelet drug-prescribing behavior among Italian general practitioners in diabetic patients: an intervention trial. , 2003, Diabetes care.

[13]  Sylvia J. Hysong,et al.  Meta-Analysis: Audit and Feedback Features Impact Effectiveness on Care Quality , 2009, Medical care.

[14]  J. Hanley,et al.  The medical office of the 21st century (MOXXI): effectiveness of computerized decision-making support in reducing inappropriate prescribing in primary care. , 2003, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[15]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.

[16]  David W. Bates,et al.  Impact of Computerized Decision Support on Blood Pressure Management and Control: A Randomized Controlled Trial , 2008, Journal of General Internal Medicine.

[17]  Laura Petersen,et al.  Does Pay-for-Performance Improve the Quality of Health Care? , 2006, Annals of Internal Medicine.

[18]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[19]  C. McDonald,et al.  Effects of computerized guidelines for managing heart disease in primary care , 2003, Journal of General Internal Medicine.

[20]  F. Griffiths,et al.  Changing Clinical Practice Through Patient Specific Reminders Available at the Time of the Clinical Encounter: Systematic Review and Meta-Analysis , 2012, Journal of General Internal Medicine.

[21]  A. Scott,et al.  The effect of financial incentives on the quality of health care provided by primary care physicians. , 2011, The Cochrane database of systematic reviews.

[22]  K. Shojania,et al.  The effects of on-screen, point of care computer reminders on processes and outcomes of care. , 2009, The Cochrane database of systematic reviews.

[23]  M. Iglesias,et al.  Effectiveness of computerized point-of-care reminders on adherence with multiple clinical recommendations by primary health care providers: protocol for a cluster-randomized controlled trial , 2016, SpringerPlus.

[24]  Tejal K. Gandhi,et al.  Actionable reminders did not improve performance over passive reminders for overdue tests in the primary care setting , 2011, J. Am. Medical Informatics Assoc..

[25]  M. Ferran,et al.  Creation of a synthetic indicator of quality of care as a clinical management standard in primary care , 2013, SpringerPlus.

[26]  W. Levinson,et al.  Pay for performance: learning about quality , 2007, Canadian Medical Association Journal.

[27]  Michael A. Krall,et al.  Effectiveness of an Electronic Medical Record Clinical Quality Alert Prepared by Off-line Data Analysis , 2004, MedInfo.

[28]  C. McDonald,et al.  A computerized reminder system to increase the use of preventive care for hospitalized patients. , 2001, The New England journal of medicine.

[29]  Miriam C.J.M. Sturkenboom,et al.  Electronic Alerts Versus On-Demand Decision Support to Improve Dyslipidemia Treatment: A Cluster Randomized Controlled Trial , 2008, Circulation.

[30]  J. Grimshaw,et al.  Overview of systematic reviews of the effectiveness of reminders in improving healthcare professional behavior , 2012, Systematic Reviews.