Interventions to Educate Family Physicians to Change Test Ordering

The purpose is to systematically review randomised controlled trials (RCTs) to change family physicians’ laboratory test-ordering. We searched 15 electronic databases (no language/date limitations). We identified 29 RCTs (4,111 physicians, 175,563 patients). Six studies specifically focused on reducing unnecessary tests, 23 on increasing screening tests. Using Cochrane methodology 48.5% of studies were low risk-of-bias for randomisation, 7% concealment of randomisation, 17% blinding of participants/personnel, 21% blinding outcome assessors, 27.5% attrition, 93% selective reporting. Only six studies were low risk for both randomisation and attrition. Twelve studies performed a power computation, three an intention-to-treat analysis and 13 statistically controlled clustering. Unweighted averages were computed to compare intervention/control groups for tests assessed by >5 studies. The results were that fourteen studies assessed lipids (average 10% more tests than control), 14 diabetes (average 8% > control), 5 cervical smears, 2 INR, one each thyroid, fecal occult-blood, cotinine, throat-swabs, testing after prescribing, and urine-cultures. Six studies aimed to decrease test groups (average decrease 18%), and two to increase test groups. Intervention strategies: one study used education (no change): two feedback (one 5% increase, one 27% desired decrease); eight education + feedback (average increase in desired direction >control 4.9%), ten system change (average increase 14.9%), one system change + feedback (increases 5-44%), three education + system change (average increase 6%), three education + system change + feedback (average 7.7% increase), one delayed testing. The conclusions are that only six RCTs were assessed at low risk of bias from both randomisation and attrition. Nevertheless, despite methodological shortcomings studies that found large changes (e.g. >20%) probably obtained real change.

[1]  R. Platt,et al.  Academic Detailing to Improve Laboratory Testing Among Outpatient Medication Users , 2007, Medical care.

[2]  Trudy van der Weijden,et al.  Ordering blood tests for patients with unexplained fatigue in general practice: what does it yield? Results of the VAMPIRE trial. , 2009, The British journal of general practice : the journal of the Royal College of General Practitioners.

[3]  J. Holmen,et al.  Implementing clinical guidelines in the treatment of hypertension in general practice. , 1998, Blood pressure.

[4]  J. Grimshaw,et al.  Effect of a practice-based strategy on test ordering performance of primary care physicians: a randomized trial. , 2003, JAMA.

[5]  A. Larsson,et al.  Costly regional variations in primary health care test utilization in Sweden , 2010, Scandinavian journal of clinical and laboratory investigation.

[6]  M J Galloway,et al.  Benchmarking general practice use of pathology services: a model for monitoring change , 2000, Journal of clinical pathology.

[7]  J. Grimshaw,et al.  The design and analysis of a randomized controlled trial to evaluate computerized decision support in primary care: the COGENT study. , 2000, Family practice.

[8]  J. Sterne,et al.  Temporal growth and geographic variation in the use of laboratory tests by NHS general practices: using routine data to identify research priorities. , 2013, The British journal of general practice : the journal of the Royal College of General Practitioners.

[9]  J. Knottnerus,et al.  Feasibility of a national cholesterol guideline in daily practice. A randomized controlled trial in 20 general practices. , 1999, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[10]  R. Baker,et al.  Randomised controlled trial of the effectiveness of feedback in improving test ordering in general practice , 2003, Scandinavian journal of primary health care.

[11]  Paul E. Johnson,et al.  Customized Feedback to Patients and Providers Failed to Improve Safety or Quality of Diabetes Care , 2009, Diabetes Care.

[12]  W S A Smellie,et al.  Is clinical practice variability the major reason for differences in pathology requesting patterns in general practice? , 2002, Journal of clinical pathology.

[13]  Jane M. Young,et al.  Audit and feedback: effects on professional practice and healthcare outcomes. , 2012, The Cochrane database of systematic reviews.

[14]  J. Sterne,et al.  The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials , 2011, BMJ : British Medical Journal.

[15]  J. Grimshaw,et al.  Comparing cost effects of two quality strategies to improve test ordering in primary care: a randomized trial. , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[16]  W J Hall,et al.  Computer-based vs manual health maintenance tracking. A controlled trial. , 1994, Archives of family medicine.

[17]  F D Hobbs,et al.  A prospective controlled trial of computerized decision support for lipid management in primary care. , 1996, Family practice.

[18]  G. Dinant,et al.  The effect of watchful waiting compared to immediate test ordering instructions on general practitioners' blood test ordering behaviour for patients with unexplained complaints; a randomized clinical trial (ISRCTN55755886) , 2012, Implementation Science.

[19]  J J Allison,et al.  Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial. , 2001, JAMA.

[20]  Michele Tarsilla Cochrane Handbook for Systematic Reviews of Interventions , 2010, Journal of MultiDisciplinary Evaluation.

[21]  Peter J. Hannan,et al.  Improving Diabetes Care in Practice , 2008, Diabetes Care.

[22]  R. Winkens,et al.  Variation in test ordering behaviour of GPs: professional or context-related factors? , 2004, Family practice.

[23]  James C. Thomas,et al.  The effect on cost of medical care for patients treated with an automated clinical audit system , 1983, Journal of Medical Systems.

[24]  J. Herrin,et al.  Effectiveness of Diabetes Resource Nurse Case Management and Physician Profiling in a Fee-For-Service Setting: A Cluster Randomized Trial , 2006, Proceedings.

[25]  R W Sanson-Fisher,et al.  Randomized controlled trial of a computer strategy to increase general practitioner preventive care. , 1999, Preventive medicine.

[26]  A. Sood,et al.  Non-evidence-based variables affecting physicians' test-ordering tendencies: a systematic review. , 2007, The Netherlands journal of medicine.

[27]  J. Crawford Academic Pathology , 2014, Academic pathology.

[28]  D. Mant,et al.  Cluster randomised controlled trial to compare three methods of promoting secondary prevention of coronary heart disease in primary care , 2001, BMJ : British Medical Journal.

[29]  Christopher Naugler Laboratory test use and primary care physician supply. , 2013, Canadian family physician Medecin de famille canadien.

[30]  R. C. Turner,et al.  Patient-carried card prompts vs computer-generated prompts to remind private practice physicians to perform health maintenance measures. , 1994, Archives of internal medicine.

[31]  Karim Keshavjee,et al.  Individualized electronic decision support and reminders to improve diabetes care in the community: COMPETE II randomized trial , 2009, Canadian Medical Association Journal.

[32]  J. van der Lei,et al.  Compliance of general practitioners with a guideline-based decision support system for ordering blood tests. , 2002, Clinical chemistry.

[33]  Oliver Frank,et al.  Opportunistic electronic reminders. Improving performance of preventive care in general practice. , 2004, Australian family physician.

[34]  K. Shojania,et al.  The effects of on-screen, point of care computer reminders on processes and outcomes of care. , 2009, The Cochrane database of systematic reviews.

[35]  G. Marcaida,et al.  Regional variations in test requiring patterns of general practitioners in Spain , 2011, Upsala journal of medical sciences.

[36]  Tejal K. Gandhi,et al.  Actionable reminders did not improve performance over passive reminders for overdue tests in the primary care setting , 2011, J. Am. Medical Informatics Assoc..

[37]  R Horswell,et al.  Improvements in diabetic care as measured by HbA1c after a physician education project. , 1999, Diabetes care.

[38]  Benjamin Littenberg,et al.  The Vermont Diabetes Information System: A Cluster Randomized Trial of a Population Based Decision Support System , 2009, Journal of General Internal Medicine.

[39]  P. Rust,et al.  Computer-generated physician and patient reminders. Tools to improve population adherence to selected preventive services. , 1991, The Journal of family practice.

[40]  J. Holmen,et al.  Implementing clinical guidelines in the treatment of hypertension in general practice. Evaluation of patient outcome related to implementation of a computer-based clinical decision support system. , 1999, Scandinavian journal of primary health care.

[41]  Diane L. Seger,et al.  Research Paper: Impact of Non-interruptive Medication Laboratory Monitoring Alerts in Ambulatory Care , 2009, J. Am. Medical Informatics Assoc..

[42]  Researching Together: A CTSA Partnership of Academicians and Communities for Translation , 2013, Clinical and translational science.

[43]  J E Rodnick,et al.  Promoting cancer prevention activities by primary care physicians. Results of a randomized, controlled trial. , 1991, JAMA.

[44]  E V Dunn,et al.  Evaluating the effectiveness of 2 educational interventions in family practice. , 1999, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[45]  Andrew D Oxman,et al.  Cluster randomised controlled trial of tailored interventions to improve the management of urinary tract infections in women and sore throat , 2002, BMJ : British Medical Journal.

[46]  Craig Ramsay,et al.  Effect of enhanced feedback and brief educational reminder messages on laboratory test requesting in primary care: a cluster randomised trial , 2006, The Lancet.

[47]  S. Gehlbach,et al.  Effects of an educational feedback strategy on physician utilization of thyroid function panels. , 1979, The Journal of family practice.

[48]  Julia A. Kelleher,et al.  Improving laboratory monitoring at initiation of drug therapy in ambulatory care: a randomized trial. , 2005, Archives of internal medicine.

[49]  R. Reid,et al.  A randomized trial of strategies to increase chlamydia screening in young women. , 2006, Preventive medicine.

[50]  W. Hammond,et al.  Computerized decision support based on a clinical practice guideline improves compliance with care standards. , 1997, The American journal of medicine.

[51]  D K Owens,et al.  A randomized trial of computer-based reminders and audit and feedback to improve HIV screening in a primary care setting , 2009, International journal of STD & AIDS.

[52]  P. Froom,et al.  Cessation of dipstick urinalysis reflex testing and physician ordering behavior. , 2012, American journal of clinical pathology.

[53]  Trudy van der Weijden,et al.  Improving Test Ordering in Primary Care: The Added Value of a Small-Group Quality Improvement Strategy Compared With Classic Feedback Only , 2004, The Annals of Family Medicine.

[54]  Steven R Simon,et al.  Improving laboratory monitoring of medications: an economic analysis alongside a clinical trial. , 2009, The American journal of managed care.

[55]  Arie Hasman,et al.  The efficacy of an automated feedback system for general practitioners. , 2003, Informatics in primary care.

[56]  S. Flottorp,et al.  Identifying barriers and tailoring interventions to improve the management of urinary tract infections and sore throat: a pragmatic study using qualitative methods , 2003, BMC health services research.

[57]  Steven R Simon,et al.  Improved therapeutic monitoring with several interventions: a randomized trial. , 2006, Archives of internal medicine.

[58]  W. McClellan,et al.  Improved diabetes care by primary care physicians: results of a group-randomized evaluation of the Medicare Health Care Quality Improvement Program (HCQIP). , 2003, Journal of clinical epidemiology.

[59]  J. Vermylen,et al.  The Belgian Improvement Study on Oral Anticoagulation Therapy: a randomized clinical trial. , 2005, European heart journal.

[60]  J. Knottnerus,et al.  Reactions of doctors to various forms of feedback designed to improve the sampling quality of cervical smears. , 1992, Quality assurance in health care : the official journal of the International Society for Quality Assurance in Health Care.

[61]  Jeremy M. Grimshaw,et al.  Growing Literature, Stagnant Science? Systematic Review, Meta-Regression and Cumulative Analysis of Audit and Feedback Interventions in Health Care , 2014, Journal of General Internal Medicine.

[62]  P. Pop,et al.  Randomised controlled trial of routine individual feedback to improve rationality and reduce numbers of test requests , 1995, The Lancet.

[63]  Victor M Montori,et al.  The impact of planned care and a diabetes electronic management system on community-based diabetes care: the Mayo Health System Diabetes Translation Project. , 2002, Diabetes care.

[64]  J. Sterne,et al.  A review identifies and classifies reasons for ordering diagnostic tests. , 2007, Journal of clinical epidemiology.

[65]  Carl van Walraven,et al.  Influence of educational, audit and feedback, system based, and incentive and penalty interventions to reduce laboratory test utilization: a systematic review , 2015, Clinical chemistry and laboratory medicine.

[66]  Miriam C.J.M. Sturkenboom,et al.  Electronic Alerts Versus On-Demand Decision Support to Improve Dyslipidemia Treatment: A Cluster Randomized Controlled Trial , 2008, Circulation.

[67]  C. van Walraven,et al.  Effect of a controlled feedback intervention on laboratory test ordering by community physicians. , 2004, Clinical chemistry.

[68]  J H van Bemmel,et al.  Assessment of Decision Support for Blood Test Ordering in Primary Care , 2001, Annals of Internal Medicine.

[69]  Keith J. Petrie,et al.  Patients and computers as reminders to screen for diabetes in family practice , 2005, Journal of General Internal Medicine.

[70]  J A Knottnerus,et al.  Does feedback improve the quality of cervical smears? A randomized controlled trial. , 1993, The British journal of general practice : the journal of the Royal College of General Practitioners.

[71]  J. Holmen,et al.  IMPLEMENTING CLINICAL GUIDELINES IN THE TREATMENT OF DIABETES MELLITUS IN GENERAL PRACTICE , 2000, International Journal of Technology Assessment in Health Care.

[72]  David Parkin,et al.  Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial , 2002, BMJ : British Medical Journal.

[73]  L Culpepper,et al.  An education program to reduce unnecessary laboratory tests by residents , 1989, Academic medicine : journal of the Association of American Medical Colleges.

[74]  Christopher Naugler,et al.  A perspective on laboratory utilization management from Canada. , 2014, Clinica chimica acta; international journal of clinical chemistry.