No magic bullets: a systematic review of 102 trials of interventions to improve professional practice.

OBJECTIVE To determine the effectiveness of different types of interventions in improving health professional performance and health outcomes. DATA SOURCES MEDLINE, SCISEARCH, CINAHL and the Research and Development Resource Base in CME were searched for trials of educational interventions in the health care professions published between 1970 and 1993 inclusive. STUDY SELECTION Studies were selected if they provided objective measurements of health professional performance or health outcomes and employed random or quasi-random allocation methods in their study designs to assign individual subjects or groups. Interventions included such activities as conferences, outreach visits, the use of local opinion leaders, audit and feedback, and reminder systems. DATA EXTRACTION Details extracted from the studies included the study design; the unit of allocation (e.g., patient, provider, practice, hospital); the characteristics of the targeted health care professionals, educational interventions and patients (when appropriate); and the main outcome measure. DATA SYNTHESIS The inclusion criteria were met by 102 trials. Areas of behaviour change included general patient management, preventive services, prescribing practices, treatment of specific conditions such as hypertension or diabetes, and diagnostic service or hospital utilization. Dissemination-only strategies, such as conferences or the mailing of unsolicited materials, demonstrated little or no changes in health professional behaviour or health outcome when used alone. More complex interventions, such as the use of outreach visits or local opinion leaders, ranged from ineffective to highly effective but were most often moderately effective (resulting in reductions of 20% to 50% in the incidence of inappropriate performance). CONCLUSION There are no "magic bullets" for improving the quality of health care, but there are a wide range of interventions available that, if used appropriately, could lead to important improvements in professional practice and patient outcomes.

[1]  H. Rockette,et al.  Impact of randomized clinical trials on therapy of primary breast cancer: the NSABP overview. , 1982, Controlled Clinical Trials.

[2]  H. Garnier,et al.  Assessment of the role of randomized clinical trials in establishing treatment policies. , 1982, Controlled clinical trials.

[3]  J. Avorn,et al.  A controlled trial of educational outreach to improve blood transfusion practice. , 1993, JAMA.

[4]  T. Louis,et al.  A Randomized Controlled Trial of Quality Assurance in Sixteen Ambulatory Care Practices , 1985, Medical care.

[5]  F. Mosteller,et al.  A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. , 1992, JAMA.

[6]  M. Chassin,et al.  A randomized trial of medical quality assurance. Improving physicians' use of pelvimetry. , 1986, JAMA.

[7]  M. Mugford,et al.  Effects of feedback of information on clinical practice: a review. , 1991, BMJ.

[8]  G. Barnett,et al.  A Computer-Based Monitoring System for Follow-Up of Elevated Blood Pressure , 1983, Medical care.

[9]  A. Sherrington AN ANNOTATED BIBLIOGRAPHY OF STUDIES ON THE FLOW OF MEDICAL INFORMATION TO PRACTITIONERS. , 1965, Methods of information in medicine.

[10]  P. Jennett,et al.  The effects of continuing medical education on family doctor performance in office practice: a randomized control study , 1988, Medical education.

[11]  R W Jelliffe,et al.  Clinical studies with computer-assisted initial lidocaine therapy. , 1984, Archives of internal medicine.

[12]  T G Tape,et al.  Computerized medical records and preventive health care: success depends on many factors. , 1993, The American journal of medicine.

[13]  P. Chang,et al.  Effect of cost education, cost audits, and faculty chart review on the use of laboratory services. , 1983, Archives of internal medicine.

[14]  K Magruder-Habib,et al.  Improving Physicians' Recognition and Treatment of Depression in General Medical Care: Results From a Randomized Clinical Trial , 1990, Medical care.

[15]  R. Haynes,et al.  A taxonomy and critical review of tested strategies for the application of clinical practice recommendations: from "official" to "individual" clinical policy. , 1988, American journal of preventive medicine.

[16]  T Shinozaki,et al.  Medical Information Management: Improving the Transfer of Research Results to Presurgical Evaluation , 1983, Medical care.

[17]  G O Barnett,et al.  Computerized concurrent review of prenatal care. , 1978, QRB. Quality review bulletin.

[18]  D. Smith,et al.  Counseling medical and dental patients about cigarette smoking: the impact of nicotine gum and chart reminders. , 1987, American journal of public health.

[19]  C. Woodward,et al.  A randomized controlled trial assessing the impact of problem-based versus didactic teaching methods in CME. , 1988, Research in medical education : proceedings of the ... annual Conference. Conference on Research in Medical Education.

[20]  D. Cohen,et al.  Influence of Simple Computerized Feedback on Prescription Charges in an Ambulatory Clinic: A Randomized Clinical Trial , 1986, Medical care.

[21]  R. Wigton,et al.  Chart reminders in the diagnosis of anemia. , 1981, JAMA.

[22]  J. Knottnerus,et al.  Reactions of doctors to various forms of feedback designed to improve the sampling quality of cervical smears. , 1992, Quality assurance in health care : the official journal of the International Society for Quality Assurance in Health Care.

[23]  H C Sox,et al.  Modifying test-ordering behavior in the outpatient medical clinic. A controlled trial of two educational interventions. , 1985, Archives of internal medicine.

[24]  T. Ching,et al.  The employment of ward opinion leaders for continuing education in the hospital. , 1990, Medical teacher.

[25]  C. McDonald,et al.  Reminders to physicians from an introspective computer medical record. A two-year randomized trial. , 1984, Annals of internal medicine.

[26]  R B Haynes,et al.  Does a mailed continuing education program improve physician performance? Results of a randomized trial in antihypertensive care. , 1986, JAMA.

[27]  L. Muhlbaier,et al.  Improving Hypertension Control: Impact of Computer Feedback and Physician Education , 1981, Medical care.

[28]  H. Foye,et al.  Use of a chart audit: teaching well child care to paediatric house officers , 1993, Medical education.

[29]  The impact of controlled trials on the practice of medicine. , 1974, The Mount Sinai journal of medicine, New York.

[30]  L. Solberg,et al.  A randomized trial to increase smoking intervention by physicians. Doctors Helping Smokers, Round I. , 1989, JAMA.

[31]  M. Becker,et al.  Improving pediatricians' compliance-enhancing practices. A randomized trial. , 1988, American journal of diseases of children.

[32]  N. Freemantle,et al.  Implementing findings of medical research: the Cochrane Collaboration on Effective Professional Practice. , 1995, Quality in health care : QHC.

[33]  J E Rodnick,et al.  Promoting cancer prevention activities by primary care physicians. Results of a randomized, controlled trial. , 1991, JAMA.

[34]  W. Rosser,et al.  Use of reminders for preventive procedures in family medicine. , 1991, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[35]  D. Brown,et al.  The effectiveness of continuing medical education in changing the behavior of physicians caring for patients with acute myocardial infarction. A controlled randomized trial. , 1985, Annals of internal medicine.

[36]  D M Eddy,et al.  Clinical policies and the quality of clinical practice. , 1982, The New England journal of medicine.

[37]  G. Bole,et al.  Evaluation of an educational program for primary care practitioners, on the management of osteoarthritis. , 1985, Arthritis and rheumatism.

[38]  P S Heckerling,et al.  Effect of a fact sheet reminder on performance of the periodic health examination: a randomized controlled trial. , 1992, American journal of preventive medicine.

[39]  J L Rogers,et al.  The Impact of a Computerized Medical Record Summary System on Incidence and Length of Hospitalization , 1979, Medical care.

[40]  Stephen B. Soumerai,et al.  Improving Drug-Therapy Decisions through Educational Outreach , 1983 .

[41]  R. Haynes,et al.  Evidence for the effectiveness of CME. A review of 50 randomized controlled trials. , 1992, JAMA.

[42]  A. Donner,et al.  Do family physicians need medical assistants to detect and manage hypertension? , 1986, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[43]  D W Raisch,et al.  Improving antiulcer agent prescribing in a health maintenance organization. , 1990, American journal of hospital pharmacy.

[44]  C J McDonald,et al.  Delayed Feedback of Physician Performance Versus Immediate Reminders to Perform Preventive Care: Effects on Physician Compliance , 1986, Medical care.

[45]  C J McDonald,et al.  Effects of computer reminders for influenza vaccination on morbidity during influenza epidemics. , 1992, M.D. computing : computers in medical practice.

[46]  F. M. Wolf,et al.  Evaluation of an education program on the management of rheumatic diseases for physical therapists. , 1986, The Journal of rheumatology.

[47]  K L Coltin,et al.  Feedback reduces test use in a health maintenance organization. , 1986, JAMA.

[48]  E C Coles,et al.  Randomised controlled trial of computer-held medical records in hypertensive patients. , 1976, British medical journal.

[49]  S C Schoenbaum,et al.  Implementing clinical guidelines: a quality management approach to reminder systems. , 1992, QRB. Quality review bulletin.

[50]  D L Sackett,et al.  A randomized trial of continuing medical education. , 1982, The New England journal of medicine.

[51]  C. Lewis,et al.  Disease prevention and health promotion practices of primary care physicians in the United States. , 1988, American journal of preventive medicine.

[52]  C J McDonald,et al.  Physician response to computer reminders. , 1980, JAMA.

[53]  R. E. Johnson,et al.  Examining Physicians' Drug Order Recording Behavior , 1978, Medical care.

[54]  J. Stross,et al.  The dissemination of new medical information. , 1979, JAMA.

[55]  A. Nattinger,et al.  Improving the utilization of screening mammography in primary care practices. , 1989, Archives of internal medicine.

[56]  H. Goldberg,et al.  The effect of computerized feedback coupled with a newsletter upon outpatient prescribing charges. A randomized controlled trial. , 1988, Medical care.

[57]  S. Mcphee,et al.  Promoting cancer screening. A randomized, controlled trial of three interventions. , 1989 .

[58]  B. Skipper,et al.  Physician behavior modification using claims data: tetracycline for upper respiratory infection. , 1982, The Western journal of medicine.

[59]  J. Avorn,et al.  Improving drug-therapy decisions through educational outreach. A randomized controlled trial of academically based "detailing". , 1983, The New England journal of medicine.

[60]  G. Bole,et al.  Evaluation of a continuing education program in rheumatoid arthritis. , 1980, Arthritis and rheumatism.

[61]  R. Putnam,et al.  Physicians' participation in establishing criteria for hypertension management in the office: will patient outcomes be improved? , 1989, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[62]  L W Green,et al.  Preventive practices by physicians: behavioral determinants and potential interventions. , 1988, American journal of preventive medicine.

[63]  R. Worth,et al.  Concurrent quality assurance in hospital care. Report of a study by Private Initiative in PSRO. , 1978, The New England journal of medicine.

[64]  James R. Campbell,et al.  Process in ambulatory care: A controlled clinical trial of computerized records , 1988 .

[65]  H. Anderson,et al.  Randomized controlled trial of small group education on the outcome of chronic asthma in general practice. , 1989, The Journal of the Royal College of General Practitioners.

[66]  T. Hassard,et al.  Assessing practicing physicians in two settings using standardized patients , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[67]  B. Littenberg,et al.  Does Cost Information Availability Reduce Physician Test Usage?: A Randomized Clinical Trial With Unexpected Findings , 1982, Medical care.

[68]  C. Mc Donald,et al.  Use of a computer to detect and respond to clinical events: its effect on clinician behavior. , 1976, Annals of internal medicine.

[69]  R. Hiss,et al.  Continuing education in pulmonary disease for primary-care physicians. , 2015, The American review of respiratory disease.

[70]  C. McDonald Protocol-based computer reminders, the quality of care and the non-perfectability of man. , 1976, The New England journal of medicine.

[71]  J. LoGerfo,et al.  Teaching sigmoidoscopy to primary care physicians: a controlled study of continuing medical education. , 1983, The Journal of family practice.

[72]  R. C. Turner,et al.  The effect of patient-carried reminder cards on the performance of health maintenance measures. , 1990, Archives of internal medicine.

[73]  Eugene Vayda,et al.  Opinion leaders vs audit and feedback to implement practice guidelines. Delivery after previous cesarean section. , 1991, JAMA.

[74]  D. Ketley,et al.  Impact of clinical trials on clinical practice: example of thrombolysis for acute myocardial infarction , 1993, The Lancet.

[75]  R. Putnam,et al.  Impact of patient care appraisal on physician behaviour in the office setting. , 1985, Canadian Medical Association journal.

[76]  T. Speroff,et al.  Efforts to improve compliance with the National Cholesterol Education Program guidelines. Results of a randomized controlled trial. , 1992, Archives of internal medicine.

[77]  J W Williamson,et al.  Health science information management and continuing education of physicians. A survey of U.S. primary care practitioners and their opinion leaders. , 1989, Annals of internal medicine.

[78]  P. Norton,et al.  Self-audit: its effect on quality of care. , 1985, The Journal of family practice.

[79]  D. Waddell The effects of continuing education on nursing practice: a meta-analysis. , 1991, Journal of continuing education in nursing.

[80]  P M Wortman,et al.  Medical Information Systems: Assessing Impact in the Areas of Hypertension, Obesity and Renal Disease , 1982, Medical care.

[81]  J. Goodwin,et al.  Failure to Recognize Efficacious Treatments: A History of Salicylate Therapy in Rheumatoid Arthritis , 2015, Perspectives in biology and medicine.

[82]  R B D'Agostino,et al.  The usefulness of a predictive instrument to reduce inappropriate admissions to the coronary care unit. , 1980, Annals of internal medicine.

[83]  R. E. Johnson,et al.  Studying the Impact of Patient Drug Profiles in an HMO , 1976, Medical care.

[84]  M. Britton,et al.  Impact of medication profile review on prescribing in a general medicine clinic. , 1991, American journal of hospital pharmacy.

[85]  I. Adams,et al.  Computer aided diagnosis of acute abdominal pain: a multicentre study. , 1986, British medical journal.

[86]  H. Covvey,et al.  Randomised controlled trial of computer assisted management of hypertension in primary care. , 1986, British medical journal.

[87]  William M. Tierney,et al.  Effects of the Clinical Environment on Physicians’ Response to Postgraduate Medical Education , 1990 .

[88]  D. Smith,et al.  Encouraging primary care physicians to help smokers quit. A randomized, controlled trial. , 1989, Annals of internal medicine.

[89]  J. Restuccia,et al.  The Effect of Concurrent Feedback in Reducing Inappropriate Hospital Utilization , 1982, Medical care.

[90]  J. Eisenberg Doctors''Decisions and the Cost of Medical Care , 1986 .

[91]  B. Linn Continuing medical education. Impact on emergency room burn care. , 1980, JAMA.

[92]  L. Fisher,et al.  Randomized surgical clinical trials for treatment of coronary artery disease. , 1982, Controlled clinical trials.

[93]  R B D'Agostino,et al.  A predictive instrument to improve coronary-care-unit admission practices in acute ischemic heart disease. A prospective multicenter clinical trial. , 1984, The New England journal of medicine.

[94]  F Davidoff,et al.  Changing Test Ordering Behavior: A Randomized Controlled Trial Comparing Probabilistic Reasoning With Cost-Containment Education , 1989, Medical care.

[95]  C. Chambers,et al.  Microcomputer-generated reminders. Improving the compliance of primary care physicians with mammography screening guidelines. , 1989, The Journal of family practice.

[96]  T. Coates,et al.  Management of hypertension in private practice: A randomized controlled trial in continuing medical education , 1988 .

[97]  M. Bass,et al.  Preventive practice patterns of Canadian primary care physicians. , 1988, American journal of preventive medicine.

[98]  T C Chalmers,et al.  Cumulative meta-analysis of therapeutic trials for myocardial infarction. , 1992, The New England journal of medicine.

[99]  C J McDonald,et al.  The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. , 1990, The New England journal of medicine.

[100]  J. Ramsdell,et al.  Effect of medical records' checklists on implementation of periodic health measures. , 1987, The American journal of medicine.

[101]  H. Shannon,et al.  Computerized protocol for preventive medicine: a controlled self-audit in family practice. , 1989, Family practice.

[102]  J A Knottnerus,et al.  Does feedback improve the quality of cervical smears? A randomized controlled trial. , 1993, The British journal of general practice : the journal of the Royal College of General Practitioners.

[103]  R. Donaldson,et al.  How physicians use cimetidine: a survey of hospitalized patients and published cases. , 1981, The New England journal of medicine.

[104]  P. A. Carney,et al.  Cancer: improving early detection and prevention. A community practice randomised trial. , 1992, BMJ.

[105]  Chalmers Tc The impact of controlled trials on the practice of medicine. , 1974 .

[106]  G. Knatterud,et al.  Impact of the Coronary Drug Project findings on clinical practice. , 1983, Controlled clinical trials.

[107]  M. Pollack,et al.  Pediatric critical care cost containment: Combined actuarial and clinical program , 1991, Critical care medicine.

[108]  W E Hammond,et al.  Improving Drug Prescribing in a Primary Care Practice , 1984, Medical care.

[109]  M. Abrahamowicz,et al.  Evaluation of the effectiveness of immunization delivery methods. , 1994, Canadian journal of public health = Revue canadienne de sante publique.

[110]  J. Lomas Teaching old (and not so old) docs new tricks , 1993 .

[111]  G O Barnett,et al.  Improving Physician Performance Through Peer Comparison Feedback , 1984, Medical care.

[112]  E F Hughes,et al.  Training House Officers to be Cost Conscious: Effects of an Educational Intervention on Charges and Length of Stay , 1990, Medical care.

[113]  C J McDonald,et al.  Computer predictions of abnormal test results. Effects on outpatient testing. , 1988, JAMA.

[114]  Stuart J. Cohen,et al.  The impact of reading on physicians' nonadherence to recommended standards of medical care. , 1985, Social science & medicine.

[115]  A. Jette,et al.  Improving patient function: a randomized trial of functional disability screening. , 1989, Annals of internal medicine.

[116]  L. A. Thibodeau,et al.  A trial of two strategies to modify the test-ordering behavior of medical residents. , 1980, The New England journal of medicine.

[117]  Albert R. Martin,et al.  Training physicians in counseling about smoking cessation. A randomized trial of the "Quit for Life" program. , 1989, Annals of internal medicine.

[118]  S. Graber,et al.  Cost Effectiveness of Two Interventions for Reducing Outpatient Prescribing Costs , 1989, DICP : the annals of pharmacotherapy.

[119]  S R Salem-Schatz,et al.  A randomized trial of a program to reduce the use of psychoactive drugs in nursing homes. , 1992, The New England journal of medicine.

[120]  J. Stross Relationships between knowledge and experience in the use of disease-modifying antirheumatic agents. A study of primary care practitioners. , 1989, JAMA.

[121]  R G Wones,et al.  Failure of low-cost audits with feedback to reduce laboratory test utilization. , 1987, Medical care.

[122]  D. Taylor,et al.  A randomized trial of a family physician intervention for smoking cessation. , 1988, JAMA.

[123]  P Ours,et al.  DIABEDS: a randomized trial of the effects of physician and/or patient education on diabetes patient outcomes. , 1987, Journal of chronic diseases.