Providing Performance Feedback to Individual Physicians : Current Practice and Emerging Lessons Final Report

This product is part of the RAND Health working paper series. RAND working papers are intended to share researchers' latest findings and to solicit additional peer review. This paper has been peer reviewed but not edited. Unless otherwise indicated, working papers can be quoted and cited without permission of the author, provided the source is clearly referred to as a working paper. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors. is a registered trademark.

[1]  Margaret Maglione,et al.  Interventions That Increase Use of Adult Immunization and Cancer Screening Services , 2002, Annals of Internal Medicine.

[2]  S. Schoenbaum,et al.  Improving influenza vaccination performance in an HMO setting: the use of computer-generated reminders and peer comparison feedback. , 1990, American journal of public health.

[3]  J. Hopkins.  Financial incentives for ambulatory care performance improvement. , 1999, The Joint Commission journal on quality improvement.

[4]  Reporting health care performance: learning from the past, prospects for the future. , 2002, Journal of evaluation in clinical practice.

[5]  S. Weingarten,et al.  Physician education and report cards: do they make the grade? results from a randomized controlled trial. , 1999, The American journal of medicine.

[6]  M. Mugford,et al.  Effects of feedback of information on clinical practice: a review. , 1991, BMJ.

[7]  D. Bates,et al.  Effects of computerized physician order entry on prescribing practices. , 2000, Archives of internal medicine.

[8]  L. Solberg,et al.  Paying for quality improvement: compliance with tobacco cessation guidelines. , 2003, Joint Commission journal on quality and safety.

[9]  D. Parker,et al.  Enhancing the quality of care for patients with coronary heart disease: the design and baseline results of the hastening the effective application of research through technology (HEART) trial. , 2002, The American journal of managed care.

[10]  N. Freemantle,et al.  Impact of formal continuing medical education: do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes? , 1999, JAMA.

[11]  P. Basch.  Quality of health care delivered to adults in the United States. , 2003, New England Journal of Medicine.

[12]  E. McGlynn,et al.  What Cognitive Science Tells Us about the Design of Reports for Consumers , 2002, Medical care research and review : MCRR.

[13]  A D Oxman,et al.  Changing physician performance. A systematic review of the effect of continuing medical education strategies. , 1995, JAMA.

[14]  G. Divine,et al.  A Web-based diabetes care management support system. , 2001, The Joint Commission journal on quality improvement.

[15]  A. Hillman,et al.  The Use of Physician Financial Incentives and Feedback to Improve Pediatric Preventive Care in Medicaid Managed Care , 1999, Pediatrics.

[16]  H. Beckman,et al.  Physician Reactions to Quantitative Individual Performance Reports , 2006, American journal of medical quality : the official journal of the American College of Medical Quality.

[17]  S B Soumerai,et al.  Principles of educational outreach ('academic detailing') to improve clinical decision making. , 1990, JAMA.

[18]  M. Tingen,et al.  Provider feedback improves adherence with AHCPR Smoking Cessation Guideline. , 2001, Preventive medicine.

[19]  R B Haynes,et al.  Does a mailed continuing education program improve physician performance? Results of a randomized trial in antihypertensive care. , 1986, JAMA.

[20]  A. Taylor-Vaisey,et al.  Translating guidelines into practice. A systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines. , 1997, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[21]  H. Bauchner,et al.  Changing physician behaviour , 2001, Archives of disease in childhood.

[22]  S. Soumerai,et al.  Principles and Uses of Academic Detailing to Improve the Management of Psychiatric Disorders , 1998, International journal of psychiatry in medicine.

[23]  P Slovic,et al.  Making health care quality reports easier to use. , 2001, The Joint Commission journal on quality improvement.

[24]  Sharon-Lise T Normand,et al.  Physician clinical performance assessment: prospects and barriers. , 2003, JAMA.

[25]  R. Trowbridge,et al.  Educational Techniques Used in Changing Provider Behavior , 2001 .

[26]  D. Marrero,et al.  Impact of a program to improve adherence to diabetes guidelines by primary care physicians. , 2002, Diabetes care.

[27]  E. Main,et al.  Reducing cesarean birth rates with data-driven quality improvement activities. , 1999, Pediatrics.

[28]  S B Soumerai,et al.  Effect of local medical opinion leaders on quality of care for acute myocardial infarction: a randomized controlled trial. , 1998, JAMA.

[29]  J. Spertus,et al.  Effects of sustained audit/feedback on self-reported health status of primary care patients. , 2004, The American journal of medicine.

[30]  W. Zareba,et al.  The influence of public reporting of outcome data on medical decision making by physicians. , 2005, Archives of internal medicine.

[31]  C J McDonald,et al.  Delayed Feedback of Physician Performance Versus Immediate Reminders to Perform Preventive Care: Effects on Physician Compliance , 1986, Medical care.

[32]  N. Weinberg.  Using performance measures to identify plans of action to improve care. , 2001, The Joint Commission journal on quality improvement.

[33]  J J Allison,et al.  Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial. , 2001, JAMA.

[34]  C. Violato,et al.  Assessment of physician performance in Alberta: the physician achievement review. , 1999, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[35]  P B Batalden,et al.  Report cards or instrument panels: who needs what? , 1995, The Joint Commission journal on quality improvement.

[36]  J. Hibbard,et al.  Engaging Health Care Consumers to Improve the Quality of Care , 2003, Medical care.

[37]  L. G. Pawlson,et al.  Measuring patients' trust in physicians when assessing quality of care. , 2004, Health affairs.

[38]  W. R. Smith,et al.  Evidence for the effectiveness of techniques To change physician behavior. , 2000, Chest.

[39]  R. Lowes.  Groups get serious about judging their doctors. , 1995, Medical economics.

[40]  J. Avorn,et al.  Predictors of Physician Prescribing Change in an Educational Experiment to Improve Medication Use , 1987, Medical care.

[41]  C. Mulrow,et al.  From understanding health care provider behavior to improving health care: the QUERI framework for quality improvement. Quality Enhancement Research Initiative. , 2000, Medical care.

[42]  E V Dunn,et al.  Evaluating the effectiveness of 2 educational interventions in family practice. , 1999, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[43]  Jeroan J. Allison,et al.  Do Local Opinion Leaders Augment Hospital Quality Improvement Efforts?: A Randomized Trial to Promote Adherence to Unstable Angina Guidelines , 2003, Medical care.

[44]  W. Wadland,et al.  The Development of Resident “Report Cards” in the Context of Managed Care Education , 2001, Academic medicine : journal of the Association of American Medical Colleges.

[45]  M. Spranca,et al.  Reporting about Health Care Quality: A Guide to the Galaxy , 2004, Health promotion practice.

[46]  M. Nettleman,et al.  Changing physician behavior: half‐empty or half‐full? , 2003 .

[47]  J Lomas,et al.  Words without action? The production, dissemination, and impact of consensus recommendations. , 1991, Annual review of public health.

[48]  S M Shortell,et al.  Promoting clinical involvement in hospital quality improvement efforts: the effects of top management, board, and physician leadership. , 1997, Health services research.

[49]  James C. Robinson,et al.  What are the facilitators and barriers in physician organizations' use of care management processes? , 2004, Joint Commission journal on quality and safety.

[50]  S. Berry,et al.  Will Financial Incentives Stimulate Quality Improvement? Reactions From Frontline Physicians , 2006, American journal of medical quality : the official journal of the American College of Medical Quality.

[51]  S. Shortell,et al.  Assessing the impact of continuous quality improvement on clinical practice: what it will take to accelerate progress. , 1998, The Milbank quarterly.

[52]  D W Belcher,et al.  Implementing preventive services. Success and failure in an outpatient trial. , 1990, Archives of internal medicine.

[53]  E. McGlynn,et al.  Providing Performance Feedback to Individual Physicians , 2006 .

[54]  N. Freemantle,et al.  Audit and feedback versus alternative strategies: effects on professional practice and health care outcomes. , 1998, The Cochrane database of systematic reviews.

[55]  Paul Slovic,et al.  Strategies for reporting health plan performance information to consumers: evidence from controlled studies. , 2002, Health services research.

[56]  J. Hux,et al.  Confidential prescriber feedback and education to improve antibiotic use in primary care: a controlled trial. , 1999, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[57]  Eugene Vayda,et al.  Opinion leaders vs audit and feedback to implement practice guidelines. Delivery after previous cesarean section. , 1991, JAMA.

[58]  J. Allison,et al.  A group randomized trial to improve safe use of nonsteroidal anti-inflammatory drugs. , 2005, The American journal of managed care.

[59]  J. Grimshaw,et al.  Effect of a practice-based strategy on test ordering performance of primary care physicians: a randomized trial. , 2003, JAMA.

[60]  A D Oxman,et al.  Audit and feedback: effects on professional practice and health care outcomes. , 2006, The Cochrane database of systematic reviews.

[61]  D. Shye,et al.  Primary care physicians' use of lumbar spine imaging tests: effects of guidelines and practice pattern feedback. , 1997, Journal of general internal medicine.

[62]  Realizing the potential of practice pattern profiling. , 1992, Inquiry : a journal of medical care organization, provision and financing.

[63]  L. Goebel,et al.  A peer review feedback method of promoting compliance with preventive care guidelines in a resident ambulatory care clinic. , 1997, The Joint Commission journal on quality improvement.

[64]  J. Eisenberg,et al.  Changing physicians' practices. , 1993, Tobacco control.

[65]  W. Haefeli,et al.  Drug dosage in patients with renal failure optimized by immediate concurrent feedback , 2001, Journal of General Internal Medicine.

[66]  D E Kanouse,et al.  When Does Information Change Practitioners' Behavior? , 1988, International Journal of Technology Assessment in Health Care.

[67]  G. Gilmet,et al.  The Use of an Integrated Clinical Laboratory and Pharmacy Diabetes Database To Provide Physician Performance Feedback in an IPA‐Model HMO , 1998, The Journal of ambulatory care management.

[68]  J. Hibbard,et al.  Choosing a health plan: do large employers use the data? , 1997, Health affairs.

[69]  W. Tierney,et al.  A controlled trial of including symptom data in computer-based care suggestions for managing patients with chronic heart failure. , 2004, The American journal of medicine.

[70]  J. Eisenberg.  Doctors''Decisions and the Cost of Medical Care , 1986 .

[71]  P Slovic,et al.  Informing consumer decisions in health care: implications from decision-making research. , 1997, The Milbank quarterly.

[72]  Paul B. Batalden,et al.  Clinical Improvement Action Guide , 1998 .

[73]  M. Enkin,et al.  Do practice guidelines guide practice? The effect of a consensus statement on the practice of physicians. , 1989, The New England journal of medicine.

[74]  Edward Guadagnoli,et al.  Failure of Information as an Intervention to Modify Clinical Management: A Time-Series Trial in Patients with Acute Chest Pain , 1995, Annals of Internal Medicine.

[75]  Donald E Lighter,et al.  Case study: using control charts to track physician productivity. , 2004, Physician executive.

[76]  A. Jette,et al.  Functional disability screening of ambulatory patients , 1994, Journal of General Internal Medicine.

[77]  C. van Weel,et al.  Interventions to improve the delivery of preventive services in primary care. , 1999, American journal of public health.

[78]  D. Kanouse,et al.  Effects of the National Institutes of Health Consensus Development Program on physician practice. , 1987, JAMA.

[79]  J J Mohr,et al.  Improving health care, Part 1: The clinical value compass. , 1996, The Joint Commission journal on quality improvement.

[80]  Joyce A. Mitchell,et al.  Effect of physician profiling on utilization , 1996, Journal of General Internal Medicine.

[81]  Terry Hyslop,et al.  Impact of a physician-oriented intervention on follow-up in colorectal cancer screening. , 2004, Preventive medicine.

[82]  M. Cabana,et al.  Why don't physicians follow clinical practice guidelines? A framework for improvement. , 1999, JAMA.

[83]  E. Yano,et al.  Helping practices reach primary care goals. Lessons from the literature. , 1995, Archives of internal medicine.

[84]  J H Hibbard,et al.  Increasing the impact of health plan report cards by addressing consumers' concerns. , 2000, Health affairs.

[85]  M. Nettleman,et al.  Assigning responsibility: using feedback to achieve sustained control of methicillin-resistant Staphylococcus aureus. , 1991, The American journal of medicine.

[86]  E A Balas,et al.  Effect of physician profiling on utilization. Meta-analysis of randomized clinical trials. , 1996, Journal of general internal medicine.

[87]  J Gabbay,et al.  The role of performance indicators in changing the autonomy of the general practice profession in the UK. , 2003, Social science & medicine.

[88]  Andrew D Oxman,et al.  Closing the gap between research and practice : an overview of systematic reviews of interventions to promote the implementation of research findings , 2011 .

[89]  Sarah Corley,et al.  A Multimethod Quality Improvement Intervention To Improve Preventive Cardiovascular Care , 2004, Annals of Internal Medicine.

[90]  W Lorenz,et al.  Optimal Methods for Guideline Implementation: Conclusions From Leeds Castle Meeting , 2001, Medical care.

[91]  Marla R. Miller,et al.  Increasing adherence to a community-based guideline for acute sinusitis through education, physician profiling, and financial incentives. , 2004, The American journal of managed care.

[92]  C. Tilquin,et al.  The diluting effect of medical work groups on feedback efficacy in changing physician's practice , 1996, Journal of Behavioral Medicine.

[93]  Jerry Avorn,et al.  Cultural and Economic Factors That (Mis)Shape Antibiotic Use: The Nonpharmacologic Basis of Therapeutics , 2000, Annals of Internal Medicine.

[94]  M. Petrillo,et al.  The Effect of a Multifaceted Physician Office‐Based Intervention on Older Women's Mammography Use , 2000, Journal of the American Geriatrics Society.

[95]  J. Cox,et al.  Comparing clinical resources and outcomes to understand best practices. , 2002, Journal of healthcare management / American College of Healthcare Executives.

[96]  G. Fairbrother,et al.  The impact of physician bonuses, enhanced fees, and feedback on childhood immunization coverage rates. , 1999, American journal of public health.

[97]  C. Violato,et al.  Changing physicians' practices: the effect of individual feedback. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[98]  D. Asch,et al.  The unintended consequences of publicly reporting quality information. , 2005, JAMA.

[99]  J. Eisenberg,et al.  Physician Utilization: The State of Research About Physicians’ Practice Patterns , 1985, Medical care.

[100]  Dave Davis,et al.  Does CME Work? An Analysis of the Effect of Educational Activities on Physician Performance or Health Care Outcomes , 1998, International journal of psychiatry in medicine.

[101]  Jens Søndergaard,et al.  Mailed prescriber feedback in addition to a clinical guideline has no impact: a randomised, controlled trial , 2003, Scandinavian journal of primary health care.

[102]  A. C. Conway,et al.  Partnering with physicians to achieve quality improvement. , 1995, The Joint Commission journal on quality improvement.

[103]  Stephen C Schoenbaum,et al.  Measure, learn, and improve: physicians' involvement in quality improvement. , 2005, Health affairs.

[104]  K. Wells,et al.  Physician knowledge, financial incentives and treatment decisions for depression. , 1998, The journal of mental health policy and economics.