Systematic review: Effects, design choices, and context of pay-for-performance in health care

BackgroundPay-for-performance (P4P) is one of the primary tools used to support healthcare delivery reform. Substantial heterogeneity exists in the development and implementation of P4P in health care and its effects. This paper summarizes evidence, obtained from studies published between January 1990 and July 2009, concerning P4P effects, as well as evidence on the impact of design choices and contextual mediators on these effects. Effect domains include clinical effectiveness, access and equity, coordination and continuity, patient-centeredness, and cost-effectiveness.MethodsThe systematic review made use of electronic database searching, reference screening, forward citation tracking and expert consultation. The following databases were searched: Cochrane Library, EconLit, Embase, Medline, PsychINFO, and Web of Science. Studies that evaluate P4P effects in primary care or acute hospital care medicine were included. Papers concerning other target groups or settings, having no empirical evaluation design or not complying with the P4P definition were excluded. According to study design nine validated quality appraisal tools and reporting statements were applied. Data were extracted and summarized into evidence tables independently by two reviewers.ResultsOne hundred twenty-eight evaluation studies provide a large body of evidence -to be interpreted with caution- concerning the effects of P4P on clinical effectiveness and equity of care. However, less evidence on the impact on coordination, continuity, patient-centeredness and cost-effectiveness was found. P4P effects can be judged to be encouraging or disappointing, depending on the primary mission of the P4P program: supporting minimal quality standards and/or boosting quality improvement. Moreover, the effects of P4P interventions varied according to design choices and characteristics of the context in which it was introduced.Future P4P programs should (1) select and define P4P targets on the basis of baseline room for improvement, (2) make use of process and (intermediary) outcome indicators as target measures, (3) involve stakeholders and communicate information about the programs thoroughly and directly, (4) implement a uniform P4P design across payers, (5) focus on both quality improvement and achievement, and (6) distribute incentives to the individual and/or team level.ConclusionsP4P programs result in the full spectrum of possible effects for specific targets, from absent or negligible to strongly beneficial. Based on the evidence the review has provided further indications on how effect findings are likely to relate to P4P design choices and context. The provided best practice hypotheses should be tested in future research.

[1]  Can You Get What You Pay For? Pay-for-Performance and the Quality of Healthcare Providers , 2009 .

[2]  R. Daniels,et al.  Primary care , 1998, BMJ : British Medical Journal.

[3]  G. Fairbrother,et al.  The impact of physician bonuses, enhanced fees, and feedback on childhood immunization coverage rates. , 1999, American journal of public health.

[4]  R. Kouides,et al.  A performance-based incentive program for influenza immunization in the elderly. , 1993, American journal of preventive medicine.

[5]  N. Steel,et al.  Potential population health gain of the quality and outcomes framework: report to Department of Health , 2008 .

[6]  M. Lynch Effect of practice and patient population characteristics on the uptake of childhood immunizations. , 1995, The British journal of general practice : the journal of the Royal College of General Practitioners.

[7]  Robert Sherrick,et al.  Who is at greatest risk for receiving poor-quality health care? , 2006, The New England journal of medicine.

[8]  L. Solberg,et al.  Paying for quality improvement: compliance with tobacco cessation guidelines. , 2003, Joint Commission journal on quality and safety.

[9]  Bruce Guthrie,et al.  Record rewards: the effects of targeted quality incentives on the recording of risk factors by primary care providers. , 2009, Health economics.

[10]  B. Guthrie,et al.  Deprivation and quality of primary care services: evidence for persistence of the inverse care law from the UK Quality and Outcomes Framework , 2006, Journal of Epidemiology and Community Health.

[11]  K. Lefevre,et al.  Introduction of a new incentive and target‐based contract for family physicians in the UK: good for older patients with diabetes but less good for women? , 2008, Diabetic medicine : a journal of the British Diabetic Association.

[12]  M. Sutton,et al.  Determinants of primary medical care quality measured under the new UK contract: cross sectional study , 2006, BMJ : British Medical Journal.

[13]  B. H. Thomas,et al.  A process for systematically reviewing the literature: providing the research evidence for public health nursing interventions. , 2004, Worldviews on evidence-based nursing.

[14]  Jeremy Gray Mrcp Mrcgp,et al.  Ethnicity and Quality of Diabetes Care in a Health System with Universal Coverage: Population-Based Cross-sectional Survey in Primary Care , 2007, Journal of General Internal Medicine.

[15]  H. Rubin,et al.  Does the frequency of pay-for-performance payment matter?--Experience from a randomized trial. , 2010, Health services research.

[16]  Thomas G. Rundall,et al.  Support for Smoking Cessation Interventions in Physician Organizations: Results From a National Study , 2003, Medical care.

[17]  I. Durand-zaleski,et al.  Effects of financial incentives on medical practice: results from a systematic review of the literature and methodological issues. , 2000, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[18]  Michael W. Taylor,et al.  Bmc Family Practice Are Different Groups of Patients with Stroke More Likely to Be Excluded from the New Uk General Medical Services Contract? a Cross-sectional Retrospective Analysis of a Large Primary Care Population , 2022 .

[19]  Yu-Kang Tu,et al.  Do the UK government's new Quality and Outcomes Framework (QOF) scores adequately measure primary care performance? A cross-sectional survey of routine healthcare data , 2007, BMC Health Services Research.

[20]  A. Majeed,et al.  Impact of a pay-for-performance incentive on support for smoking cessation and on smoking prevalence among people with diabetes , 2007, Canadian Medical Association Journal.

[21]  Matt Sutton,et al.  Doctor Behaviour Under a Pay for Performance Contract: Further Evidence from the Quality and Outcomes Framework , 2008 .

[22]  Thomas G. Rundall,et al.  Research Paper: Adoption of Order Entry with Decision Support for Chronic Care by Physician Organizations , 2007, J. Am. Medical Informatics Assoc..

[23]  Kathleen J. Mullen,et al.  Can You Get What You Pay For? Pay-for-Performance and the Quality of Healthcare Providers , 2009, The Rand journal of economics.

[24]  Nancy Dean Beaulieu,et al.  Putting smart money to work for quality improvement. , 2005, Health services research.

[25]  A. Hillman,et al.  Physician financial incentives and feedback: failure to increase cancer screening in Medicaid managed care. , 1998, American journal of public health.

[26]  Hermann Brenner,et al.  Cost-effective primary care-based strategies to improve smoking cessation: more value for money. , 2009, Archives of internal medicine.

[27]  Evangelos Kontopantelis,et al.  Quality of primary care in England with the introduction of pay for performance. , 2007, The New England journal of medicine.

[28]  M. Gulliford,et al.  Achievement of metabolic targets for diabetes by English primary care practices under a new system of incentives , 2007, Diabetic medicine : a journal of the British Diabetic Association.

[29]  U. Srirangalingam,et al.  Changing pattern of referral to a diabetes clinic following implementation of the new UK GP contract. , 2006, The British journal of general practice : the journal of the Royal College of General Practitioners.

[30]  Francois S de Brantes,et al.  Physicians respond to pay-for-performance incentives: larger incentives yield greater participation. , 2009, The American journal of managed care.

[31]  Evangelos Kontopantelis,et al.  Pay-for-performance programs in family practices in the United Kingdom. , 2006, The New England journal of medicine.

[32]  Shu-Hong Zhu,et al.  The impact of financial incentives and a patient registry on preventive care quality: increasing provider adherence to evidence-based smoking cessation practice guidelines. , 2003, Preventive medicine.

[33]  B. Rimer,et al.  Interventions to increase recommendation and delivery of screening for breast, cervical, and colorectal cancers by healthcare providers systematic reviews of provider assessment and feedback and provider incentives. , 2008, American journal of preventive medicine.

[34]  R. Morrow,et al.  Improving physicians' preventive health care behavior through peer review and financial incentives. , 1995, Archives of family medicine.

[35]  Gary J. Young,et al.  Effects of Paying Physicians Based on their Relative Performance for Quality , 2007, Journal of General Internal Medicine.

[36]  J. Lemkau,et al.  Enhancing mammography referral in primary care. , 1997, Preventive medicine.

[37]  D. Altman,et al.  CONSORT statement: extension to cluster randomised trials , 2004, BMJ : British Medical Journal.

[38]  Janice A Singer,et al.  The impact of pay-for-performance on health care quality in Massachusetts, 2001-2003. , 2008, Health affairs.

[39]  D. Crook,et al.  Using the UK primary care Quality and Outcomes Framework to audit health care equity: preliminary data on diabetes management. , 2006, Journal of public health.

[40]  A James O'Malley,et al.  Quality of care for the treatment of acute medical conditions in US hospitals. , 2006, Archives of internal medicine.

[41]  Ken P Kleinman,et al.  The response of physician groups to P4P incentives. , 2007, The American journal of managed care.

[42]  Thomas Bodenheimer,et al.  The use of patient and physician reminders for preventive services: results from a National Study of Physician Organizations. , 2004, Preventive medicine.

[43]  Nick Freemantle,et al.  Effect of the quality and outcomes framework on diabetes care in the United Kingdom: retrospective cohort study , 2009, BMJ : British Medical Journal.

[44]  Ming Tai-Seale,et al.  Association between physician compensation methods and delivery of guideline-concordant STD care: is there a link? , 2005, The American journal of managed care.

[45]  D. Conrad,et al.  Quality-based financial incentives in health care: can we improve quality by paying for it? , 2009, Annual review of public health.

[46]  B. Leese,et al.  Target payments in primary care: effects on professional practice and health care outcomes. , 1999, The Cochrane database of systematic reviews.

[47]  James C. Robinson,et al.  Improving Quality in Medicaid: The Use of Care Management Processes for Chronic Illness and Preventive Care , 2006, Medical Care.

[48]  G. Fairbrother,et al.  Comparison of preventive care in Medicaid managed care and Medicaid fee for service in institutions and private practices. , 2001, Ambulatory pediatrics : the official journal of the Ambulatory Pediatric Association.

[49]  B. Sibbald,et al.  Effects of pay for performance on the quality of primary care in England. , 2009, The New England journal of medicine.

[50]  A. Legorreta,et al.  A Quality‐Driven Physician Compensation Model: Four‐Year Follow‐up Study , 2003, Journal for healthcare quality : official publication of the National Association for Healthcare Quality.

[51]  Hoangmai H Pham,et al.  Rapidity and modality of imaging for acute low back pain in elderly patients. , 2009, Archives of internal medicine.

[52]  M. Rosenthal,et al.  Early experience with pay-for-performance: from concept to practice. , 2005, JAMA.

[53]  James C. Robinson,et al.  External incentives, information technology, and organized processes to improve health care quality for patients with chronic diseases. , 2003, JAMA.

[54]  Laura Petersen,et al.  Does Pay-for-Performance Improve the Quality of Health Care? , 2006, Annals of Internal Medicine.

[55]  M. Thorogood,et al.  The carrot, the stick and the general practitioner: how have changes in financial incentives affected health promotion activity in general practice? , 1995, The British journal of general practice : the journal of the Royal College of General Practitioners.

[56]  Tim Coleman,et al.  Impact of contractual financial incentives on the ascertainment and management of smoking in primary care. , 2007, Addiction.

[57]  Ateev Mehrotra,et al.  Pay for Performance in the Hospital Setting: What Is the State of the Evidence? , 2009, American journal of medical quality : the official journal of the American College of Medical Quality.

[58]  D. Nash,et al.  Pay for Performance: An Overview of the Literature , 2009, American journal of medical quality : the official journal of the American College of Medical Quality.

[59]  A. Rubinstein,et al.  A Multimodal Strategy Based on Pay‐Per‐Performance to Improve Quality of Care of Family Practitioners in Argentina , 2009, The Journal of ambulatory care management.

[60]  Thomas Custers,et al.  Selecting effective incentive structures in health care: A decision framework to support health care purchasers in finding the right incentives to drive performance , 2008, BMC health services research.

[61]  M. Young,et al.  Health services research , 2008, Journal of General Internal Medicine.

[62]  D. Melzer,et al.  Self reported receipt of care consistent with 32 quality indicators: national population survey of adults aged 50 or more in England , 2008, BMJ : British Medical Journal.

[63]  Stephen R Grossbart,et al.  What’s the Return? Assessing the Effect of “Pay-for-Performance” Initiatives on the Quality of Care Delivery , 2006, Medical care research and review : MCRR.

[64]  C. Lebaron,et al.  Changes in clinic vaccination coverage after institution of measurement and feedback in 4 states and 2 cities. , 1999, Archives of pediatrics & adolescent medicine.

[65]  Thomas Bodenheimer,et al.  Organizational factors affecting the adoption of diabetes care management processes in physician organizations. , 2004, Diabetes care.

[66]  R. Town,et al.  Economic incentives for preventive care. , 2004, Evidence report/technology assessment.

[67]  L. Kennedy Impact of a pay-for-performance incentive on support for smoking cessation and on smoking prevalence among people with diabetes , 2008 .

[68]  Colin Simpson,et al.  Effect of the UK Incentive–Based Contract on the Management of Patients With Stroke in Primary Care , 2006, Stroke.

[69]  Karen E McKinley,et al.  “ProvenCareSM”: A Provider-Driven Pay-for-Performance Program for Acute Episodic Cardiac Surgical Care , 2007, Annals of surgery.

[70]  G. Watt,et al.  Practice size and quality attainment under the new GMS contract: a cross-sectional analysis. , 2006, The British journal of general practice : the journal of the Royal College of General Practitioners.

[71]  James C. Robinson,et al.  Theory and practice in the design of physician payment incentives. , 2001, The Milbank quarterly.

[72]  M. Schatz Does pay-for-performance influence the quality of care? , 2008, Current opinion in allergy and clinical immunology.

[73]  G. Fairbrother,et al.  Effect of the vaccines for children program on inner-city neighborhood physicians. , 1997, Archives of pediatrics & adolescent medicine.

[74]  K. Reiter,et al.  The Impact of Pay-for-Performance on Diabetes Care in a Large Network of Community Health Centers , 2007, Journal of health care for the poor and underserved.

[75]  J. Wike,et al.  The Influence of Year-End Bonuses on Colorectal Cancer Screening , 2003, The American journal of managed care.

[76]  R. Fleetcroft,et al.  Do the incentive payments in the new NHS contract for primary care reflect likely population health gains? , 2006, Journal of health services research & policy.

[77]  Tim Doran,et al.  Exclusion of patients from pay-for-performance targets by English physicians. , 2008, The New England journal of medicine.

[78]  Margaret Maglione,et al.  Interventions That Increase Use of Adult Immunization and Cancer Screening Services , 2002, Annals of Internal Medicine.

[79]  Howard Isenstein,et al.  Snapshot of hospital quality reporting and pay-for-performance under Medicare. , 2006, Health affairs.

[80]  K. Khunti,et al.  Competing Interests: AM is Associate Director (Primary Care) of , 2022 .

[81]  S. Weingarten,et al.  Relationship Between Organizational Factors and Performance Among Pay-for-Performance Hospitals , 2009, Journal of General Internal Medicine.

[82]  F. Eijkenaar Pay for Performance in Health Care , 2012, Medical care research and review : MCRR.

[83]  A. Majeed,et al.  Impact of pay for performance on quality of chronic disease management by social class group in England , 2009, Journal of the Royal Society of Medicine.

[84]  H. Slater,et al.  Diabetes care and the new GMS contract: the evidence for a whole county. , 2007, The British journal of general practice : the journal of the Royal College of General Practitioners.

[85]  E. Peterson,et al.  Potential unintended financial consequences of pay-for-performance on the quality of care for minority patients. , 2008, American heart journal.

[86]  A. Ryan Effects of the Premier Hospital Quality Incentive Demonstration on Medicare patient mortality and cost. , 2009, Health services research.

[87]  S. Pocock,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. , 2008, Journal of clinical epidemiology.

[88]  Fang-Shu Ou,et al.  Pay for performance, quality of care, and outcomes in acute myocardial infarction. , 2007, JAMA.

[89]  Anne Frølich,et al.  A behavioral model of clinician responses to incentives to improve quality. , 2007, Health policy.

[90]  Frederick Bloom,et al.  Employing the Electronic Health Record to Improve Diabetes Care: A Multifaceted Intervention in an Integrated Delivery System , 2008, Journal of General Internal Medicine.

[91]  Nicole G Devita,et al.  Impact of Pay-for-Performance Contracts and Network Registry on Diabetes and Asthma HEDIS® Measures in an Integrated Delivery Network , 2006, Medical care research and review : MCRR.

[92]  X. Vidal,et al.  An Intervention to Improve Spontaneous Adverse Drug Reaction Reporting by Hospital Physicians , 2009, Drug safety.

[93]  Marla R. Miller,et al.  Increasing adherence to a community-based guideline for acute sinusitis through education, physician profiling, and financial incentives. , 2004, The American journal of managed care.

[94]  D. Moher,et al.  Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. , 2008, Annals of internal medicine.

[95]  R. Kane,et al.  Economic incentives and physicians' delivery of preventive care: a systematic review. , 2005, American journal of preventive medicine.

[96]  Kristin L. Reiter,et al.  Cost-Effectiveness of Hospital Pay-for-Performance Incentives , 2006, Medical care research and review : MCRR.

[97]  James C. Vertrees,et al.  Redesigning Medicare Inpatient PPS to Adjust Payment for Post-Admission Complications , 2006, Health care financing review.

[98]  S. Pocock,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. , 2007, Preventive medicine.

[99]  N. Black,et al.  The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. , 1998, Journal of epidemiology and community health.

[100]  Milton C Weinstein,et al.  Principles of good practice for decision analytic modeling in health-care evaluation: report of the ISPOR Task Force on Good Research Practices--Modeling Studies. , 2003, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[101]  H. Slater,et al.  Impact of practice size on delivery of diabetes care before and after the Quality and Outcomes Framework implementation. , 2008, The British journal of general practice : the journal of the Royal College of General Practitioners.

[102]  S M Shortell,et al.  Implementing Evidence-Based Medicine: The Role of Market Pressures, Compensation Incentives, and Culture in Physician Organizations , 2001, Medical care.

[103]  P. Seed,et al.  The relationship between social deprivation and the quality of primary care: a national survey using indicators from the UK Quality and Outcomes Framework. , 2007, The British journal of general practice : the journal of the Royal College of General Practitioners.

[104]  P. V. Wilder,et al.  Guidelines for Pharmacoeconomic Evaluations in Belgium , 2008 .

[105]  M. Rosenthal,et al.  What Is the Empirical Basis for Paying for Quality in Health Care? , 2006, Medical care research and review : MCRR.

[106]  L. Sampietro-Colom,et al.  Impact of economic incentives on quality of professional life and on end-user satisfaction in primary care. , 2007, Health policy.

[107]  Sheila Roman,et al.  Public reporting and pay for performance in hospital quality improvement. , 2007, The New England journal of medicine.

[108]  D. Taira,et al.  Patient outcomes and evidence-based medicine in a preferred provider organization setting: a six-year evaluation of a physician pay-for-performance program. , 2007, Health services research.

[109]  D. Safran,et al.  Organizational and market influences on physician performance on patient experience measures. , 2009, Health services research.

[110]  Darcey D. Terris,et al.  Data Quality Bias: An Underrecognized Source of Misclassification in Pay‐for‐Performance Reporting? , 2008, Quality management in health care.

[111]  F M LaForce,et al.  Performance-based physician reimbursement and influenza immunization rates in the elderly. The Primary-Care Physicians of Monroe County. , 1998, American journal of preventive medicine.

[112]  R. Maheswaran,et al.  Socioeconomic deprivation, coronary heart disease prevalence and quality of care: a practice-level analysis in Rotherham using data from the new UK general practitioner Quality and Outcomes Framework. , 2006, Journal of public health.

[113]  J. Herrin,et al.  The effect of health care system administrator pay-for-performance on quality of care. , 2008, Joint Commission journal on quality and patient safety.

[114]  A. Majeed,et al.  Ethnic Disparities in Blood Pressure Management in Patients With Hypertension After the Introduction of Pay for Performance , 2008, The Annals of Family Medicine.

[115]  Steven Towner,et al.  Longitudinal assessment of a diabetes care management system in an integrated health network. , 2003, Journal of managed care pharmacy : JMCP.

[116]  L. An,et al.  A randomized trial of a pay-for-performance program targeting clinician referral to a state tobacco quitline. , 2008, Archives of internal medicine.

[117]  D. Reeves,et al.  Effect of financial incentives on inequalities in the delivery of primary clinical care in England: analysis of clinical activity indicators for the quality and outcomes framework , 2008, The Lancet.

[118]  Robert A. Greene,et al.  Return on Investment in Pay for Performance: A Diabetes Case Study , 2006, Journal of healthcare management / American College of Healthcare Executives.

[119]  M. Rosenthal,et al.  Bridges to Excellence--recognizing high-quality care: analysis of physician quality and resource use. , 2008, The American journal of managed care.

[120]  S. Shortell,et al.  Health promotion in physician organizations: results from a national study. , 2004, American journal of preventive medicine.

[121]  B. Armour,et al.  The effect of explicit financial incentives on physician behavior. , 2001, Archives of internal medicine.

[122]  M. Morgan,et al.  Effect of social deprivation on blood pressure monitoring and control in England: a survey of data from the quality and outcomes framework , 2008, BMJ : British Medical Journal.

[123]  P. Shekelle,et al.  Will changes in primary care improve health outcomes? Modelling the impact of financial incentives introduced to improve quality of care in the UK , 2004, Quality and Safety in Health Care.

[124]  L. Ritchie,et al.  Primary and preschool immunisation in Grampian: progress and the 1990 contract. , 1992, BMJ.

[125]  J. Hippisley-Cox,et al.  Association of deprivation, ethnicity, and sex with quality indicators for diabetes: population based survey of 53,000 patients in primary care. , 2004, BMJ.

[126]  A. Frølich,et al.  Strategies To Support Quality-based Purchasing : A Review of the Evidence , 2004 .

[127]  A. Majeed,et al.  Impact of Pay for Performance on Ethnic Disparities in Intermediate Outcomes for Diabetes: A Longitudinal Study , 2009, Diabetes Care.

[128]  P. Basch Quality of health care delivered to adults in the United States. , 2003, New England Journal of Medicine.

[129]  M. Gulliford,et al.  Population Intermediate Outcomes of Diabetes Under Pay-for-Performance Incentives in England From 2004 to 2008 , 2009, Diabetes Care.

[130]  K. Khunti,et al.  Diabetes prevalence, process of care and outcomes in relation to practice size, caseload and deprivation: national cross-sectional study in primary care. , 2007, Journal of the Royal Society of Medicine.

[131]  Sheila Leatherman,et al.  Lessons From Evaluations of Purchaser Pay-for-Performance Programs , 2008, Medical care research and review : MCRR.

[132]  J. McNeil,et al.  The effects of bonus payments on emergency service performance in Victoria , 2000, The Medical journal of Australia.

[133]  A. Hillman,et al.  The Use of Physician Financial Incentives and Feedback to Improve Pediatric Preventive Care in Medicaid Managed Care , 1999, Pediatrics.

[134]  J. Car,et al.  Practice size, caseload, deprivation and quality of care of patients with coronary heart disease, hypertension and stroke in primary care: national cross-sectional study , 2007, BMC Health Services Research.

[135]  T. Ferris,et al.  Measuring the report card: the validity of pay-for-performance metrics in orthopedic surgery. , 2009, Health affairs.

[136]  Azeem Majeed,et al.  Ethnic Disparities in Coronary Heart Disease Management and Pay for Performance in the UK , 2008, Journal of General Internal Medicine.

[137]  A. Freiberg,et al.  Hospital characteristics associated with success in a pay-for-performance program in orthopaedic surgery. , 2008, The Journal of bone and joint surgery. American volume.

[138]  H. Rubin,et al.  Effect of physician-specific pay-for-performance incentives in a large group practice. , 2010, The American journal of managed care.

[139]  H. Brenner,et al.  Effects of practitioner education, practitioner payment and reimbursement of patients’ drug costs on smoking cessation in primary care: a cluster randomised trial , 2007, Tobacco Control.