Physician Response to Pay-for-Performance: Evidence from a Natural Experiment

This study exploits a natural experiment in the province of Ontario, Canada, to identify the impact of pay-for-performance (P4P) incentives on the provision of targeted primary care services and whether physicians' responses differ by age, size of patient population, and baseline compliance level. We use administrative data that cover the full population of Ontario and nearly all the services provided by primary care physicians. We employ a difference-in-differences approach that controls for selection on observables and selection on unobservables that may cause estimation bias. We implement a set of robustness checks to control for confounding from other contemporaneous interventions of the primary care reform in Ontario. The results indicate that responses were modest and that physicians responded to the financial incentives for some services but not others. The results provide a cautionary message regarding the effectiveness of employing P4P to increase the quality of health care.

[1]  Martin Emmert,et al.  Economic evaluation of pay-for-performance in health care: a systematic review , 2012, The European Journal of Health Economics.

[2]  A. Scott,et al.  The effect of financial incentives on the quality of health care provided by primary care physicians. , 2011, The Cochrane database of systematic reviews.

[3]  Frank Eijkenaar,et al.  Key issues in the design of pay for performance programs , 2011, The European Journal of Health Economics.

[4]  Evangelos Kontopantelis,et al.  Effect of financial incentives on incentivised and non-incentivised clinical activities: longitudinal analysis of data from the UK Quality and Outcomes Framework , 2011, BMJ : British Medical Journal.

[5]  Fang Zhang,et al.  Effect of pay for performance on the management and outcomes of hypertension in the United Kingdom: interrupted time series study , 2011, BMJ : British Medical Journal.

[6]  A. D. Elster Radiologist Report Turnaround Time: Impact of Pay-for-Performance Measures , 2011 .

[7]  J. Hurley,et al.  The Response of Ontario Primary Care Physicians to Pay-for-Performance Incentives , 2011 .

[8]  B. Saver,et al.  Effect of Financial Incentives on Improvement in Medical Quality Indicators for Primary Care , 2010, The Journal of the American Board of Family Medicine.

[9]  J. Selby,et al.  The impact of removing financial incentives from clinical quality indicators: longitudinal analysis of four Kaiser Permanente indicators , 2010, British medical journal.

[10]  M. Roland,et al.  Lessons from major initiatives to improve primary care in the United Kingdom. , 2010, Health affairs.

[11]  H. Rubin,et al.  Effect of physician-specific pay-for-performance incentives in a large group practice. , 2010, The American journal of managed care.

[12]  H. Gravelle,et al.  Doctor Behaviour Under a Pay for Performance Contract: Treating, Cheating and Case Finding? , 2010 .

[13]  Kathleen J. Mullen,et al.  Can You Get What You Pay For? Pay-for-Performance and the Quality of Healthcare Providers , 2009, The Rand journal of economics.

[14]  Bruce Guthrie,et al.  Record rewards: the effects of targeted quality incentives on the recording of risk factors by primary care providers. , 2009, Health economics.

[15]  B. Sibbald,et al.  Effects of pay for performance on the quality of primary care in England. , 2009, The New England journal of medicine.

[16]  S. Lewis Pay for performance: the wrong time, the wrong place? , 2009, Healthcare quarterly.

[17]  Jonathan Richards Is there an elephant in the room? , 2009, The British journal of general practice : the journal of the Royal College of General Practitioners.

[18]  Adam Wagstaff,et al.  Europe and central Asia's great post-communist social health insurance experiment: Aggregate impacts on health sector outcomes. , 2009, Journal of health economics.

[19]  M. Gulliford,et al.  Population Intermediate Outcomes of Diabetes Under Pay-for-Performance Incentives in England From 2004 to 2008 , 2009, Diabetes Care.

[20]  Sheila Leatherman,et al.  Lessons From Evaluations of Purchaser Pay-for-Performance Programs , 2008, Medical care research and review : MCRR.

[21]  L. An,et al.  A randomized trial of a pay-for-performance program targeting clinician referral to a state tobacco quitline. , 2008, Archives of internal medicine.

[22]  B. Hutchison Pay for performance in primary care: proceed with caution, pitfalls ahead. , 2008, Healthcare policy = Politiques de sante.

[23]  Janice A Singer,et al.  The impact of pay-for-performance on health care quality in Massachusetts, 2001-2003. , 2008, Health affairs.

[24]  A. Maynard Payment for Performance ( P 4 P ) : International experience and a cautionary proposal for Estonia , 2008 .

[25]  K. Reiter,et al.  The Impact of Pay-for-Performance on Diabetes Care in a Large Network of Community Health Centers , 2007, Journal of health care for the poor and underserved.

[26]  M. Stebbins,et al.  Evaluation of the Relationship Between a Chronic Disease Care Management Program and California Pay-for-Performance Diabetes Care Cholesterol Measures in One Medical Group , 2007, Journal of managed care pharmacy : JMCP.

[27]  Evangelos Kontopantelis,et al.  Quality of primary care in England with the introduction of pay for performance. , 2007, The New England journal of medicine.

[28]  Gilbert Gimm,et al.  Making pay-for-performance work in Medicaid. , 2007, Health affairs.

[29]  U. Kotagal,et al.  Pay for performance alone cannot drive quality. , 2007, Archives of pediatrics & adolescent medicine.

[30]  A. Majeed,et al.  Impact of a pay-for-performance incentive on support for smoking cessation and on smoking prevalence among people with diabetes , 2007, Canadian Medical Association Journal.

[31]  Robert Fleetcroft,et al.  Quality of clinical primary care and targeted incentive payments: an observational study. , 2007, The British journal of general practice : the journal of the Royal College of General Practitioners.

[32]  Stephen G. Donald,et al.  Inference with Difference-in-Differences and Other Panel Data , 2007, The Review of Economics and Statistics.

[33]  Gary J. Young,et al.  Effects of Paying Physicians Based on their Relative Performance for Quality , 2007, Journal of General Internal Medicine.

[34]  L. Sandy,et al.  Pay for performance in commercial HMOs. , 2007, The New England journal of medicine.

[35]  M. Rosenthal,et al.  Pay-for-performance: will the latest payment trend improve care? , 2007, JAMA.

[36]  H. Brenner,et al.  Effects of practitioner education, practitioner payment and reimbursement of patients’ drug costs on smoking cessation in primary care: a cluster randomised trial , 2007, Tobacco Control.

[37]  Anne Frølich,et al.  A behavioral model of clinician responses to incentives to improve quality. , 2007, Health policy.

[38]  Laura Petersen,et al.  Does Pay-for-Performance Improve the Quality of Health Care? , 2006, Annals of Internal Medicine.

[39]  Evangelos Kontopantelis,et al.  Pay-for-performance programs in family practices in the United Kingdom. , 2006, The New England journal of medicine.

[40]  A. Epstein Paying for performance in the United States and abroad. , 2006, The New England journal of medicine.

[41]  M. Rosenthal,et al.  What Is the Empirical Basis for Paying for Quality in Health Care? , 2006, Medical care research and review : MCRR.

[42]  Nicole G Devita,et al.  Impact of Pay-for-Performance Contracts and Network Registry on Diabetes and Asthma HEDIS® Measures in an Integrated Delivery Network , 2006, Medical care research and review : MCRR.

[43]  J. Stockmaniii Early Experience With Pay-For-Performance: From Concept to Practice , 2006 .

[44]  M. Rosenthal,et al.  Early experience with pay-for-performance: from concept to practice. , 2005, JAMA.

[45]  Nancy Dean Beaulieu,et al.  Putting smart money to work for quality improvement. , 2005, Health services research.

[46]  R. Blundell,et al.  Evaluation Methods for Non‐Experimental Data , 2005 .

[47]  R. Kane,et al.  Economic incentives and physicians' delivery of preventive care: a systematic review. , 2005, American journal of preventive medicine.

[48]  Karen Eggleston,et al.  Multitasking and mixed systems for provider payment. , 2005, Journal of health economics.

[49]  Jon B Christianson,et al.  Penetrating the “Black Box”: Financial Incentives for Enhancing the Quality of Physician Services , 2004, Medical care research and review : MCRR.

[50]  D. Wholey,et al.  Assessing the Influence of Incentives on Physicians and Medical Groups , 2004, Medical care research and review : MCRR.

[51]  A. Frølich,et al.  Strategies To Support Quality-based Purchasing : A Review of the Evidence , 2004 .

[52]  Yujing Shen,et al.  Selection incentives in a performance-based contracting system. , 2003, Health services research.

[53]  Shu-Hong Zhu,et al.  The impact of financial incentives and a patient registry on preventive care quality: increasing provider adherence to evidence-based smoking cessation practice guidelines. , 2003, Preventive medicine.

[54]  L. Solberg,et al.  Paying for quality improvement: compliance with tobacco cessation guidelines. , 2003, Joint Commission journal on quality and safety.

[55]  Jonathan Haughton,et al.  Market Dynamics and Business Process Pay for Performance Incentive Programs in Healthcare , 2003 .

[56]  Jeffrey M. Woodbridge Econometric Analysis of Cross Section and Panel Data , 2002 .

[57]  E. Duflo,et al.  How Much Should We Trust Differences-in-Differences Estimates? , 2001 .

[58]  P. Kory,et al.  Impact of financial incentives on documented immunization rates in the inner city: results of a randomized controlled trial. , 2001, Ambulatory pediatrics : the official journal of the Ambulatory Pediatric Association.

[59]  James C. Robinson,et al.  Theory and practice in the design of physician payment incentives. , 2001, The Milbank quarterly.

[60]  B. Armour,et al.  The effect of explicit financial incentives on physician behavior. , 2001, Archives of internal medicine.

[61]  A. Scott,et al.  Eliciting GPs' preferences for pecuniary and non-pecuniary job characteristics. , 2001, Journal of health economics.

[62]  B Leese,et al.  Impact of payment method on behaviour of primary care physicians: a systematic review , 2001, Journal of health services research & policy.

[63]  B Leese,et al.  Capitation, salary, fee-for-service and mixed systems of payment: effects on the behaviour of primary care physicians. , 2000, The Cochrane database of systematic reviews.

[64]  A. Hillman,et al.  The Use of Physician Financial Incentives and Feedback to Improve Pediatric Preventive Care in Medicaid Managed Care , 1999, Pediatrics.

[65]  R. Blundell,et al.  Getting the Unemployed Back to Work: The Role of Targeted Wage Subsidies , 1999 .

[66]  Canice Prendergast The Provision of Incentives in Firms , 1999 .

[67]  G. Fairbrother,et al.  The impact of physician bonuses, enhanced fees, and feedback on childhood immunization coverage rates. , 1999, American journal of public health.

[68]  A. Hillman,et al.  Physician financial incentives and feedback: failure to increase cancer screening in Medicaid managed care. , 1998, American journal of public health.

[69]  F M LaForce,et al.  Performance-based physician reimbursement and influenza immunization rates in the elderly. The Primary-Care Physicians of Monroe County. , 1998, American journal of preventive medicine.

[70]  J. Lemkau,et al.  Enhancing mammography referral in primary care. , 1997, Preventive medicine.

[71]  Petra E. Todd,et al.  Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme , 1997 .

[72]  F. W. Derrick,et al.  Physician behavioral response to a Medicare price reduction. , 1997, Health services research.

[73]  A. Shiell,et al.  Do fee descriptors influence treatment choices in general practice? A multilevel discrete choice model. , 1997, Journal of health economics.

[74]  J Hurley,et al.  Defining the practice population in fee-for-service practice. , 1997, Health services research.

[75]  Thomas G. McGuire,et al.  Optimal Health Insurance and Provider Payment , 1997 .

[76]  J Hurley,et al.  Do physician-payment mechanisms affect hospital utilization? A study of Health Service Organizations in Ontario. , 1996, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[77]  J. Newhouse Reimbursing Health Plans and Health Providers: Efficiency in Production versus Selection , 1996 .

[78]  Bruce D. Meyer Natural and Quasi- Experiments in Economics , 1994 .

[79]  G. Baker Incentive Contracts and Performance Measurement , 1992, Journal of Political Economy.

[80]  Å. Blomqvist,et al.  The doctor as double agent: information asymmetry, health insurance, and medical care. , 1991, Journal of health economics.

[81]  M. Pauly,et al.  Physician response to fee changes with multiple payers. , 1991, Journal of health economics.

[82]  Scholten,et al.  Changing remuneration systems: effects on activity in general practice. , 1990, BMJ.

[83]  Brent R. Moulton An Illustration of a Pitfall in Estimating the Effects of Aggregate Variables on Micro Unit , 1990 .

[84]  T. Mcguire,et al.  Optimal payment systems for health services. , 1990, Journal of health economics.

[85]  J. Hurley,et al.  The relationship between physician fees and the utilization of medical services in Ontario. , 1990, Advances in health economics and health services research.

[86]  W A Altemeier,et al.  Physician reimbursement by salary or fee-for-service: effect on physician practice behavior in a randomized prospective study. , 1987, Pediatrics.

[87]  J. Samet,et al.  Doctors' decisions and the cost of medical care: By John M. Eisenberg. Health Administration Press, Ann Arbor, Mich., 1986. 190 pp. No price given , 1987 .

[88]  Brent R. Moulton Random group effects and the precision of regression estimates , 1986 .

[89]  J. Eisenberg Doctors''Decisions and the Cost of Medical Care , 1986 .

[90]  J. Eisenberg,et al.  Physician Utilization: The State of Research About Physicians’ Practice Patterns , 1985, Medical care.

[91]  B. Barnes,et al.  Professional uncertainty and the problem of supplier-induced demand. , 1982, Social science & medicine.

[92]  Joseph E. Stiglitz,et al.  Incentives and Risk Sharing in Sharecropping , 1974 .