The Effect of a Quality Improvement Initiative on the Quality of Other Aspects of Health Care: The Law of Unintended Consequences?

Problem:Policymakers and clinicians are concerned that initiatives to improve the quality of care for some conditions may have unintended negative consequences for quality in other conditions. Objective:We sought to determine whether a practice redesign intervention that improved care for falls, incontinence, and cognitive impairment by an absolute 15% change also affected quality of care for masked conditions (conditions not targeted by the intervention). Design, Setting, and Participants:Controlled trial in 2 community medical groups, with 357 intervention and 287 control patients age 75 years or older who had difficulty with falls, incontinence, or cognitive impairment. Intervention:Both intervention and control practices implemented case-finding for target conditions, but only intervention practices received a multicomponent practice-change intervention. Quality of care in the intervention practices improved for 2 of the target conditions (falls and incontinence). Main Outcome Measures:Percent of quality indicators satisfied for a set of 9 masked conditions measured by abstraction of medical records. Results:Before the intervention, the overall percent of masked indicators satisfied was 69% in the intervention group and 67% in the control group. During the intervention period, these percentages did not change, and there was no difference between intervention and control groups for the change in quality between the 2 periods (P = 0.86). The intervention minus control difference-in-change for the percent of masked indicators satisfied was 0.2% (bootstrapped 95% confidence interval, −2.7% to 2.9%). Subgroup analyses by clinical condition and by type of care process performed by the clinician did not show consistent results favoring either the intervention or the control group. Conclusion:A practice-based intervention that improved quality of care for targeted conditions by an absolute 15% change did not affect measurable aspects of care on a broad set of masked quality measures encompassing 9 other conditions.

[1]  L. Chambers,et al.  A Randomized Trial of Quality Assurance in Nursing Homes , 1988, Medical care.

[2]  Peter C Smith,et al.  On the unintended consequences of publishing performance data in the public sector , 1995 .

[3]  R. Fleetcroft,et al.  Do the incentive payments in the new NHS contract for primary care reflect likely population health gains? , 2006, Journal of health services research & policy.

[4]  Eric M. Liederman,et al.  Patient-physician web messaging , 2007, Journal of General Internal Medicine.

[5]  T. Chow,et al.  Quality Indicators for Dementia in Vulnerable Community-Dwelling and Hospitalized Elders , 2001, Annals of Internal Medicine.

[6]  P. Shekelle,et al.  The Vulnerable Elders Survey: A Tool for Identifying Vulnerable Older People in the Community , 2001, Journal of the American Geriatrics Society.

[7]  C. Powers,et al.  Quality Indicators for the Management and Prevention of Falls and Mobility Problems in Vulnerable Elders , 2001, Annals of Internal Medicine.

[8]  J. Cummings,et al.  Appropriateness of Quality Indicators for Older Patients with Advanced Dementia and Poor Prognosis , 2003, Journal of the American Geriatrics Society.

[9]  P. Shekelle,et al.  Assessing Care of Vulnerable Elders: ACOVE Project Overview , 2001, Annals of Internal Medicine.

[10]  Robert M Wachter,et al.  Expected and unanticipated consequences of the quality and information technology revolutions. , 2006, JAMA.

[11]  Martin Marshall,et al.  Impact of star performance ratings in English acute hospital trusts , 2005, Journal of health services research & policy.

[12]  R. Wachter,et al.  The unintended consequences of measuring quality on the quality of medical care. , 2000, The New England journal of medicine.

[13]  Carol Roth,et al.  Restructuring Primary Care Practices to Manage Geriatric Syndromes: The ACOVE‐2 Intervention , 2003, Journal of the American Geriatrics Society.

[14]  D. Asch,et al.  Racial Profiling: The Unintended Consequences of Coronary Artery Bypass Graft Report Cards , 2005, Circulation.

[15]  J. Schnelle,et al.  Quality Indicators for the Management of Urinary Incontinence in Vulnerable Community-Dwelling Elders , 2001, Annals of Internal Medicine.

[16]  P. Shekelle,et al.  The Quality of Medical Care Provided to Vulnerable Community-Dwelling Older Patients , 2003, Annals of Internal Medicine.

[17]  D. Asch,et al.  The unintended consequences of publicly reporting quality information. , 2005, JAMA.

[18]  P. Shekelle,et al.  Comparison of Quality of Care for Patients in the Veterans Health Administration and Patients in a National Sample , 2004, Annals of Internal Medicine.

[19]  H. Davies,et al.  How do we maximize the impact of the public reporting of quality of care? , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[20]  T. A. May,et al.  Unintended consequences of a quality improvement program designed to improve treatment of alcohol withdrawal in hospitalized patients. , 2005, Joint Commission journal on quality and patient safety.

[21]  D. Mechanic,et al.  Are patients' office visits with physicians getting shorter? , 2001, The New England journal of medicine.