Mortality Trends During a Program That Publicly Reported Hospital Performance

Background. It is unclear whether publicly reporting hospitals’ risk-adjusted mortality leads to improvements in outcomes. Objectives. To examine mortality trends during a period (1991–1997) when the Cleveland Health Quality Choice program was operational. Research Design. Time series. Subjects. Medicare patients hospitalized with acute myocardial infarction (AMI; n = 10,439), congestive heart failure (CHF; n = 23,505), gastrointestinal hemorrhage (GIH; n = 11,088), chronic obstructive pulmonary disease (COPD; n = 8495), pneumonia (n = 23,719), or stroke (n = 14,293). Measures. Risk-adjusted in-hospital mortality, early postdischarge mortality (between discharge and 30 days after admission), and 30-day mortality. Results. Risk-adjusted in-hospital mortality declined significantly for all conditions except stroke and GIH, with absolute declines ranging from –2.1% for COPD to –4.8% for pneumonia. However, the mortality rate in the early postdischarge period rose significantly for all conditions except COPD, with increases ranging from 1.4% for GIH to 3.8% for stroke. As a consequence, the 30-day mortality declined significantly only for CHF (absolute decline 1.4%, 95% CI, −2.5 to −0.1%) and COPD (absolute decline 1.6%, 95% CI, −2.8–0.0%). For stroke, risk-adjusted 30-day mortality actually increased by 4.3% (95% CI, 1.8–7.1%). Conclusion. During Cleveland’s experiment with hospital report cards, deaths shifted from in hospital to the period immediately after discharge with little or no net reduction in 30-day mortality for most conditions. Hospital profiling remains an unproven strategy for improving outcomes of care for medical conditions. Using in-hospital mortality rates to monitor trends in outcomes for hospitalized patients may lead to spurious conclusions.

[1]  G. Rosenthal,et al.  Cleveland health quality choice: a model for collaborative community-based outcomes assessment. , 1994, The Joint Commission journal on quality improvement.

[2]  G. Rosenthal,et al.  Declines in Hospital Mortality Associated with a Regional Initiative to Measure Hospital Performance , 1997, American journal of medical quality : the official journal of the American College of Medical Quality.

[3]  Outcomes management: a technology of patient experience. , 1989, The New England journal of medicine.

[4]  E L Hannan,et al.  Improving the outcomes of coronary artery bypass surgery in New York State. , 1994, JAMA.

[5]  C. Sirio,et al.  Cleveland Health Quality Choice (CHQC)--an ongoing collaborative, community-based outcomes assessment program. , 1994, New horizons.

[6]  Jing Fang,et al.  Trend of Stroke Hospitalization, United States, 1988–1997 , 2001, Stroke.

[7]  A. Epstein,et al.  Performance reports on quality--prototypes, problems, and prospects. , 1995, The New England journal of medicine.

[8]  C A Marrin,et al.  A regional intervention to improve the hospital mortality associated with coronary artery bypass graft surgery. The Northern New England Cardiovascular Disease Study Group. , 1996, JAMA.

[9]  D. K. Williams,et al.  Assessing hospital-associated deaths from discharge data. The role of length of stay and comorbidities. , 1988, JAMA.

[10]  Russell L. Stogsdill,et al.  A regional intervention to improve the hospital mortality associated with coronary artery bypass graft surgery. The Northern New England Cardiovascular Disease Study Group. , 1996, JAMA.

[11]  J. Jollis,et al.  Pennsylvania's Focus on Heart Attack--grading the scorecard. , 1998, The New England journal of medicine.

[12]  R H Brook,et al.  The public release of performance data: what do we expect to gain? A review of the evidence. , 2000, JAMA.

[13]  A. Furlan,et al.  Use of tissue-type plasminogen activator for acute ischemic stroke: the Cleveland area experience. , 2000, JAMA.

[14]  J. Pell,et al.  Evidence of Improving Prognosis in Heart Failure: Trends in Case Fatality in 66 547 Patients Hospitalized Between 1986 and 1995 , 2000, Circulation.

[15]  K. Anstrom,et al.  Alabama coronary artery bypass grafting project: results of a statewide quality improvement initiative. , 2001, JAMA.

[16]  L. Iezzoni Risk Adjustment for Measuring Healthcare Outcomes , 1994 .

[17]  S. Reiser,et al.  The era of the patient. Using the experience of illness in shaping the missions of health care. , 1993, JAMA.

[18]  E. Hannan,et al.  Improving the Outcomes of Coronary Artery Bypass Surgery in New York State , 1994 .

[19]  Ellwood Pm,et al.  Shattuck Lecture--outcomes management. A technology of patient experience. 1988. , 1997, Archives of pathology & laboratory medicine.

[20]  B. B. Fleming,et al.  Quality of medical care delivered to Medicare beneficiaries: A profile at state and national levels. , 2000, JAMA.

[21]  D Draper,et al.  Prospective payment system and impairment at discharge. The 'quicker-and-sicker' story revisited. , 1990, JAMA.

[22]  L. Gostin,et al.  National health information privacy: regulations under the Health Insurance Portability and Accountability Act. , 2001, JAMA.

[23]  J. Zhang,et al.  What's the relative risk? A method of correcting the odds ratio in cohort studies of common outcomes. , 1998, JAMA.

[24]  D. Baker,et al.  Relationships between in-hospital and 30-day standardized hospital mortality: implications for profiling hospitals. , 2000, Health services research.

[25]  J. Mohr Thrombolytic therapy for ischemic stroke: from clinical trials to clinical practice. , 2000, JAMA.

[26]  P. Austin,et al.  Investigating the determinants of decreasing postmyocardial infarction mortality: an analysis of in-hospital data from 1992 and 1997. , 2001, The Canadian journal of cardiology.

[27]  R F Anda,et al.  National Trends in the Initial Hospitalization for Heart Failure , 1997, Journal of the American Geriatrics Society.

[28]  E L Hannan,et al.  Benefits and hazards of reporting medical outcomes publicly. , 1996, The New England journal of medicine.

[29]  R. Pokras,et al.  Design and operation of the National Hospital Discharge Survey: 1988 redesign. , 2000, Vital and health statistics. Ser. 1, Programs and collection procedures.

[30]  O. Anderson,et al.  Quality measurement and control in physician decision making: state of the art. , 1982, Health services research.

[31]  E. DeLong,et al.  The effects of New York's bypass surgery provider profiling on access to care and patient outcomes in the elderly. , 1998, Journal of the American College of Cardiology.

[32]  L. Gostin,et al.  Health Services Research: Public Benefits, Personal Privacy, and Proprietary Interests , 1998, Annals of Internal Medicine.

[33]  R. M. Shelton,et al.  Hospital use and mortality among Medicare beneficiaries in Boston and New Haven. , 1989, The New England journal of medicine.

[34]  J. Cleland,et al.  Is the prognosis of heart failure improving? , 2000, European journal of heart failure.

[35]  Robert H. Brook,et al.  Prospective Payment System and Impairment at Discharge , 1990 .

[36]  D Draper,et al.  Comparing outcomes of care before and after implementation of the DRG-based prospective payment system. , 1990, JAMA.