Survival curves to support quality improvement in hospitals with excess 30-day mortality after acute myocardial infarction, cerebral stroke and hip fracture: a before–after study

Objectives To evaluate survival curves (Kaplan-Meier) as a means of identifying areas in the clinical pathway amenable to quality improvement. Design Observational before–after study. Setting In Norway, annual public reporting of nationwide 30-day in-and-out-of-hospital mortality (30D) for three medical conditions started in 2011: first time acute myocardial infarction (AMI), stroke and hip fracture; reported for 2009. 12 of 61 hospitals had statistically significant lower/higher mortality compared with the hospital mean. Participants Three hospitals with significantly higher mortality requested detailed analyses for quality improvement purposes: Telemark Hospital Trust Skien (AMI and stroke), Østfold Hospital Trust Fredrikstad (stroke), Innlandet Hospital Trust Gjøvik (hip fracture). Outcome measures Survival curves, crude and risk-adjusted 30D before (2008–2009) and after (2012–2013). Interventions Unadjusted survival curves for the outlier hospitals were compared to curves based on pooled data from the other hospitals for the 30-day period 2008–2009. For patients admitted with AMI (Skien), stroke (Fredrikstad) and hip fracture (Gjøvik), the curves suggested increased mortality from the initial part of the clinical pathway. For stroke (Skien), increased mortality appeared after about 8 days. The curve profiles were thought to reflect suboptimal care in various phases in the clinical pathway. This informed improvement efforts. Results For 2008–2009, hospital-specific curves differed from other hospitals: borderline significant for AMI (p=0.064), highly significant (p≤0.005) for the remainder. After intervention, no difference was found (p>0.188). Before–after comparison of the curves within each hospital revealed a significant change for Fredrikstad (p=0.006). For the three hospitals, crude 30D declined and they were non-outliers for risk-adjusted 30D for 2013. Conclusions Survival curves as a supplement to 30D may be useful for identifying suboptimal care in the clinical pathway, and thus informing design of quality improvement projects.

[1]  G. Hankey,et al.  Stroke Unit Care Benefits Patients With Intracerebral Hemorrhage: Systematic Review and Meta-analysis , 2013, Stroke.

[2]  Bing Li,et al.  Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. , 2011, American journal of epidemiology.

[3]  P. Laake,et al.  Comparing hospital mortality – how to count does matter for patients hospitalized for acute myocardial infarction (AMI), stroke and hip fracture , 2012, BMC Health Services Research.

[4]  C. Chiosi,et al.  At a glance , 2003, Nature.

[5]  Kathryn M. McDonald,et al.  DEVELOPMENT OF NEW HARM-BASED WEIGHTING APPROACH TO COMPOSITE INDICATORS: THE AGENCY FOR HEALTHCARE RESEARCH AND QUALITY PATIENT SAFETY FOR SELECTED INDICATORS (AHRQ PSI-90) , 2015 .

[6]  P. Gulbrandsen,et al.  Methodological development and evaluation of 30-day mortality as quality indicator for Norwegian hospitals , 2005 .

[7]  Jeroen J. Bax,et al.  ESC Guidelines for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation , 2012 .

[8]  Refik Saskin,et al.  Introduction of surgical safety checklists in Ontario, Canada. , 2014, The New England journal of medicine.

[9]  D. Harrington.  A class of rank test procedures for censored survival data , 1982 .

[10]  A. Sussman,et al.  When Things Go Wrong: The Impact of Being a Statistical Outlier in Publicly Reported Coronary Artery Bypass Graft Surgery Mortality Data , 2008, American journal of medical quality : the official journal of the American College of Medical Quality.

[11]  Jan Mainz,et al.  National quality measurement using clinical indicators: The danish national indicator project , 2009, Journal of surgical oncology.

[12]  Association Between Stroke Center Hospitalization for Acute Ischemic Stroke and Mortality , 2012 .

[13]  B. Bridgewater,et al.  NHS transparency , 2013, BMJ.

[14]  R. Dubois.  Inherent limitations of hospital death rates to assess quality. , 1990, International journal of technology assessment in health care.

[15]  Baris Gencer,et al.  ESC Guidelines for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation , 2011 .

[16]  C. Dyer.  Bristol inquiry , 2001, BMJ : British Medical Journal.

[17]  R. Mannion,et al.  Public disclosure of comparative clinical performance data: lessons from the Scottish experience. , 2003, Journal of evaluation in clinical practice.

[18]  E. Kaplan,et al.  Nonparametric Estimation from Incomplete Observations , 1958 .

[19]  Mel Sheddon.  Robert Francis Inquiry report into Mid-Staffordshire NHS Foundation Trust , 2010 .

[20]  Marie Schmidt,et al.  HEAL TH AT A GLANCE , 2007 .

[21]  R. Perla,et al.  Measuring Hospital-Wide Mortality—Pitfalls and Potential , 2016, Journal for healthcare quality : official publication of the National Association for Healthcare Quality.

[22]  D. Atar,et al.  ESC Guidelines for the Management of Acute Myocardial Infarction in Patients Presenting With ST-Segment Elevation , 2013 .

[23]  John Wright,et al.  Learning from Death: A Hospital Mortality Reduction Programme , 2006, Journal of the Royal Society of Medicine.

[24]  Dana B. Mukamel,et al.  Impact of the Present-on-Admission Indicator on Hospital Quality Measurement: Experience With the Agency for Healthcare Research and Quality (AHRQ) Inpatient Quality Indicators , 2008, Medical care.

[25]  K. Hillman,et al.  Do large-scale hospital- and system-wide interventions improve patient outcomes: a systematic review , 2014, BMC Health Services Research.

[26]  Bert Meijboom,et al.  Using quality indicators to improve hospital care: a review of the literature. , 2009, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[27]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[28]  L. Neyses,et al.  Kardiologische Aspekte der präoperativen Risikostratifizierung , 2011 .

[29]  G. Teasdale.  Learning from Bristol: report of the public inquiry into children's heart surgery at Bristol Royal Infirmary 1984-1995 , 2002, British journal of neurosurgery.

[30]  L I Iezzoni,et al.  Explaining differences in English hospital death rates using routinely collected data , 1999, BMJ.

[31]  R. Mendler,et al.  In safe hands , 2008, IEEE Industry Applications Magazine.

[32]  C. Dyer.  Bristol inquiry condemns hospital's "club culture". , 2001, British medical journal.

[33]  C. Vincent,et al.  The role of hospital managers in quality and patient safety: a systematic review , 2014, BMJ Open.

[34]  Steve Bhimji,et al.  Agency for Healthcare Research and Quality (AHRQ) , 2015 .

[35]  J. Neely,et al.  A practical guide to understanding Kaplan-Meier curves , 2010, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[36]  Jeroen J. Bax,et al.  2015 ESC Guidelines for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation: Task Force for the Management of Acute Coronary Syndromes in Patients Presenting without Persistent ST-Segment Elevation of the European Society of Cardiology (ESC). , 2011, European heart journal.

[37]  Andrew Carson-Stevens,et al.  Recommendations for evaluation of health care improvement initiatives. , 2013, Academic pediatrics.

[38]  H. Luft,et al.  Use of risk-adjusted outcome data for quality improvement by public hospitals. , 1996, The Western journal of medicine.

[39]  E. DeLong,et al.  Comparing risk-adjustment methods for provider profiling. , 1998, Statistics in medicine.

[40]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[41]  David W. Hosmer,et al.  Applied Survival Analysis: Regression Modeling of Time-to-Event Data , 2008 .

[42]  O. Rønning,et al.  Factors related to knowledge of stroke symptoms and risk factors in a norwegian stroke population. , 2014, Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association.

[43]  David J Spiegelhalter,et al.  Accounting for regression‐to‐the‐mean in tests for recent changes in institutional performance: Analysis and power , 2009, Statistics in medicine.

[44]  Alex Bottle,et al.  Strengths and weaknesses of hospital standardised mortality ratios , 2010, BMJ : British Medical Journal.