The Mismeasurement of Quality by Readmission Rate: How Blunt Is too Blunt an Instrument? A Quantitative Bias Analysis

Background:The rate of readmission is widely used as a measure of hospital quality of care, often with funding implications for outlying facilities. Objectives:This study explored the plausibility of readmission as a proxy for health care quality with quantitative bias analysis and the application of a structural Directed Acyclic Graph framework. It applies this paradigm to observed ethnic differences in the odds of readmission in a sample of New Zealand hospital patients. Research Design:Ethnicity was defined as the exposure, readmission rate as the proxy outcome, and quality of care as a missing mediator. Using data from 89,090 surgical patients from New Zealand, and estimates from the literature of the prevalence of “poor quality” and the strength of the quality-of-care readmission association, a series of sensitivity analyses were performed to calculate an odds ratio of the ethnicity-readmission association corrected for the missing mediator “quality.” Results:Given the assumptions applied, potentially only 29% of the excess odds of readmission for Māori compared with Europeans were due to poor quality of care. Conclusions:This investigation finds substantial error when using readmission as a marker of quality, and suggests that differences in readmission between populations are more likely to be due to factors other than quality of care.

[1]  G. Stevens,et al.  Ethnic Differences in the Management of Lung Cancer in New Zealand , 2008, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[2]  T. Blakely,et al.  Ethnic disparities in the quality of hospital care in New Zealand, as measured by 30-day rate of unplanned readmission/death. , 2013, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[3]  Robert Sherrick,et al.  Who is at greatest risk for receiving poor-quality health care? , 2006, The New England journal of medicine.

[4]  J. Rumball-Smith Not in my hospital? Ethnic disparities in quality of hospital care in New Zealand: a narrative review of the evidence. , 2009, The New Zealand medical journal.

[5]  J. W. Thomas Does risk-adjusted readmission rate provide valid information on hospital quality? , 1996, Inquiry : a journal of medical care organization, provision and financing.

[6]  Timothy L. Lash,et al.  Applying Quantitative Bias Analysis to Epidemiologic Data , 2009, Statistics for Biology and Health.

[7]  A Clarke,et al.  Measuring readmission rates. , 1990, BMJ.

[8]  J. Benbassat,et al.  Hospital readmissions as a measure of quality of health care: advantages and limitations. , 2000, Archives of internal medicine.

[9]  L. McMahon,et al.  Measuring Hospital Performance: The Development and Validation of Risk-Adjusted Indexes of Mortality, Readmissions, and Complications , 1990, Medical care.

[10]  C. Ashton,et al.  A conceptual framework for the study of early readmission as an indicator of quality of care. , 1996, Social science & medicine.

[11]  J. García-Alegría,et al.  Readmission rate as an indicator of hospital performance: The case of Spain , 2004, International Journal of Technology Assessment in Health Care.

[12]  C. Mackenzie,et al.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. , 1987, Journal of chronic diseases.

[13]  R J Panzer,et al.  Hospital readmissions and quality of care. , 1991, The American journal of medicine.

[14]  T. Heggestad,et al.  Measuring readmissions: focus on the time factor. , 2003, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[15]  J. Pearl,et al.  Causal diagrams for epidemiologic research. , 1999, Epidemiology.

[16]  Sander Greenland,et al.  Bias Analysis , 2011, International Encyclopedia of Statistical Science.

[17]  P. Austin,et al.  Proportion of hospital readmissions deemed avoidable: a systematic review , 2011, Canadian Medical Association Journal.

[18]  A. Sporle,et al.  Quality of hospital care for Māori patients in New Zealand: retrospective cross-sectional assessment , 2006, The Lancet.

[19]  Alan J. Forster,et al.  Incidence of potentially avoidable urgent readmissions and their relation to all-cause urgent readmissions , 2011, Canadian Medical Association Journal.

[20]  G. Shaw,et al.  Maternal pesticide exposure from multiple sources and selected congenital anomalies. , 1999 .

[21]  C M Ashton,et al.  The association between the quality of inpatient care and early readmission: a meta-analysis of the evidence. , 1997, Medical care.

[22]  T. Blakely,et al.  Ethnicity and management of colon cancer in New Zealand , 2010, Cancer.

[23]  Sander Greenland,et al.  Causal Diagrams , 2011, International Encyclopedia of Statistical Science.

[24]  Jonathan A C Sterne,et al.  The impact of residual and unmeasured confounding in epidemiologic studies: a simulation study. , 2007, American journal of epidemiology.