Variation in Performance of Neonatal Intensive Care Units in the United States

Importance Hospitals use rates from the best quartile or decile as benchmarks for quality improvement aims, but to what extent these aims are achievable is uncertain. Objective To determine the proportion of neonatal intensive care units (NICUs) in 2014 that achieved rates for death and major morbidities as low as the shrunken adjusted rates from the best quartile and decile in 2005 and the time it took to achieve those rates. Design, Setting, and Participants A total of 408 164 infants with a birth weight of 501 to 1500 g born from January 1, 2005, to December 31, 2014, and cared for at 756 Vermont Oxford Network member NICUs in the United States were evaluated. Logistic regression models with empirical Bayes factors were used to estimate standardized morbidity ratios for each NICU. Each ratio was multiplied by the overall network rate to calculate the 10th, 25th, 50th, 75th, and 90th percentiles of the shrunken adjusted rates for each year. The proportion in 2014 that achieved the 10th and 25th percentile rates from 2005 and the number of years it took for 75% of NICUs to achieve the 2005 rates from the best quartile were estimated. Main Outcomes and Measures Death prior to hospital discharge, infection more than 3 days after birth, severe retinopathy of prematurity, severe intraventricular hemorrhage, necrotizing enterocolitis, and chronic lung disease among infants less than 33 weeks’ gestational age at birth. Results Of the 756 hospitals, 695 provided data for 2014. The mean unadjusted infant-level rate of death before hospital discharge decreased from 14.0% in 2005 to 10.9% in 2014. In 2014, 689 of 695 NICUs (99.1%; 95% CI, 97.4%-100.0%) achieved the 2005 shrunken adjusted rates from the best quartile for death prior to discharge, 678 of 695 (97.6%; 95% CI, 95.8%-99.6%) for late-onset infection, 558 of 681 (81.9%; 95% CI, 77.2%-86.6%) for severe retinopathy of prematurity, 611 of 693 (88.2%; 95% CI, 81.7%-97.0%) for severe intraventricular hemorrhage, 529 of 696 (76.0%; 95% CI, 71.8%-81.2%) for necrotizing enterocolitis, and 286 of 693 (41.3%; 95% CI, 36.1%-45.6%) for chronic lung disease. It took 3 years before 445 NICUs (75.0%) achieved the 2005 shrunken adjusted rate from the best quartile for death prior to discharge, 5 years to achieve the rate from the best quartile for late-onset infection, 6 years to achieve the rate from the best quartile for severe retinopathy of prematurity and severe intraventricular hemorrhage, and 8 years to achieve the rate from the best quartile for necrotizing enterocolitis. Conclusions and Relevance From 2005 to 2014, rates of death prior to discharge and serious morbidities decreased among the NICUs in this study. Within 8 years, 75% of NICUs achieved rates of performance from the best quartile of the 2005 benchmark for all outcomes except chronic lung disease. These findings provide a novel way to quantify the magnitude and pace of improvement in neonatology.

[1]  J. Gould,et al.  Nosocomial Infection Reduction in VLBW Infants With a Statewide Quality-Improvement Model , 2011, Pediatrics.

[2]  P. Rosenbaum,et al.  The Hospital Compare mortality model and the volume-outcome relationship. , 2010, Health services research.

[3]  Bradley P. Carlin,et al.  Bayesian Methods for Data Analysis , 2008 .

[4]  Jeffrey D Horbar,et al.  The Vermont Oxford Network: a community of practice. , 2010, Clinics in perinatology.

[5]  L. Provost,et al.  Reducing Central Line–Associated Bloodstream Infections in North Carolina NICUs , 2013, Pediatrics.

[6]  B. Poindexter,et al.  Trends in Care Practices, Morbidity, and Mortality of Extremely Preterm Neonates, 1993-2012. , 2015, JAMA.

[7]  Assuring Healthy Outcomes,et al.  Preterm Birth : Causes , Consequences , and Prevention , 2005 .

[8]  M. Walsh,et al.  Ohio Statewide Quality-Improvement Collaborative to Reduce Late-Onset Sepsis in Preterm Infants , 2011, Pediatrics.

[9]  A. Salvator,et al.  Maternal psychological distress and parenting stress after the birth of a very low-birth-weight infant. , 1999, JAMA.

[10]  D. Roberts,et al.  Antenatal Corticosteroids for Accelerating Fetal Lung Maturation for Women at Risk of Preterm Birth , 2007, The Cochrane database of systematic reviews.

[11]  P. Pronovost,et al.  An intervention to decrease catheter-related bloodstream infections in the ICU. , 2006, The New England journal of medicine.

[12]  L. Papile,et al.  Incidence and evolution of subependymal and intraventricular hemorrhage: a study of infants with birth weights less than 1,500 gm. , 1978, The Journal of pediatrics.

[13]  P. Plsek Quality improvement methods in clinical medicine. , 1999, Pediatrics.

[14]  S. Normand,et al.  When less is more: using shrinkage to increase accuracy. , 2010, Annals of emergency medicine.

[15]  P. Plsek,et al.  Collaborative quality improvement to promote evidence based surfactant for preterm infants: a cluster randomised trial , 2004, BMJ : British Medical Journal.

[16]  S. Kauffman,et al.  Searching the Clinical Fitness Landscape , 2012, PloS one.

[17]  A. Spitzer,et al.  A Multifaceted Approach to Improving Outcomes in the NICU: The Pediatrix 100 000 Babies Campaign , 2016, Pediatrics.

[18]  G. Badger,et al.  Mortality and Neonatal Morbidity Among Infants 501 to 1500 Grams From 2000 to 2009 , 2012, Pediatrics.

[19]  P. Sharek,et al.  A Quality Improvement Project to Increase Breast Milk Use in Very Low Birth Weight Infants , 2012, Pediatrics.

[20]  B. Schmidt,et al.  Impact of bronchopulmonary dysplasia, brain injury, and severe retinopathy on the outcome of extremely low-birth-weight infants at 18 months: results from the trial of indomethacin prophylaxis in preterms. , 2003, JAMA.

[21]  B. Schmidt,et al.  Bronchopulmonary dysplasia: NHLBI Workshop on the Primary Prevention of Chronic Lung Diseases. , 2014, Annals of the American Thoracic Society.

[22]  R. Gibberd,et al.  Analysing differences in clinical outcomes between hospitals , 2003, Quality & safety in health care.

[23]  Paul J Sharek,et al.  NICU Practices and Outcomes Associated With 9 Years of Quality Improvement Collaboratives , 2010, Pediatrics.

[24]  Y. MacNab,et al.  Improving the quality of care for infants: a cluster randomized controlled trial , 2009, Canadian Medical Association Journal.

[25]  B. Vohr,et al.  Neurodevelopmental and growth impairment among extremely low-birth-weight infants with neonatal infection. , 2004, JAMA.

[26]  Marlene R. Miller,et al.  Reducing PICU Central Line–Associated Bloodstream Infections: 3-Year Results , 2011, Pediatrics.

[27]  Anna L. Ells,et al.  The International Classification of Retinopathy of Prematurity revisited. , 2005, Archives of ophthalmology.

[28]  Stark Ar 超出生体重児に対する早期デキサメサゾン投与の有用性 : National Institute of Child Health and Human Development Neonatal research Network報告 (海外誌掲載論文の和文概要とそれに対するコメント) , 2001 .

[29]  L. Saiman,et al.  Statewide NICU Central-Line-Associated Bloodstream Infection Rates Decline After Bundles and Checklists , 2011, Pediatrics.

[30]  K. Thorlund,et al.  Completeness of main outcomes across randomized trials in entire discipline: survey of chronic lung disease outcomes in preterm infants , 2015, BMJ : British Medical Journal.

[31]  Robbert Huijsman,et al.  Evidence for the impact of quality improvement collaboratives: systematic review , 2008, BMJ : British Medical Journal.

[32]  E. Draper,et al.  Use of evidence based practices to improve survival without severe morbidity for very preterm infants: results from the EPICE population based cohort , 2016, British Medical Journal.

[33]  S. Heard An Intervention to Decrease Catheter-Related Bloodstream Infections in the ICU , 2019, 50 Landmark Papers.

[34]  Jeffrey D Horbar,et al.  Trends in mortality and morbidity for very low birth weight infants, 1991-1999. , 2002, Pediatrics.

[35]  Jeffrey D. Horbar,et al.  Revalidation of the Score for Neonatal Acute Physiology in the Vermont Oxford Network , 2007, Pediatrics.

[36]  G. Grunwald,et al.  A primer on using shrinkage to compare in-hospital mortality between centers. , 2015, The Annals of thoracic surgery.

[37]  M. Baucus National Association of Children's Hospitals , 2007 .

[38]  Justin B Dimick,et al.  Optimizing ACS NSQIP modeling for evaluation of surgical quality and risk: patient risk adjustment, procedure mix adjustment, shrinkage adjustment, and surgical focus. , 2013, Journal of the American College of Surgeons.

[39]  Philip E. Auerswald,et al.  The Production Recipes Approach to Modeling Technological Innovation: An Application to Learning by Doing , 1998 .

[40]  B. Vohr,et al.  Neurodevelopmental and Growth Outcomes of Extremely Low Birth Weight Infants After Necrotizing Enterocolitis , 2005, Pediatrics.

[41]  G. Badger,et al.  Obstetric and Neonatal Care Practices for Infants 501 to 1500 g From 2000 to 2009 , 2013, Pediatrics.

[42]  M. Coory,et al.  New measures for reporting the magnitude of small-area variation in rates. , 1998, Statistics in medicine.

[43]  What is a performance outlier? , 2015, BMJ quality & safety.

[44]  Assuring Healthy Outcomes,et al.  A Systematic Review of Costs Associated with Preterm Birth , 2007 .

[45]  S. Kazzi,et al.  A Cluster-Randomized Trial of Benchmarking and Multimodal Quality Improvement to Improve Rates of Survival Free of Bronchopulmonary Dysplasia for Infants With Birth Weights of Less Than 1250 Grams , 2007, Pediatrics.

[46]  J. Gould The role of regional collaboratives: the California Perinatal Quality Care Collaborative model. , 2010, Clinics in perinatology.