Using Enriched Observational Data to Develop and Validate Age-specific Mortality Risk Adjustment Models for Hospitalized Pediatric Patients

Background:Growth and development in early childhood are associated with rapid physiological changes. We sought to develop and validate age-specific mortality risk adjustment models for hospitalized pediatric patients using objective physiological variables on admission in addition to administrative variables. Methods:Age-specific laboratory and vital sign variables were crafted for neonates (up to 30 d old), infants/toddlers (1–23 mo), and children (2–17 y). We fit 3 logistic regression models, 1 for each age group, using a derivation cohort comprising admissions from 2000–2001 in 215 hospitals. We validated the models with a separate validation cohort comprising admissions from 2002–2007 in 62 hospitals. We used the c statistic to assess model fit. Results:The derivation cohort comprised 93,011 neonates (0.55% mortality), 46,152 infants/toddlers (0.37% mortality), and 104,010 children (0.40% mortality). The corresponding numbers of admissions (mortality rates) for the validation cohort were 162,131 (0.50%), 33,818 (0.09%), and 73,362 (0.20%), respectively. The c statistics for the 3 models were 0.94, 0.91, and 0.92, respectively, for the derivation cohort and 0.91, 0.86, and 0.93, respectively, for the validation cohort. The relative contributions of physiological versus administrative variables to the model fit were 52% versus 48% (neonates), 93% versus 7% (infants/toddlers), and 82% versus 18% (children). Conclusions:The thresholds for physiological determinants varied by age. Common physiological variables assessed on admission contributed significantly to predicting mortality for hospitalized pediatric patients. These models may have practical utility in risk adjustment for pediatric outcomes and comparative effectiveness research when physiological data are captured through the electronic medical record.

[1]  M. Fine,et al.  A prediction rule to identify low-risk patients with community-acquired pneumonia. , 1997, The New England journal of medicine.

[2]  W. Knaus,et al.  Variations in Mortality and Length of Stay in Intensive Care Units , 1993, Annals of Internal Medicine.

[3]  Y. Tabak,et al.  Healthcare-associated bloodstream infection: A distinct entity? Insights from a large U.S. database* , 2006, Critical care medicine.

[4]  W. Knaus,et al.  Physiologic abnormalities and outcome from acute disease. Evidence for a predictable relationship. , 1986 .

[5]  E. Draper,et al.  APACHE II: A severity of disease classification system , 1985, Critical care medicine.

[6]  Xiaowu Sun,et al.  Development and validation of a disease-specific risk adjustment system using automated clinical data. , 2010, Health services research.

[7]  Gabriel J. Escobar,et al.  Risk-Adjusting Hospital Inpatient Mortality Using Automated Inpatient, Outpatient, and Laboratory Databases , 2008, Medical care.

[8]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[9]  the Swiss Neonatal Network.  The CRIB (clinical risk index for babies) score: a tool for assessing initial neonatal risk and comparing performance of neonatal intensive care units , 1993, The Lancet.

[10]  Xiaowu Sun,et al.  Mortality and need for mechanical ventilation in acute exacerbations of chronic obstructive pulmonary disease: development and validation of a simple risk score. , 2009, Archives of internal medicine.

[11]  S. Jencks,et al.  Accuracy in recorded diagnoses. , 1992, JAMA.

[12]  Y. Tabak,et al.  Using Automated Clinical Data for Risk Adjustment: Development and Validation of Six Disease-Specific Mortality Predictive Models for Pay-for-Performance , 2007, Medical care.

[13]  T. Brennan,et al.  A middle ground on public accountability. , 2004, The New England journal of medicine.

[14]  P E Dans,et al.  Looking for Answers in All the Wrong Places , 1993, Annals of Internal Medicine.

[15]  M. Pencina,et al.  Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond , 2008, Statistics in medicine.

[16]  Sankey V. Williams,et al.  Evaluation of the complication rate as a measure of quality of care in coronary artery bypass graft surgery. , 1995, JAMA.

[17]  D. Hoaglin,et al.  Enhancement of claims data to improve risk adjustment of hospital mortality. , 2007, JAMA.

[18]  D. Richardson,et al.  Score for Neonatal Acute Physiology: a physiologic severity index for neonatal intensive care. , 1993, Pediatrics.

[19]  U. Ruttimann,et al.  PRISM III: an updated Pediatric Risk of Mortality score. , 1996, Critical care medicine.

[20]  E. DeLong,et al.  Discordance of Databases Designed for Claims Payment versus Clinical Information Systems: Implications for Outcomes Research , 1993, Annals of Internal Medicine.

[21]  Jeffrey D. Horbar,et al.  Revalidation of the Score for Neonatal Acute Physiology in the Vermont Oxford Network , 2007, Pediatrics.

[22]  S. Lemeshow,et al.  A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. , 1993, JAMA.

[23]  L I Iezzoni,et al.  A clinical assessment of MedisGroups. , 1988, JAMA.

[24]  Ralph B D'Agostino,et al.  Presentation of multivariate data for clinical use: The Framingham Study risk score functions. , 2005, Statistics in medicine.

[25]  Xiaowu Sun,et al.  Developing and Validating a Risk Score for Lower-Extremity Amputation in Patients Hospitalized for a Diabetic Foot Infection , 2011, Diabetes Care.

[26]  J. Johnston,et al.  Importance of organ dysfunction in determining hospital outcomes in children. , 2004, The Journal of pediatrics.