Estimating the Comparative Effectiveness of Feeding Interventions in the Pediatric Intensive Care Unit: A Demonstration of Longitudinal Targeted Maximum Likelihood Estimation

Abstract Longitudinal data sources offer new opportunities for the evaluation of sequential interventions. To adjust for time-dependent confounding in these settings, longitudinal targeted maximum likelihood based estimation (TMLE), a doubly robust method that can be coupled with machine learning, has been proposed. This paper provides a tutorial in applying longitudinal TMLE, in contrast to inverse probability of treatment weighting and g-computation based on iterative conditional expectations. We apply these methods to estimate the causal effect of nutritional interventions on clinical outcomes among critically ill children in a United Kingdom study (Control of Hyperglycemia in Paediatric Intensive Care, 2008–2011). We estimate the probability of a child’s being discharged alive from the pediatric intensive care unit by a given day, under a range of static and dynamic feeding regimes. We find that before adjustment, patients who follow the static regime “never feed” are discharged by the end of the fifth day with a probability of 0.88 (95% confidence interval: 0.87, 0.90), while for the patients who follow the regime “feed from day 3,” the probability of discharge is 0.64 (95% confidence interval: 0.62, 0.66). After adjustment for time-dependent confounding, most of this difference disappears, and the statistical methods produce similar results. TMLE offers a flexible estimation approach; hence, we provide practical guidance on implementation to encourage its wider use.

[1]  J. Robins,et al.  Sensitivity Analyses for Unmeasured Confounding Assuming a Marginal Structural Model for Repeated Measures , 2022 .

[2]  Mark J van der Laan,et al.  Analyzing sequentially randomized trials based on causal effect models for realistic individualized treatment rules , 2008, Statistics in medicine.

[3]  James M. Robins,et al.  The International Journal of Biostatistics CAUSAL INFERENCE When to Start Treatment ? A Systematic Approach to the Comparison of Dynamic Regimes Using Observational Data , 2011 .

[4]  M. J. van der Laan,et al.  Causal Models and Learning from Data: Integrating Causal Modeling and Statistical Estimation , 2014, Epidemiology.

[5]  R. Grieve,et al.  A randomized trial of hyperglycemic control in pediatric intensive care. , 2014, The New England journal of medicine.

[6]  Mark J van der Laan,et al.  EFFECT OF BREASTFEEDING ON GASTROINTESTINAL INFECTION IN INFANTS: A TARGETED MAXIMUM LIKELIHOOD APPROACH FOR CLUSTERED LONGITUDINAL DATA. , 2014, The annals of applied statistics.

[7]  J. Robins,et al.  Comparison of dynamic treatment regimes via inverse probability weighting. , 2006, Basic & clinical pharmacology & toxicology.

[8]  Susan Gruber,et al.  Ensemble learning of inverse probability weights for marginal structural modeling in large observational datasets , 2015, Statistics in medicine.

[9]  A. Tsiatis.  Semiparametric Theory and Missing Data , 2006 .

[10]  S. Keleş,et al.  Statistical Applications in Genetics and Molecular Biology Asymptotic Optimality of Likelihood-Based Cross-Validation , 2011 .

[11]  Aad van der Vaart,et al.  Estimating a survival distribution with current status data and high-dimensional covariates , 2006 .

[12]  James M Robins,et al.  Using Big Data to Emulate a Target Trial When a Randomized Trial Is Not Available. , 2016, American journal of epidemiology.

[13]  S. Rose.  Mortality risk score prediction in an elderly population using machine learning. , 2013, American journal of epidemiology.

[14]  Sherri Rose,et al.  Implementation of G-computation on a simulated data set: demonstration of a causal inference technique. , 2011, American journal of epidemiology.

[15]  J. Sekhon,et al.  Evaluating treatment effectiveness under model misspecification: A comparison of targeted maximum likelihood estimation with bias-corrected matching , 2014, Statistical methods in medical research.

[16]  Maya L Petersen,et al.  Commentary: Applying a Causal Road Map in Settings with Time-dependent Confounding , 2014, Epidemiology.

[17]  S. Gerrior,et al.  An Easy Approach to Calculating Estimated Energy Requirements , 2006, Preventing chronic disease.

[18]  M. J. van der Laan,et al.  Evaluating the Impact of a HIV Low-Risk Express Care Task-Shifting Program: A Case Study of the Targeted Learning Roadmap , 2016, Epidemiologic methods.

[19]  Kristin E. Porter,et al.  Diagnosing and responding to violations in the positivity assumption , 2012, Statistical methods in medical research.

[20]  S. Vansteelandt,et al.  Marginal structural models for partial exposure regimes. , 2008, Biostatistics.

[21]  James M. Robins,et al.  Commentary on ‘Using inverse weighting and predictive inference to estimate the effects of time‐varying treatments on the discrete‐time hazard’ , 2002 .

[22]  J. Mayer,et al.  Postoperative course and hemodynamic profile after the arterial switch operation in neonates and infants. A comparison of low-flow cardiopulmonary bypass and circulatory arrest. , 1995, Circulation.

[23]  Ekaterina Eliseeva,et al.  An Application Of Machine Learning Methods To The Derivation Of Exposure-Response Curves For Respiratory Outcomes , 2013 .

[24]  Catherine M Crespi,et al.  Semiparametric Estimation of the Impacts of Longitudinal Interventions on Adolescent Obesity using Targeted Maximum-Likelihood: Accessible Estimation with the ltmle Package , 2014, Journal of causal inference.

[25]  Mark J van der Laan,et al.  The International Journal of Biostatistics A Targeted Maximum Likelihood Estimator of a Causal Effect on a Bounded Continuous Outcome , 2011 .

[26]  Mark J. van der Laan,et al.  Super Learner In Prediction , 2010 .

[27]  J. Robins.  Analytic Methods for Estimating HIV-Treatment and Cofactor Effects , 2002 .

[28]  Trevor Hastie,et al.  Regularization Paths for Cox's Proportional Hazards Model via Coordinate Descent. , 2011, Journal of statistical software.

[29]  Ronald C. Kessler,et al.  Methodological Issues in AIDS Behavioral Research , 1993, AIDS Prevention and Mental Health.

[30]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[31]  C. Compher,et al.  A.S.P.E.N. Clinical Guidelines: nutrition support of the critically ill child. , 2009, JPEN. Journal of parenteral and enteral nutrition.

[32]  M. J. van der Laan,et al.  Practice of Epidemiology Improving Propensity Score Estimators ’ Robustness to Model Misspecification Using Super Learner , 2015 .

[33]  M. J. Laan,et al.  Targeted Learning: Causal Inference for Observational and Experimental Data , 2011 .

[34]  M. Hernán.  Counterpoint: epidemiology to guide decision-making: moving away from practice-free research. , 2015, American journal of epidemiology.

[35]  S. Murphy,et al.  Optimal dynamic treatment regimes , 2003 .

[36]  Frank E Harrell,et al.  Case complexity scores in congenital heart surgery: a comparative study of the Aristotle Basic Complexity score and the Risk Adjustment in Congenital Heart Surgery (RACHS-1) system. , 2007, The Journal of thoracic and cardiovascular surgery.

[37]  M. J. Laan,et al.  Targeted Learning of an Optimal Dynamic Treatment, and Statistical Inference for its Mean Outcome , 2014 .

[38]  J. Robins,et al.  Marginal Structural Models and Causal Inference in Epidemiology , 2000, Epidemiology.

[39]  D. Horvitz,et al.  A Generalization of Sampling Without Replacement from a Finite Universe , 1952 .

[40]  James M. Robins,et al.  Comparative Effectiveness of Dynamic Treatment Regimes: An Application of the Parametric G-Formula , 2011, Statistics in biosciences.

[41]  S. Dudoit,et al.  Unified Cross-Validation Methodology For Selection Among Estimators and a General Cross-Validated Adaptive Epsilon-Net Estimator: Finite Sample Oracle Inequalities and Examples , 2003 .

[42]  M. J. van der Laan,et al.  Targeted Maximum Likelihood Estimation for Dynamic and Static Longitudinal Marginal Structural Working Models , 2014, Journal of causal inference.

[43]  J M Robins,et al.  Marginal Mean Models for Dynamic Regimes , 2001, Journal of the American Statistical Association.

[44]  Sherri Rose,et al.  Targeted Maximum Likelihood Estimation for Causal Inference in Observational Studies , 2017, American journal of epidemiology.

[45]  M. J. van der Laan,et al.  Targeted Minimum Loss Based Estimation of Causal Effects of Multiple Time Point Interventions , 2012, The international journal of biostatistics.

[46]  J. Robins,et al.  Doubly Robust Estimation in Missing Data and Causal Inference Models , 2005, Biometrics.

[47]  Erica Moodie,et al.  Dynamic treatment regimes. , 2004, Clinical trials.

[48]  B L De Stavola,et al.  Methods for dealing with time‐dependent confounding , 2013, Statistics in medicine.

[49]  Kristin E. Porter,et al.  The Relative Performance of Targeted Maximum Likelihood Estimators , 2011, The international journal of biostatistics.

[50]  M. J. van der Laan,et al.  The International Journal of Biostatistics Targeted Maximum Likelihood Learning , 2011 .

[51]  J. Robins.  A new approach to causal inference in mortality studies with a sustained exposure period—application to control of the healthy worker survivor effect , 1986 .

[52]  S. Murphy,et al.  An experimental design for the development of adaptive treatment strategies , 2005, Statistics in medicine.

[53]  D. Heyland,et al.  Feeding the Critically Ill Patient , 2014, Critical care medicine.

[54]  D. Ruppert.  Robust Statistics: The Approach Based on Influence Functions , 1987 .

[55]  G. Andrew,et al.  arm: Data Analysis Using Regression and Multilevel/Hierarchical Models , 2014 .

[56]  M. J. van der Laan,et al.  Statistical Applications in Genetics and Molecular Biology Super Learner , 2010 .

[57]  J. Robins,et al.  Comment: Performance of Double-Robust Estimators When “Inverse Probability” Weights Are Highly Variable , 2007, 0804.2965.

[58]  M. Parmar,et al.  More multiarm randomised trials of superiority are needed , 2014, The Lancet.

[59]  M. J. van der Laan,et al.  Occupational Exposure to PM2.5 and Incidence of Ischemic Heart Disease , 2015, Epidemiology.

[60]  J. Robins,et al.  G-Estimation of the Effect of Prophylaxis Therapy for Pneumocystis carinii Pneumonia on the Survival of AIDS Patients , 1992, Epidemiology.

[61]  T. Kirby.  Early versus late parenteral nutrition in critically ill children. , 2016, The Lancet. Respiratory medicine.

[62]  Romain Neugebauer,et al.  Targeted learning in real‐world comparative effectiveness research with time‐varying interventions , 2014, Statistics in medicine.

[63]  Mark J van der Laan,et al.  Targeted Maximum Likelihood Estimation of Natural Direct Effects , 2012, The international journal of biostatistics.