Estimating Response-Maximized Decision Rules With Applications to Breastfeeding

To estimate the sequence of actions that optimizes response in a longitudinal setting, it is important to study the actions as part of a set of decision rules rather than in a series of single-action comparisons. We take as our motivating example the estimation of the set of decision rules for the duration of breastfeeding with a view to maximizing infant growth. Breastfeeding has many well-recognized beneficial effects on health and development. However observational evidence has suggested that breastfeeding is associated with reduced infant growth, although the long-term consequences for stature and adiposity remain controversial. The Promotion of Breastfeeding Intervention Trial (PROBIT) recruited 17,046 women in which hospitals and their affiliated polyclinics in Belarus were randomized to a breastfeeding promotion intervention or to standard care. In this article, we propose Structural Mean Models and estimate their parameters using G-estimation to obtain unbiased estimates of the effect of continued breastfeeding on infant growth (weight or length) at one year of age. We also implement a modified version of the G-estimation algorithm that is asymptotically unbiased; this is the first real-data application of the algorithm. Finally, we compare the decision rules implied by the G-estimates with the decision implied by a myopic optimization estimation approach, that is, we compare with decision rules that maximize response in the short-term. The breastfeeding regimes selected by each of the three models are optimal in the sense that specific criteria were optimized; the criteria considered here (maximizing weight or length) were chosen for simplicity, but may not lead to better overall health. We demonstrate in the context of a breastfeeding promotion intervention trial that optimal myopic decision strategies do not coincide with strategies that optimize a longer-term response. Please see the online supplements for a correction to this article.

[1]  R. Bellman.  Dynamic programming. , 1957, Science.

[2]  Donald B. Rubin,et al.  Bayesian Inference for Causal Effects: The Role of Randomization , 1978 .

[3]  J. Robins.  A new approach to causal inference in mortality studies with a sustained exposure period—application to control of the healthy worker survivor effect , 1986 .

[4]  J. Robins.  Correcting for non-compliance in randomized trials using structural nested mean models , 1994 .

[5]  J. Robins,et al.  Analysis of semiparametric regression models for repeated outcomes in the presence of missing data , 1995 .

[6]  Leemon C. Baird,et al.  Residual advantage learning applied to a differential game , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[7]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[8]  James M. Robins,et al.  Causal Inference from Complex Longitudinal Data , 1997 .

[9]  E Goetghebeur,et al.  Practical properties of some structural mean analyses of the effect of compliance in randomized trials. , 1997, Controlled clinical trials.

[10]  Philip W. Lavori,et al.  A design for testing clinical strategies: biased adaptive within‐subject randomization , 2000 .

[11]  Promotion of Breastfeeding Intervention Trial (PROBIT) a randomized trial in the Republic of Belarus. , 2001, The Journal of pediatrics.

[12]  M S Kramer,et al.  Promotion of Breastfeeding Intervention Trial (PROBIT): a randomized trial in the Republic of Belarus. , 2001, JAMA.

[13]  K. Davis,et al.  National Institute of Mental Health Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE): Alzheimer disease trial methodology. , 2001, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[14]  J M Robins,et al.  Marginal Mean Models for Dynamic Regimes , 2001, Journal of the American Statistical Association.

[15]  C. Mamì,et al.  Incidence of dehydration and hypernatremia in exclusively breast-fed infants. , 2001, The Journal of pediatrics.

[16]  Robert W Platt,et al.  Breastfeeding and infant growth: biology or bias? , 2002, Pediatrics.

[17]  P. Lavori,et al.  Using inverse weighting and predictive inference to estimate the effects of time‐varying treatments on the discrete‐time hazard , 2002, Statistics in medicine.

[18]  S. Murphy,et al.  Optimal dynamic treatment regimes , 2003 .

[19]  M. Heinig,et al.  Risk factors for suboptimal infant breastfeeding behavior, delayed onset of lactation, and excess neonatal weight loss. , 2003, Pediatrics.

[20]  J. Lieberman,et al.  The National Institute of Mental Health Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) project: schizophrenia trial design and protocol development. , 2003, Schizophrenia bulletin.

[21]  E. Hodnett,et al.  Infant growth and health outcomes associated with 3 compared with 6 mo of exclusive breastfeeding. , 2003, The American journal of clinical nutrition.

[22]  Ree Dawson,et al.  Dynamic treatment regimes: practical design considerations , 2004, Clinical trials.

[23]  P. Lavori,et al.  Placebo‐free designs for evaluating new mental health treatments: the use of adaptive treatment strategies , 2004, Statistics in medicine.

[24]  Robert W Platt,et al.  Feeding effects on growth during infancy. , 2004, The Journal of pediatrics.

[25]  A. Tsiatis,et al.  Optimal Estimator for the Survival Distribution and Related Quantities for Treatment Policies in Two‐Stage Randomization Designs in Clinical Trials , 2004, Biometrics.

[26]  P. Thall,et al.  Randomized, adaptive, phase II selection trial of four chemotherapy regimens in androgen independent prostate cancer (AIPC). , 2004, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[27]  M. Heinig,et al.  Risk factors for suboptimal infant breastfeeding behavior, delayed onset of lactation, and excess neonatal weight loss , 2004 .

[28]  E. Hodnett,et al.  Does previous infection protect against atopic eczema and recurrent wheeze ininfancy? , 2004, Clinical and experimental allergy : journal of the British Society for Allergy and Clinical Immunology.

[29]  James M. Robins,et al.  Optimal Structural Nested Models for Optimal Sequential Decisions , 2004 .

[30]  Susan A. Murphy,et al.  A-Learning for approximate planning , 2004 .

[31]  D. Kupfer,et al.  Sequenced treatment alternatives to relieve depression (STAR*D): rationale and design. , 2004, Controlled clinical trials.

[32]  E. Hodnett,et al.  Infant growth and health outcomes associated with 3 compared with 6 months of exclusive breastfeeding , 2004 .

[33]  Brent A. Johnson,et al.  Estimating Mean Response as a Function of Treatment Duration in an Observational Study, Where Duration May Be Informatively Censored , 2004, Biometrics.

[34]  Marshall M Joffe,et al.  History-Adjusted Marginal Structural Models and Statically-Optimal Dynamic Treatment Regimens , 2005 .

[35]  S. Murphy,et al.  An experimental design for the development of adaptive treatment strategies , 2005, Statistics in medicine.

[36]  Brent A. Johnson,et al.  Semiparametric inference in observational duration-response studies, with duration possibly right-censored , 2005 .

[37]  Anastasios A. Tsiatis,et al.  Semiparametric efficient estimation of survival distributions in two-stage randomisation designs in clinical trials with censored data , 2006 .

[38]  J. Avorn,et al.  Variable selection for propensity score models. , 2006, American journal of epidemiology.

[39]  J. Robins,et al.  Comparison of dynamic treatment regimes via inverse probability weighting. , 2006, Basic & clinical pharmacology & toxicology.

[40]  Mark J. van der Laan,et al.  A semiparametric model selection criterion with applications to the marginal structural model , 2006, Comput. Stat. Data Anal..

[41]  Joelle Pineau,et al.  Constructing evidence-based treatment strategies using methods from computer science. , 2007, Drug and alcohol dependence.

[42]  M. J. van der Laan,et al.  Statistical methods for analyzing sequentially randomized trials. , 2007, Journal of the National Cancer Institute.

[43]  S. Murphy,et al.  Developing adaptive treatment strategies in substance abuse research. , 2007, Drug and alcohol dependence.

[44]  Erica E M Moodie,et al.  Demystifying Optimal Dynamic Treatment Regimes , 2007, Biometrics.

[45]  Richard M Martin,et al.  Effects of prolonged and exclusive breastfeeding on child height, weight, adiposity, and blood pressure at age 6.5 y: evidence from a large randomized trial. , 2007, The American journal of clinical nutrition.

[46]  Peter C Austin,et al.  A comparison of the ability of different propensity score models to balance measured variables between treated and untreated subjects: a Monte Carlo study , 2007, Statistics in medicine.

[47]  M. Kramer,et al.  The Effect of Prolonged and Exclusive Breast-Feeding on Dental Caries in Early School-Age Children , 2007, Caries Research.

[48]  Paul Zador,et al.  Variable selection and raking in propensity scoring. , 2007, Statistics in medicine.

[49]  S. Murphy,et al.  The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. , 2007, American journal of preventive medicine.

[50]  P. Thall,et al.  Adaptive therapy for androgen-independent prostate cancer: a randomized selection trial of four regimens. , 2007, Journal of the National Cancer Institute.

[51]  Ji Zhu,et al.  Variable Selection for Optimal Decision Making , 2007, AIME.

[52]  J. Robins,et al.  Estimation and extrapolation of optimal treatment and testing strategies , 2008, Statistics in medicine.

[53]  Geneviève Lefebvre,et al.  Impact of mis‐specification of the treatment model on estimates from a marginal structural model , 2008, Statistics in medicine.

[54]  Mark J van der Laan,et al.  Analyzing sequentially randomized trials based on causal effect models for realistic individualized treatment rules , 2008, Statistics in medicine.

[55]  E. Fombonne,et al.  Effects of Prolonged and Exclusive Breastfeeding on Child Behavior and Maternal Adjustment: Evidence From a Large, Randomized Trial , 2008, Pediatrics.

[56]  R. Reading.  Effects of prolonged and exclusive breastfeeding on child behavior and maternal adjustment: evidence from a large, randomized trial , 2008 .

[57]  J. Stockman.  Effect of prolonged and exclusive breast feeding on risk of allergy and asthma: cluster randomised trial , 2009 .

[58]  Erica E M Moodie,et al.  Estimating Optimal Dynamic Regimes: Correcting Bias under the Null , 2009, Scandinavian journal of statistics, theory and applications.

[59]  Frank Windmeijer,et al.  Identification of causal effects on binary outcomes using structural mean models , 2010, Biostatistics.

[60]  Alena I. Oetting,et al.  Statistical Methodology for a SMART Design in the Development of Adaptive Treatment Strategies , 2011 .

[61]  Statistical and Applied Mathematical Sciences Institute , 2011 .