Data-Adaptive Estimation in Cluster Randomized Trials

In randomized trials, adjustment for measured covariates during the analysis can reduce variance and increase power. To avoid misleading inference, the analysis plan must be pre-specified. However, it is often unclear a priori which baseline covariates (if any) should be included in the analysis. This results in an important challenge: the need to learn from the data to realize precision gains, but to do so in pre-specified and rigorous way to maintain valid statistical inference. This challenge is especially prominent in cluster randomized trials (CRTs), which often have limited numbers of independent units (e.g., communities, clinics or schools) and many potential adjustment variables.

[1]  L. Watson,et al.  Mounting a community-randomized trial: sample size, matching, selection, and randomization issues in PRISM. , 2004, Controlled clinical trials.

[2]  Jerome Amir Singh,et al.  Antiretroviral resource allocation for HIV prevention , 2013, AIDS.

[3]  W. Satariano,et al.  Association between self-reported leisure-time physical activity and measures of cardiorespiratory fitness in an elderly population. , 1998, American journal of epidemiology.

[4]  A. Afifi,et al.  Statistical Analysis: A Computer Oriented Approach , 1979 .

[5]  J. Robins,et al.  Estimation of Regression Coefficients When Some Regressors are not Always Observed , 1994 .

[6]  David Madigan,et al.  Algorithms for Sparse Linear Classifiers in the Massive Data Setting , 2008 .

[7]  Holly Janes,et al.  Efficacy trial of a DNA/rAd5 HIV-1 preventive vaccine. , 2013, The New England journal of medicine.

[8]  Cathy O'Neil,et al.  Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy , 2016, Vikalpa: The Journal for Decision Makers.

[9]  M. J. van der Laan,et al.  Targeted Minimum Loss Based Estimation of Causal Effects of Multiple Time Point Interventions , 2012, The international journal of biostatistics.

[10]  D. Rubin,et al.  Assessing Sensitivity to an Unobserved Binary Covariate in an Observational Study with Binary Outcome , 1983 .

[11]  D. Rubin,et al.  Targeted ANCOVA Estimator in RCTs , 2011 .

[12]  Michael E. Sobel,et al.  What Do Randomized Studies of Housing Mobility Demonstrate? , 2006 .

[13]  Mark J van der Laan,et al.  Targeted Estimation of Binary Variable Importance Measures with Interval-Censored Outcomes , 2014, The international journal of biostatistics.

[14]  J. Robins Addendum to “a new approach to causal inference in mortality studies with a sustained exposure period—application to control of the healthy worker survivor effect” , 1987 .

[15]  Michael Rosenblum,et al.  Marginal Structural Models , 2011 .

[16]  J. Robins,et al.  Estimation and extrapolation of optimal treatment and testing strategies , 2008, Statistics in medicine.

[17]  Laura B. Balzer,et al.  Targeted estimation and inference for the sample average treatment effect in trials with and without pair‐matching , 2016, Statistics in medicine.

[18]  P B Gilbert,et al.  Statistical methods for assessing differential vaccine protection against human immunodeficiency virus types. , 1998, Biometrics.

[19]  Mark J. van der Laan,et al.  Estimation based on case-control designs with known prevalence probability. , 2008 .

[20]  Michael Rosenblum,et al.  Using Regression Models to Analyze Randomized Trials: Asymptotically Valid Hypothesis Tests Despite Incorrectly Specified Models , 2009, Biometrics.

[21]  Oleg Sofrygin,et al.  Semi-Parametric Estimation and Inference for the Mean Outcome of the Single Time-Point Intervention in a Causally Connected Population , 2016, Journal of causal inference.

[22]  Sherri Rose,et al.  Rose and van der Laan respond to "Some advantages of the relative excess risk due to interaction". , 2014, American journal of epidemiology.

[23]  Yuval Peres,et al.  Concentration of Lipschitz Functionals of Determinantal and Other Strong Rayleigh Measures , 2011, Combinatorics, Probability and Computing.

[24]  Jingwei Wu,et al.  A Dynamic Directional Model for Effective Brain Connectivity Using Electrocorticographic (ECoG) Time Series , 2015, Journal of the American Statistical Association.

[25]  Sarah M. Greene,et al.  The role of research in integrated healthcare systems: the HMO Research Network. , 2004, The American journal of managed care.

[26]  Kevin B. Korb,et al.  Varieties of Causal Intervention , 2004, PRICAI.

[27]  Tyler J. VanderWeele,et al.  Vaccines, Contagion, and Social Networks , 2014, ArXiv.

[28]  M. J. van der Laan,et al.  Super-Learning of an Optimal Dynamic Treatment Rule , 2016, The international journal of biostatistics.

[29]  Mark J van der Laan,et al.  Analyzing sequentially randomized trials based on causal effect models for realistic individualized treatment rules , 2008, Statistics in medicine.

[30]  James M. Robins,et al.  Unified Methods for Censored Longitudinal Data and Causality , 2003 .

[31]  Eric J Tchetgen Tchetgen,et al.  Interference and Sensitivity Analysis. , 2014, Statistical science : a review journal of the Institute of Mathematical Statistics.

[32]  G. Andrew,et al.  arm: Data Analysis Using Regression and Multilevel/Hierarchical Models , 2014 .

[33]  C. Jenkins,et al.  Coronary heart disease in the Western collaborative group study. A follow-up experience of two years. , 1966, JAMA.

[34]  Dominik Wied,et al.  Consistency of the kernel density estimator: a survey , 2012 .

[35]  A Donner,et al.  The merits of matching in community intervention trials: a cautionary tale. , 1997, Statistics in medicine.

[36]  D. Horvitz,et al.  A Generalization of Sampling Without Replacement from a Finite Universe , 1952 .

[37]  J. Friedman Multivariate adaptive regression splines , 1990 .

[38]  Uwe Einmahl,et al.  Uniform in bandwidth consistency of kernel-type function estimators , 2005 .

[39]  Mark J. van der Laan,et al.  Causal Mediation in a Survival Setting with Time-Dependent Mediators , 2012 .

[40]  Richard M. Karp,et al.  Reducibility Among Combinatorial Problems , 1972, 50 Years of Integer Programming.

[41]  Mark J van der Laan,et al.  An Application of Collaborative Targeted Maximum Likelihood Estimation in Causal Inference and Genomics , 2010, The international journal of biostatistics.

[42]  Sherri Rose,et al.  Implementation of G-computation on a simulated data set: demonstration of a causal inference technique. , 2011, American journal of epidemiology.

[43]  N. Christakis,et al.  The Spread of Obesity in a Large Social Network Over 32 Years , 2007, The New England journal of medicine.

[44]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[45]  W. G. Cochran Analysis of covariance: Its nature and uses. , 1957 .

[46]  Bruce Fireman,et al.  Balancing Score Adjusted Targeted Minimum Loss-based Estimation , 2015, Journal of causal inference.

[47]  David B Dunson,et al.  TENSOR DECOMPOSITIONS AND SPARSE LOG-LINEAR MODELS. , 2014, Annals of statistics.

[48]  M. J. van der Laan,et al.  Increasing Power in Randomized Trials with Right Censored Outcomes Through Covariate Adjustment , 2009, Journal of biopharmaceutical statistics.

[49]  Kristian Lum,et al.  Limitations of mitigating judicial bias with machine learning , 2017, Nature Human Behaviour.

[50]  B. Zinman,et al.  Medical Management of Hyperglycemia in Type 2 Diabetes: A Consensus Algorithm for the Initiation and Adjustment of Therapy , 2009, Diabetes Care.

[51]  Laura B. Balzer,et al.  ADAPTIVE MATCHING IN RANDOMIZED TRIALS AND OBSERVATIONAL STUDIES. , 2012, Journal of statistical research.

[52]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[53]  J Benichou,et al.  Estimates of absolute cause-specific risk in cohort studies. , 1990, Biometrics.

[54]  Jeffrey H Silber,et al.  Optimal multivariate matching before randomization. , 2004, Biostatistics.

[55]  D. Rubin Matched Sampling for Causal Effects , 2006 .

[56]  R. Brand,et al.  Coronary heart disease in Western Collaborative Group Study. Final follow-up experience of 8 1/2 years. , 1975, JAMA.

[57]  Jay S. Kaufman,et al.  Bounding Causal Effects Under Uncontrolled Confounding Using Counterfactuals , 2005, Epidemiology.

[58]  D Scharfstein,et al.  Methods for Conducting Sensitivity Analysis of Trials with Potentially Nonignorable Competing Causes of Censoring , 2001, Biometrics.

[59]  Michael E. Miller,et al.  ACTION TO CONTROL CARDIOVASCULAR RISK IN DIABETES STUDY GROUP. EFFECTS OF INTENSIVE GLUCOSE LOWERING IN TYPE 2 DIABETES , 2010 .

[60]  Yoram Singer,et al.  Pegasos: primal estimated sub-gradient solver for SVM , 2011, Math. Program..

[61]  Dylan Walker,et al.  Design of Randomized Experiments in Networks , 2014, Proceedings of the IEEE.

[62]  Mark J. van der Laan,et al.  tmle : An R Package for Targeted Maximum Likelihood Estimation , 2012 .

[63]  J. Pearl Causal diagrams for empirical research , 1995 .

[64]  M. J. Laan,et al.  Targeted Learning of an Optimal Dynamic Treatment, and Statistical Inference for its Mean Outcome , 2014 .

[65]  J. Pearl Myth, Confusion, and Science in Causal Analysis , 2009 .

[66]  B. Levit,et al.  On the Efficiency of a Class of Non-Parametric Estimates , 1976 .

[67]  Mark J van der Laan,et al.  The International Journal of Biostatistics Collaborative Targeted Maximum Likelihood for Time to Event Data , 2011 .

[68]  J. Roy,et al.  Dynamic marginal structural modeling to evaluate the comparative effectiveness of more or less aggressive treatment intensification strategies in adults with type 2 diabetes , 2012, Pharmacoepidemiology and drug safety.

[69]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[70]  Tomer Hertz,et al.  Increased HIV-1 vaccine efficacy against viruses with genetic signatures in Env-V2 , 2012, Nature.

[71]  Mark J van der Laan,et al.  A practical illustration of the importance of realistic individualized treatment rules in causal inference. , 2007, Electronic journal of statistics.

[72]  Mark J. van der Laan,et al.  Application of Time-to-Event Methods in the Assessment of Safety in Clinical Trials , 2009 .

[73]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[74]  Guoli Liu,et al.  Managing the Challenges of Complex Interdependence: China and the United States in the Era of Globalization , 2010 .

[75]  Romain Neugebauer,et al.  High‐dimensional propensity score algorithm in comparative effectiveness research with time‐varying interventions , 2015, Statistics in medicine.

[76]  Robert W Platt,et al.  Breastfeeding and infant growth: biology or bias? , 2002, Pediatrics.

[77]  M. Rosenblatt Remarks on Some Nonparametric Estimates of a Density Function , 1956 .

[78]  J. Robins,et al.  Sensitivity Analysis for Selection bias and unmeasured Confounding in missing Data and Causal inference models , 2000 .

[79]  Sherri Rose,et al.  Robust Machine Learning Variable Importance Analyses of Medical Conditions for Health Care Spending , 2018, Health services research.

[80]  Richard J. Hayes,et al.  Cluster randomised trials , 2009 .

[81]  Mark J van der Laan,et al.  The International Journal of Biostatistics A Targeted Maximum Likelihood Estimator of a Causal Effect on a Bounded Continuous Outcome , 2011 .

[82]  James M. Robins,et al.  Estimation of the failure time distribution in the presence of informative censoring , 2002 .

[83]  B. Howard,et al.  Intensive Glycemic Control and the Prevention of Cardiovascular Events: Implications of the ACCORD, ADVANCE, and VA Diabetes Trials , 2009, Diabetes Care.

[84]  Susan Gruber,et al.  One-Step Targeted Minimum Loss-based Estimation Based on Universal Least Favorable One-Dimensional Submodels , 2016, The international journal of biostatistics.

[85]  Boris Polyak,et al.  Acceleration of stochastic approximation by averaging , 1992 .

[86]  Alan Hubbard,et al.  Variable Importance and Prediction Methods for Longitudinal Problems with Missing Variables , 2015, PloS one.

[87]  R. Holman,et al.  10-year follow-up of intensive glucose control in type 2 diabetes. , 2008, The New England journal of medicine.

[88]  R. Tibshirani,et al.  Generalized additive models for medical research , 1986, Statistical methods in medical research.

[89]  Donald B. Rubin,et al.  Multivariate matching methods that are equal percent bias reducing , 1974 .

[90]  Steven G. Deeks,et al.  The Risk of Virologic Failure Decreases with Duration of HIV Suppression, at Greater than 50% Adherence to Antiretroviral Therapy , 2009, PloS one.

[91]  Catherine P. Bradshaw,et al.  The use of propensity scores to assess the generalizability of results from randomized trials , 2011, Journal of the Royal Statistical Society. Series A,.

[92]  R. Macklin,et al.  Given financial constraints, it would be unethical to divert antiretroviral drugs from treatment to prevention. , 2012, Health affairs.

[93]  Cosma Rohilla Shalizi,et al.  Homophily and Contagion Are Generically Confounded in Observational Social Network Studies , 2010, Sociological methods & research.

[94]  Tyler J VanderWeele,et al.  On causal inference in the presence of interference , 2012, Statistical methods in medical research.

[95]  Mark J. van der Laan,et al.  Targeted Methods for Biomarker Discovery , 2011 .

[96]  Mark J van der Laan,et al.  Sensitivity Analysis for Causal Inference under Unmeasured Confounding and Measurement Error Problems , 2013, The international journal of biostatistics.

[97]  Marie Davidian,et al.  Improving Efficiency of Inferences in Randomized Clinical Trials Using Auxiliary Covariates , 2008, Biometrics.

[98]  R. Fisher Statistical methods for research workers , 1927, Protoplasma.

[99]  G. S. Watson,et al.  Smooth regression analysis , 1964 .

[100]  M. J. Laan,et al.  Doubly robust nonparametric inference on the average treatment effect , 2017, Biometrika.

[101]  F. Fuchs,et al.  The effect of antihypertensive agents on sleep apnea: protocol for a randomized controlled trial , 2014, Trials.

[102]  J. Hahn On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects , 1998 .

[103]  Elizabeth L. Ogburn,et al.  High-dimensional multivariate mediation with application to neuroimaging data. , 2015, Biostatistics.

[104]  Bhramar Mukherjee,et al.  Sensitivity analysis for interactions under unmeasured confounding , 2012, Statistics in medicine.

[105]  D. A. Freedman,et al.  Adjusting for Nonignorable Drop-Out Using Semiparametric Nonresponse Models: Comment , 1999 .

[106]  D. Rubin Randomization Analysis of Experimental Data: The Fisher Randomization Test Comment , 1980 .

[107]  M. J. van der Laan,et al.  A General Implementation of TMLE for Longitudinal Data Applied to Causal Inference in Survival Analysis , 2012, The international journal of biostatistics.

[108]  Eric B. Laber,et al.  Inference about the expected performance of a data-driven dynamic treatment regime , 2014, Clinical trials.

[109]  M Lunn,et al.  Applying Cox regression to competing risks. , 1995, Biometrics.

[110]  Jake Bowers,et al.  Reasoning about Interference Between Units: A General Framework , 2013, Political Analysis.

[111]  Shai Shalev-Shwartz,et al.  Online Learning and Online Convex Optimization , 2012, Found. Trends Mach. Learn..

[112]  Robert M Califf,et al.  Characteristics of clinical trials registered in ClinicalTrials.gov, 2007-2010. , 2012, JAMA.

[113]  Edoardo M. Airoldi,et al.  Optimal design of experiments in the presence of network-correlated outcomes , 2015, ArXiv.

[114]  Martin Schumacher,et al.  Proportional subdistribution hazards modeling offers a summary analysis, even if misspecified , 2010, Statistics in medicine.

[115]  Wenjiang J. Fu Penalized Regressions: The Bridge versus the Lasso , 1998 .

[116]  J. Robins,et al.  Comparison of dynamic treatment regimes via inverse probability weighting. , 2006, Basic & clinical pharmacology & toxicology.

[117]  Antoine Chambaz,et al.  Practical targeted learning from large data sets by survey sampling , 2016, 1606.09522.

[118]  Xinyi Xu,et al.  Optimal Nonbipartite Matching and Its Statistical Applications , 2011, The American statistician.

[119]  Mark J. van der Laan,et al.  The Statistics of Sensitivity Analyses , 2015 .

[120]  M. J. van der Laan,et al.  TARGETED SEQUENTIAL DESIGN FOR TARGETED LEARNING INFERENCE OF THE OPTIMAL TREATMENT RULE AND ITS MEAN REWARD. , 2017, Annals of statistics.

[121]  Michael Rosenblum,et al.  The International Journal of Biostatistics Simple , Efficient Estimators of Treatment Effects in Randomized Trials Using Generalized Linear Models to Leverage Baseline Variables , 2011 .

[122]  G. Imbens,et al.  Bias-Corrected Matching Estimators for Average Treatment Effects , 2011 .

[123]  J. Horowitz,et al.  Nonparametric Analysis of Randomized Experiments with Missing Covariate and Outcome Data , 2000 .

[124]  Dylan S. Small,et al.  Comment: The Essential Role of Pair Matching in Cluster-Randomized Experiments, with Application to the Mexican Universal Health Insurance Evaluation , 2009 .

[125]  Mark J. van der Laan,et al.  Super Learner In Prediction , 2010 .

[126]  U. Grömping Dependence of Variable Importance in Random Forests on the Shape of the Regressor Space , 2009 .

[127]  Mark J van der Laan,et al.  Targeted Maximum Likelihood Estimation of Natural Direct Effects , 2012, The international journal of biostatistics.

[128]  Mark J. van der Laan,et al.  Observational Study and Individualized Antiretroviral Therapy Initiation Rules for Reducing Cancer Incidence in HIV-Infected Patients , 2010 .

[129]  Wenjing Zheng,et al.  Longitudinal Mediation Analysis with Time-varying Mediators and Exposures, with Application to Survival Outcomes , 2017, Journal of causal inference.

[130]  James M Robins,et al.  Identification, Estimation and Approximation of Risk under Interventions that Depend on the Natural Value of Treatment Using Observational Data , 2014, Epidemiologic methods.

[131]  M. J. van der Laan,et al.  Practice of Epidemiology Improving Propensity Score Estimators ’ Robustness to Model Misspecification Using Super Learner , 2015 .

[132]  M. J. van der Laan,et al.  Simple Optimal Weighting of Cases and Controls in Case-Control Studies , 2008, The international journal of biostatistics.

[133]  Karl J. Friston,et al.  Modelling functional integration: a comparison of structural equation and dynamic causal models , 2004, NeuroImage.

[134]  Donglin Zeng,et al.  Comment on "Dynamic treatment regimes: technical challenges and applications" , 2014, Electronic journal of statistics.

[135]  Mark J van der Laan,et al.  The International Journal of Biostatistics A Targeted Maximum Likelihood Estimator for Two-Stage Designs , 2011 .

[136]  M. J. Laan Causal Effect Models for Intention to Treat and Realistic Individualized Treatment Rules , 2006 .

[137]  B. Shepherd,et al.  GUIDO IMBENS, DONALD RUBIN, Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction. New York: Cambridge University Press. , 2016, Biometrics.

[138]  G. Imbens Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review , 2004 .

[139]  Mark J. van der Laan,et al.  Higher-order Targeted Minimum Loss-based Estimation , 2014 .

[140]  M. J. van der Laan,et al.  Targeting the Optimal Design in Randomized Clinical Trials with Binary Outcomes and No Covariate: Simulation Study , 2011 .

[141]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[142]  Geert Molenberghs,et al.  Ignorance and uncertainty regions as inferential tools in a sensitivity analysis , 2006 .

[143]  Susan Gruber,et al.  Variable Selection for Confounder Control, Flexible Modeling and Collaborative Targeted Minimum Loss-Based Estimation in Causal Inference , 2016, The international journal of biostatistics.

[144]  James M. Robins,et al.  Semiparametric Regression for Repeated Outcomes With Nonignorable Nonresponse , 1998 .

[145]  S. Pocock,et al.  Subgroup analysis, covariate adjustment and baseline comparisons in clinical trial reporting: current practiceand problems , 2002, Statistics in medicine.

[146]  A. Tsiatis Semiparametric Theory and Missing Data , 2006 .

[147]  B. Zinman,et al.  Management of Hyperglycemia in Type 2 Diabetes: A Consensus Algorithm for the Initiation and Adjustment of Therapy , 2006, Diabetes Care.

[148]  T. VanderWeele Bias Formulas for Sensitivity Analysis for Direct and Indirect Effects , 2010, Epidemiology.

[149]  Noboru Murata,et al.  A Statistical Study on On-line Learning , 1999 .

[150]  Elias Bareinboim,et al.  A General Algorithm for Deciding Transportability of Experimental Results , 2013, ArXiv.

[151]  Sherri Rose,et al.  Targeted Maximum Likelihood Estimation for Causal Inference in Observational Studies , 2017, American journal of epidemiology.

[152]  Ilya Shpitser,et al.  Semiparametric Theory for Causal Mediation Analysis: efficiency bounds, multiple robustness, and sensitivity analysis. , 2012, Annals of statistics.

[153]  C. Manski Partial Identification of Probability Distributions , 2003 .

[154]  Tyler J. VanderWeele,et al.  Sensitivity Analysis Without Assumptions , 2015, Epidemiology.

[155]  Phyllis Illari,et al.  Causality: Philosophical Theory meets Scientific Practice , 2014 .

[156]  A Donner,et al.  Developments in cluster randomized trials and Statistics in Medicine , 2007, Statistics in medicine.

[157]  Donglin Zeng,et al.  Estimating Individualized Treatment Rules Using Outcome Weighted Learning , 2012, Journal of the American Statistical Association.

[158]  M. J. Laan,et al.  Targeted Learning: Causal Inference for Observational and Experimental Data , 2011 .

[159]  Robert Gray,et al.  A Proportional Hazards Model for the Subdistribution of a Competing Risk , 1999 .

[160]  C. Aldrich,et al.  Empirical comparison of tree ensemble variable importance measures , 2011 .

[161]  N. Sattar,et al.  Effect of intensive control of glucose on cardiovascular outcomes and death in patients with diabetes mellitus: a meta-analysis of randomised controlled trials , 2009, The Lancet.

[162]  James M. Robins,et al.  Association, Causation, And Marginal Structural Models , 1999, Synthese.

[163]  J. Todd,et al.  Impact of improved treatment of sexually transmitted diseases on HIV infection in rural Tanzania: randomised controlled trial , 1995, The Lancet.

[164]  Romain Neugebauer,et al.  simcausal R Package: Conducting Transparent and Reproducible Simulation Studies of Causal Effect Estimation with Complex Longitudinal Data. , 2017, Journal of statistical software.

[165]  T. VanderWeele,et al.  Mediation analysis with time varying exposures and mediators , 2017, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[166]  David W. Aha,et al.  Instance‐based prediction of real‐valued attributes , 1989, Comput. Intell..

[167]  P. Guttorp,et al.  The Taming of Chance. , 1992 .

[168]  S. Rose Mortality risk score prediction in an elderly population using machine learning. , 2013, American journal of epidemiology.

[169]  Roel Wieringa,et al.  Design Science Methodology for Information Systems and Software Engineering , 2014, Springer Berlin Heidelberg.

[170]  Mark J. van der Laan,et al.  Super learner based conditional density estimation with application to marginal structural models. , 2011 .

[171]  R. Holman,et al.  Effect of intensive blood-glucose control with metformin on complications in overweight patients with type 2 diabetes (UKPDS 34) , 1998, The Lancet.

[172]  M. J. van der Laan,et al.  The International Journal of Biostatistics Targeted Maximum Likelihood Learning , 2011 .

[173]  Maya Petersen,et al.  Estimating the Effect of a Community-Based Intervention with Two Communities , 2013, Journal of causal inference.

[174]  B. Zinman,et al.  Intensive diabetes treatment and cardiovascular disease in patients with type 1 diabetes. , 2005, The New England journal of medicine.

[175]  Aad van der Vaart,et al.  Higher Order Tangent Spaces and Influence Functions , 2014, 1502.00812.

[176]  Muhammad HanifI,et al.  Sampling with Unequal Probabilities without Replacement: A Review , 1980 .

[177]  Michael G. Hudgens,et al.  Large Sample Randomization Inference of Causal Effects in the Presence of Interference , 2014, Journal of the American Statistical Association.

[178]  Mark J. van der Laan,et al.  Estimation of Causal Effects of Community Based Interventions , 2010 .

[179]  P. Hall The Bootstrap and Edgeworth Expansion , 1992 .

[180]  Mohammad H Rahbar,et al.  Time-dependent prediction and evaluation of variable importance using superlearning in high-dimensional clinical data , 2013, The journal of trauma and acute care surgery.

[181]  Judea Pearl,et al.  On the Consistency Rule in Causal Inference: Axiom, Definition, Assumption, or Theorem? , 2010, Epidemiology.

[182]  Richard J. C. M. Starmans,et al.  The Advent of Data Science: Some Considerations on the Unreasonable Effectiveness of Data , 2016, Handbook of Big Data.

[183]  Mark J van der Laan,et al.  Targeted Minimum Loss Based Estimator that Outperforms a given Estimator , 2012, The international journal of biostatistics.

[184]  J. Robins,et al.  Doubly Robust Estimation in Missing Data and Causal Inference Models , 2005, Biometrics.

[185]  J. Wellner,et al.  Inefficient estimators of the bivariate survival function for three models , 1995 .

[186]  M. Halloran,et al.  Causal Inference in Infectious Diseases , 1995, Epidemiology.

[187]  James M Robins,et al.  A mapping between interactions and interference: implications for vaccine trials. , 2012, Epidemiology.

[188]  Uwe Einmahl,et al.  An Empirical Process Approach to the Uniform Consistency of Kernel-Type Function Estimators , 2000 .

[189]  Nicholas A. Christakis,et al.  Social contagion theory: examining dynamic social networks and human behavior , 2011, Statistics in medicine.

[190]  Eric J. Tchetgen Tchetgen,et al.  Semiparametric Estimation of Models for Natural Direct and Indirect Effects , 2011 .

[191]  N. Unwin,et al.  Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III) Detection, Evaluation, and Treatment of High Blood Cholesterol Education Program (NCEP) Expert Panel on Executive Summary of the Third Report of the National , 2009 .

[192]  J. Hájek Asymptotic Theory of Rejective Sampling with Varying Probabilities from a Finite Population , 1964 .

[193]  Sherri Rose,et al.  Computational health economics for identification of unprofitable health care enrollees , 2017, Biostatistics.

[194]  Stephen M. Stigler,et al.  The Seven Pillars of Statistical Wisdom , 2016 .

[195]  John Langford,et al.  Sparse Online Learning via Truncated Gradient , 2008, NIPS.

[196]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[197]  Patrick J. O’Connor,et al.  C-B3-01: Building Toward a Patient-Centered Culture: Insights and Tactics from Literature, Health System Stakeholders, and Patients , 2011, Clinical Medicine & Research.

[198]  J. Robins,et al.  The International Journal of Biostatistics CAUSAL INFERENCE Dynamic Regime Marginal Structural Mean Models for Estimation of Optimal Dynamic Treatment Regimes , Part I : Main Content , 2011 .

[199]  Antoine Chambaz,et al.  Analysis of the effect of occupational exposure to asbestos based on threshold regression modeling of case-control data. , 2014, Biostatistics.

[200]  M. J. van der Laan,et al.  Targeting the Optimal Design in Randomized Clinical Trials with Binary Outcomes and No Covariate: Theoretical Study , 2010 .

[201]  Kenneth Stanley,et al.  Design of Randomized Controlled Trials , 2007, Circulation.

[202]  D. Rubin [On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9.] Comment: Neyman (1923) and Causal Inference in Experiments and Observational Studies , 1990 .

[203]  Ramon van Handel On the minimal penalty for Markov order estimation , 2009, ArXiv.

[204]  E. Nadaraya On Estimating Regression , 1964 .

[205]  M. J. van der Laan,et al.  Mortality prediction in intensive care units with the Super ICU Learner Algorithm (SICULA): a population-based study. , 2015, The Lancet. Respiratory medicine.

[206]  Mark J. van der Laan,et al.  ltmle: An R Package Implementing Targeted Minimum Loss-Based Estimation for Longitudinal Data , 2017 .

[207]  B. Efron Better Bootstrap Confidence Intervals , 1987 .

[208]  Tyler J VanderWeele,et al.  Inference for influence over multiple degrees of separation on a social network , 2013, Statistics in medicine.

[209]  S Haneuse,et al.  Estimation of the effect of interventions that modify the received treatment , 2013, Statistics in medicine.

[210]  Russell Lyons,et al.  The Spread of Evidence-Poor Medicine via Flawed Social-Network Analysis , 2010, 1007.2876.

[211]  J. Pfanzagl,et al.  Asymptotic Expansions for General Statistical Models. , 1987 .

[212]  James M. Robins,et al.  Optimal Structural Nested Models for Optimal Sequential Decisions , 2004 .

[213]  Michael Rosenblum,et al.  Targeted Maximum Likelihood Estimation of the Parameter of a Marginal Structural Model , 2010, The international journal of biostatistics.

[214]  Tim P Morris,et al.  The risks and rewards of covariate adjustment in randomized trials: an assessment of 12 outcomes from 8 studies , 2014, Trials.

[215]  F. Götze,et al.  RESAMPLING FEWER THAN n OBSERVATIONS: GAINS, LOSSES, AND REMEDIES FOR LOSSES , 2012 .

[216]  P. Rosenbaum Interference Between Units in Randomized Experiments , 2007 .

[217]  Marco Carone,et al.  Second-Order Inference for the Mean of a Variable Missing at Random , 2015, The international journal of biostatistics.

[218]  Mark J. van der Laan,et al.  Finding Quantitative Trait Loci Genes , 2011 .

[219]  Aad van der Vaart,et al.  Higher order influence functions and minimax estimation of nonlinear functionals , 2008, 0805.3040.

[220]  M. J. van der Laan,et al.  Targeted Maximum Likelihood Estimation for Dynamic and Static Longitudinal Marginal Structural Working Models , 2014, Journal of causal inference.

[221]  Donglin Zeng,et al.  New Statistical Learning Methods for Estimating Optimal Dynamic Treatment Regimes , 2015, Journal of the American Statistical Association.

[222]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[223]  Romain Neugebauer,et al.  A Case Study of the Impact of Data-Adaptive Versus Model-Based Estimation of the Propensity Scores on Causal Inferences from Three Inverse Probability Weighting Estimators , 2016, The international journal of biostatistics.

[224]  Alexander J. Smola,et al.  Online learning with kernels , 2001, IEEE Transactions on Signal Processing.

[225]  Mark van der Laan,et al.  Population Intervention Causal Effects Based on Stochastic Interventions , 2012, Biometrics.

[226]  G. Dantzig Discrete-Variable Extremum Problems , 1957 .

[227]  O. Macchi The coincidence approach to stochastic point processes , 1975, Advances in Applied Probability.

[228]  R. Lyons Determinantal probability measures , 2002, math/0204325.

[229]  Eric B. Laber,et al.  Dynamic treatment regimes: Technical challenges and applications , 2014 .

[230]  Alexander Soshnikov Gaussian limit for determinantal random point fields , 2000 .

[231]  Eric J Tchetgen Tchetgen,et al.  Why and When "Flawed" Social Network Analyses Still Yield Valid Tests of no Contagion , 2012, Statistics, politics, and policy.

[232]  Kristin E. Porter,et al.  The Relative Performance of Targeted Maximum Likelihood Estimators , 2011, The international journal of biostatistics.

[233]  Sherri Rose,et al.  A Machine Learning Framework for Plan Payment Risk Adjustment. , 2016, Health services research.

[234]  P. Bickel On Adaptive Estimation , 1982 .

[235]  Sherri Rose,et al.  A Novel Targeted Learning Method for Quantitative Trait Loci Mapping , 2014, Genetics.

[236]  Alan E. Hubbard,et al.  Statistical Inference for Data Adaptive Target Parameters , 2016, The international journal of biostatistics.

[237]  Lingling Li,et al.  Inverse probability weighting for covariate adjustment in randomized studies , 2014, Statistics in medicine.

[238]  Douglas B. Kell,et al.  Statistical strategies for avoiding false discoveries in metabolomics and related experiments , 2007, Metabolomics.

[239]  M. Hudgens,et al.  Toward Causal Inference With Interference , 2008, Journal of the American Statistical Association.

[240]  L. Keele,et al.  Identification, Inference and Sensitivity Analysis for Causal Mediation Effects , 2010, 1011.1079.

[241]  J M Robins,et al.  Marginal Mean Models for Dynamic Regimes , 2001, Journal of the American Statistical Association.

[242]  Mark J. van der Laan,et al.  Targeted Maximum Likelihood Based Causal Inference: Part I , 2010 .

[243]  J. Robins,et al.  Marginal structural models to estimate the causal effect of zidovudine on the survival of HIV-positive men. , 2000, Epidemiology.

[244]  S. Cole,et al.  Generalizing evidence from randomized clinical trials to target populations: The ACTG 320 trial. , 2010, American journal of epidemiology.

[245]  L. Keele,et al.  A General Approach to Causal Mediation Analysis , 2010, Psychological methods.

[246]  Mark J van der Laan,et al.  Deletion/Substitution/Addition Algorithm in Learning with Applications in Genomics , 2004, Statistical applications in genetics and molecular biology.

[247]  Jeffrey J. Gaynor,et al.  On the Use of Cause-Specific Failure and Conditional Failure Probabilities: Examples from Clinical Oncology Data , 1993 .

[248]  Antoine Chambaz,et al.  tmle.npvi: targeted, integrative search of associations between DNA copy number and gene expression, accounting for DNA methylation , 2015, Bioinform..

[249]  A. V. D. Vaart,et al.  Oracle inequalities for multi-fold cross validation , 2006 .

[250]  Léon Bottou,et al.  Stochastic Gradient Descent Tricks , 2012, Neural Networks: Tricks of the Trade.

[251]  M H Gail,et al.  The efficiency of the matched-pairs design of the Community Intervention Trial for Smoking Cessation (COMMIT). , 1997, Controlled clinical trials.

[252]  R. Kessler,et al.  How well can post‐traumatic stress disorder be predicted from pre‐trauma risk factors? An exploratory study in the WHO World Mental Health Surveys , 2014, World psychiatry : official journal of the World Psychiatric Association.

[253]  S. Self,et al.  Sieve analysis: methods for assessing from vaccine trial data how vaccine efficacy varies with genotypic and phenotypic pathogen variation. , 2001, Journal of clinical epidemiology.

[254]  Walter Krämer,et al.  Review of Modern applied statistics with S, 4th ed. by W.N. Venables and B.D. Ripley. Springer-Verlag 2002 , 2003 .

[255]  Erica E M Moodie,et al.  Demystifying Optimal Dynamic Treatment Regimes , 2007, Biometrics.

[256]  Marco Carone,et al.  Discussion of “Deductive derivation and turing‐computerization of semiparametric efficient estimation” by Frangakis et al. , 2015, Biometrics.

[257]  Jordan Brooks,et al.  Super Learner and Targeted Maximum Likelihood Estimation for Longitudinal Data Structures with Applications to Atrial Fibrillation , 2012 .

[258]  James M. Robins,et al.  Effect decomposition in the presence of an exposure-induced mediator-outcome confounder. , 2014, Epidemiology.

[259]  T. VanderWeele Sensitivity Analysis for Contagion Effects in Social Networks , 2011, Sociological methods & research.

[260]  L. Bondesson,et al.  Pareto Sampling versus Sampford and Conditional Poisson Sampling , 2006 .

[261]  P. Hall Theoretical Comparison of Bootstrap Confidence Intervals , 1988 .

[262]  Hao Helen Zhang,et al.  Variable selection for covariate‐adjusted semiparametric inference in randomized clinical trials , 2012, Statistics in medicine.

[263]  Stephen M. Stigler,et al.  The History of Statistics: The Measurement of Uncertainty before 1900 , 1986 .

[264]  John Beatty,et al.  The Empire of Chance: How Probability Changed Science and Everyday Life , 1989 .

[265]  Mark J. van der Laan,et al.  A new algorithm for hybrid hierarchical clustering with visualization and the bootstrap , 2003 .

[266]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[267]  James M Robins,et al.  Higher Order Inference On A Treatment Effect Under Low Regularity Conditions. , 2011, Statistics & probability letters.

[268]  Roderick J. A. Little,et al.  Adjusting for Nonignorable Drop-Out Using Semiparametric Nonresponse Models: Comment , 1999 .

[269]  M. J. van der Laan,et al.  The International Journal of Biostatistics Causal Effect Models for Realistic Individualized Treatment and Intention to Treat Rules , 2011 .

[270]  Antoine Chambaz,et al.  Drawing Valid Targeted Inference When Covariate-adjusted Response-adaptive RCT Meets Data-adaptive Loss-based Estimation, With An Application To The LASSO , 2015 .

[271]  Martin Zinkevich,et al.  Online Convex Programming and Generalized Infinitesimal Gradient Ascent , 2003, ICML.

[272]  M. J. Laan,et al.  Online Targeted Learning , 2014 .

[273]  Mark J van der Laan,et al.  Finding Quantitative Trait Loci Genes with Collaborative Targeted Maximum Likelihood Learning. , 2011, Statistics & probability letters.

[274]  D. Rubin Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[275]  J Mark,et al.  A Generally Efficient Targeted Minimum Loss Based Estimator , 2017 .

[276]  Mark J. van der Laan,et al.  Asymptotic Theory for Cross-validated Targeted Maximum Likelihood Estimation , 2010 .

[277]  Detection The sixth report of the Joint National Committee on Detection, Evaluation, and Treatment of High Blood Pressure (JNC VI) , 1997 .

[278]  Odd Aalen,et al.  Nonparametric Estimation of Partial Transition Probabilities in Multiple Decrement Models , 1978 .

[279]  Edward K. Kao,et al.  Estimation of Causal Peer Influence Effects , 2013, ICML.

[280]  Mark J van der Laan,et al.  Optimal Individualized Treatments in Resource-Limited Settings , 2016, The international journal of biostatistics.

[281]  Brian T. Austin,et al.  Improving chronic illness care: translating evidence into action. , 2001, Health affairs.

[282]  Colin L. Mallows,et al.  Variations on the Histogram , 2009 .

[283]  M. J. Laan Statistical Inference for Variable Importance , 2006 .

[284]  Richard S. Johannes,et al.  Using the ADAP Learning Algorithm to Forecast the Onset of Diabetes Mellitus , 1988 .

[285]  Michael E. Miller,et al.  Effects of intensive glucose lowering in type 2 diabetes. , 2008, The New England journal of medicine.

[286]  J. Pearl The Mediation Formula: A Guide to the Assessment of Causal Pathways in Nonlinear Models , 2011 .

[287]  Stéphan Clémençon,et al.  Empirical Processes in Survey Sampling with (Conditional) Poisson Designs , 2017 .

[288]  Sherri Rose,et al.  The International Journal of Biostatistics Why Match ? Investigating Matched Case-Control Study Designs with Causal Effect Estimation , 2011 .

[289]  Margaret Wood,et al.  The Apgar score has survived the test of time. , 2005, Anesthesiology.

[290]  J. Robins,et al.  Toward a curse of dimensionality appropriate (CODA) asymptotic theory for semi-parametric models. , 1997, Statistics in medicine.

[291]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[292]  M. Sampford,et al.  On sampling without replacement with unequal probabilities of selection. , 1967, Biometrika.

[293]  Erin LeDell,et al.  Super Learner Analysis of Electronic Adherence Data Improves Viral Prediction and May Provide Strategies for Selective HIV RNA Monitoring , 2015, Journal of acquired immune deficiency syndromes.

[294]  Mark J van der Laan,et al.  Empirical Efficiency Maximization: Improved Locally Efficient Covariate Adjustment in Randomized Experiments and Survival Analysis , 2008, The international journal of biostatistics.

[295]  Dylan Walker,et al.  Tie Strength, Embeddedness, and Social Influence: A Large-Scale Networked Experiment , 2014, Manag. Sci..

[296]  C. Manski Nonparametric Bounds on Treatment Effects , 1989 .

[297]  M. J. Laan,et al.  Adaptive pair‐matching in randomized trials with unbiased and efficient effect estimation , 2015, Statistics in medicine.

[298]  J. Robins,et al.  Marginal Structural Models and Causal Inference in Epidemiology , 2000, Epidemiology.

[299]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[300]  Vinay Prasad,et al.  Characteristics of cluster randomized trials: are they living up to the randomized trial? , 2013, JAMA internal medicine.

[301]  Y. Peres,et al.  Determinantal Processes and Independence , 2005, math/0503110.

[302]  Akritee Shrestha,et al.  Mental Health Risk Adjustment with Clinical Categories and Machine Learning , 2018, Health services research.

[303]  Mark J. van der Laan,et al.  Targeted Maximum Likelihood Estimation for Network Data , 2015 .

[304]  Romain Neugebauer,et al.  Impact of Specific Glucose-Control Strategies on Microvascular and Macrovascular Outcomes in 58,000 Adults With Type 2 Diabetes , 2013, Diabetes Care.

[305]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[306]  Marti A. Hearst Trends & Controversies: Support Vector Machines , 1998, IEEE Intell. Syst..

[307]  Karl J. Friston,et al.  Analysing connectivity with Granger causality and dynamic causal modelling , 2013, Current Opinion in Neurobiology.

[308]  Hui Wang,et al.  Dimension reduction with gene expression data using targeted variable importance measurement , 2011, BMC Bioinformatics.

[309]  Bernard R. Rosner,et al.  Fundamentals of Biostatistics. , 1992 .

[310]  J. Robins,et al.  Recovery of Information and Adjustment for Dependent Censoring Using Surrogate Markers , 1992 .

[311]  Peter Z. Schochet Estimators for Clustered Education RCTs Using the Neyman Model for Causal Inference , 2013 .

[312]  J. Robins,et al.  Estimating the causal effect of zidovudine on CD4 count with a marginal structural model for repeated measures , 2002, Statistics in medicine.

[313]  J. Lewis,et al.  Statistical principles for clinical trials (ICH E9): an introductory note on an international guideline. , 1999, Statistics in medicine.

[314]  Mark J van der Laan,et al.  Assessing the Causal Effect of Policies: An Example Using Stochastic Interventions , 2013, The international journal of biostatistics.

[315]  M. Friedman,et al.  A Predictive Study of Coronary Heart Disease: The Western Collaborative Group Study , 1964 .

[316]  Edward H Kennedy,et al.  Non‐parametric methods for doubly robust estimation of continuous treatment effects , 2015, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[317]  Mark J van der Laan,et al.  The International Journal of Biostatistics Direct Effect Models , 2011 .

[318]  Joseph P. Romano,et al.  A Review of Bootstrap Confidence Intervals , 1988 .

[319]  M. J. van der Laan,et al.  The International Journal of Biostatistics Collaborative Double Robust Targeted Maximum Likelihood Estimation , 2011 .

[320]  M J van der Laan,et al.  Covariate adjustment in randomized trials with binary outcomes: Targeted maximum likelihood estimation , 2009, Statistics in medicine.

[321]  Mark J. van der Laan,et al.  Causal Inference for a Population of Causally Connected Units , 2014 .

[322]  S. Murphy,et al.  An experimental design for the development of adaptive treatment strategies , 2005, Statistics in medicine.

[323]  Joseph P. Romano,et al.  Nonparametric confidence limits by resampling methods and least favorable families , 1990 .

[324]  Mark J. van der Laan Nonparametric Maximum Likelihood , 2014 .

[325]  Mark J van der Laan,et al.  Targeted Learning of the Mean Outcome under an Optimal Dynamic Treatment Rule , 2015, Journal of causal inference.

[326]  A. Philip Dawid,et al.  Direct and Indirect Effects of Sequential Treatments , 2006, UAI.

[327]  Tyler J VanderWeele,et al.  Causal inference under multiple versions of treatment , 2013, Journal of causal inference.

[328]  Mark J van der Laan,et al.  Super Learning: An Application to the Prediction of HIV-1 Drug Resistance , 2007, Statistical applications in genetics and molecular biology.

[329]  S. Dudoit,et al.  Asymptotics of cross-validated risk estimation in estimator selection and performance assessment , 2005 .

[330]  Aad van der Vaart,et al.  The Cross-Validated Adaptive Epsilon-Net Estimator , 2006 .

[331]  Min Zhang,et al.  Estimating optimal treatment regimes from a classification perspective , 2012, Stat.

[332]  Tyler J. VanderWeele,et al.  Social Networks and Causal Inference , 2013 .

[333]  James M. Robins,et al.  The International Journal of Biostatistics CAUSAL INFERENCE When to Start Treatment ? A Systematic Approach to the Comparison of Dynamic Regimes Using Observational Data , 2011 .

[334]  R. Scheines,et al.  Interventions and Causal Inference , 2007, Philosophy of Science.

[335]  K. Do,et al.  Efficient and Adaptive Estimation for Semiparametric Models. , 1994 .

[336]  Mark J. van der Laan,et al.  Entering the Era of Data Science: Targeted Learning and the Integration of Statistics and Computational Data Analysis , 2014 .

[337]  Mark J. van der Laan,et al.  Computerizing Efficient Estimation of a Pathwise Differentiable Target Parameter , 2015 .

[338]  Ira B. Tager,et al.  Short-Term Effects of Air Pollution on Wheeze in Asthmatic Children in Fresno, California , 2010, Environmental health perspectives.

[339]  Leo Breiman,et al.  Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author) , 2001 .

[340]  P. Aronow,et al.  Estimating Average Causal Effects Under Interference Between Units , 2015 .

[341]  J. Pfanzagl,et al.  CONTRIBUTIONS TO A GENERAL ASYMPTOTIC STATISTICAL THEORY , 1982 .

[342]  T. Fine,et al.  The Emergence of Probability , 1976 .

[343]  Ashley I Naimi,et al.  Stochastic mediation contrasts in epidemiologic research: interpregnancy interval and the educational disparity in preterm delivery. , 2014, American journal of epidemiology.

[344]  P B Gilbert,et al.  Comparison of competing risks failure time methods and time-independent methods for assessing strain variations in vaccine protection. , 2000, Statistics in medicine.

[345]  M. J. van der Laan,et al.  Statistical Issues and Limitations in Personalized Medicine Research with Clinical Trials , 2012, The international journal of biostatistics.

[346]  Mark J. van der Laan,et al.  Hybrid Clustering of Gene Expression Data with Visualization and the Bootstrap , 2001 .

[347]  Tyler J. VanderWeele,et al.  Marginal Structural Models for the Estimation of Direct and Indirect Effects , 2009, Epidemiology.

[348]  H. Sung,et al.  Selecting Therapeutic Strategies Based on Efficacy and Death in Multicourse Clinical Trials , 2002 .

[349]  Roland R. Ramsahai,et al.  From sample average treatment effect to population average treatment effect on the treated: combining experimental with observational studies to estimate population treatment effects , 2015 .

[350]  Mark J van der Laan,et al.  Biomarker discovery using targeted maximum‐likelihood estimation: Application to the treatment of antiretroviral‐resistant HIV infection , 2009, Statistics in medicine.

[351]  J. Tacq,et al.  Causality in qualitative and quantitative research , 2011 .

[352]  B. Chakraborty,et al.  Statistical Methods for Dynamic Treatment Regimes: Reinforcement Learning, Causal Inference, and Personalized Medicine , 2013 .

[353]  Gerd Gigerenzer,et al.  The Probabilistic revolution , 1987 .

[354]  J. Robins,et al.  Effect of highly active antiretroviral therapy on time to acquired immunodeficiency syndrome or death using marginal structural models. , 2003, American journal of epidemiology.

[355]  J. Robins,et al.  Identifiability and Exchangeability for Direct and Indirect Effects , 1992, Epidemiology.

[356]  John D. Kalbfleisch,et al.  Misspecified proportional hazard models , 1986 .

[357]  W. Rosenberger,et al.  The theory of response-adaptive randomization in clinical trials , 2006 .

[358]  Sherri Rose,et al.  A double robust approach to causal effects in case-control studies. , 2014, American journal of epidemiology.

[359]  Rodica Pop-Busui,et al.  Effect of intensive treatment of hyperglycaemia on microvascular outcomes in type 2 diabetes: an analysis of the ACCORD randomised trial , 2010, The Lancet.

[360]  Mark J van der Laan,et al.  Identification and Efficient Estimation of the Natural Direct Effect among the Untreated , 2013, Biometrics.

[361]  S. Murphy,et al.  PERFORMANCE GUARANTEES FOR INDIVIDUALIZED TREATMENT RULES. , 2011, Annals of statistics.

[362]  Philip W. Lavori,et al.  A design for testing clinical strategies: biased adaptive within‐subject randomization , 2000 .

[363]  A. Tsybakov,et al.  Fast learning rates for plug-in classifiers , 2007, 0708.2321.

[364]  Michael Rosenblum,et al.  Leveraging prognostic baseline variables to gain precision in randomized trials , 2015, Statistics in medicine.

[365]  Mark J van der Laan,et al.  Targeted Maximum Likelihood Estimation for Prediction Calibration , 2012, The international journal of biostatistics.

[366]  D. Brock,et al.  Ethical challenges in long-term funding for HIV/AIDS. , 2009, Health affairs.

[367]  M. Davidian,et al.  Covariate adjustment for two‐sample treatment comparisons in randomized clinical trials: A principled yet flexible approach , 2008, Statistics in medicine.

[368]  Cosma Rohilla Shalizi,et al.  Philosophy and the practice of Bayesian statistics. , 2010, The British journal of mathematical and statistical psychology.

[369]  J. Mark,et al.  Targeted estimation of nuisance parameters to obtain valid statistical inference. , 2014 .

[370]  Cheng Ju,et al.  Online cross‐validation‐based ensemble learning , 2018, Statistics in medicine.

[371]  S. Keleş,et al.  Statistical Applications in Genetics and Molecular Biology Asymptotic Optimality of Likelihood-Based Cross-Validation , 2011 .

[372]  M S Kramer,et al.  Promotion of Breastfeeding Intervention Trial (PROBIT): a randomized trial in the Republic of Belarus. , 2001, JAMA.

[373]  E. Mammen,et al.  Smooth Discrimination Analysis , 1999 .

[374]  Salomon Banarer Glucose control and vascular complications in type 2 diabetes. , 2009, The New England journal of medicine.

[375]  Grant D. Huang,et al.  Glucose control and vascular complications in veterans with type 2 diabetes. , 2009, The New England journal of medicine.

[376]  Kosuke Imai,et al.  (www.interscience.wiley.com) DOI: 10.1002/sim.3337 Variance identification and efficiency analysis in randomized experiments under the matched-pair design , 2022 .

[377]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[378]  A. Philip Dawid,et al.  Identifying the consequences of dynamic treatment strategies: A decision-theoretic overview , 2010, ArXiv.

[379]  Robin Henderson,et al.  Estimation of optimal dynamic anticoagulation regimes from observational data: a regret-based approach. , 2006, Statistics in medicine.

[380]  Gary King,et al.  The essential role of pair matching in cluster-randomized experiments, with application to the Mexican Universal Health Insurance Evaluation , 2009, 0910.3752.

[381]  A. W. van der Vaart,et al.  A local maximal inequality under uniform entropy. , 2010, Electronic journal of statistics.

[382]  A. V. D. Vaart,et al.  Asymptotic Statistics: Frontmatter , 1998 .

[383]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[384]  J Mark,et al.  Causal Inference for Networks , 2012 .

[385]  Mark J. van der Laan,et al.  Nonparametric causal effects based on marginal structural models , 2007 .

[386]  Romain Neugebauer,et al.  Robust extraction of covariate information to improve estimation efficiency in randomized trials , 2011, Statistics in medicine.

[387]  Mark J van der Laan,et al.  Discussion of Identification, Estimation and Approximation of Risk under Interventions that Depend on the Natural Value of Treatment Using Observational Data, by Jessica Young, Miguel Hernán, and James Robins , 2014, Journal of causal inference.

[388]  Deborah G. Mayo,et al.  Error and Inference: Recent Exchanges on Experimental Reasoning, Reliability, and the Objectivity and Rationality of Science , 2009 .

[389]  Susan A. Murphy,et al.  Rejoinder of “Dynamic treatment regimes: Technical challenges and applications” , 2014, Electronic Journal of Statistics.

[390]  J. Robins A new approach to causal inference in mortality studies with a sustained exposure period—application to control of the healthy worker survivor effect , 1986 .

[391]  J. Ioannidis Why Most Discovered True Associations Are Inflated , 2008, Epidemiology.

[392]  Jon A. Wellner,et al.  Weak Convergence and Empirical Processes: With Applications to Statistics , 1996 .

[393]  Dylan Walker,et al.  Identifying Social Influence in Networks Using Randomized Experiments , 2011, IEEE Intelligent Systems.

[394]  Diederick Grobbee,et al.  Intensive blood glucose control and vascular outcomes in patients with type 2 diabetes. , 2008, The New England journal of medicine.

[395]  Tyler J VanderWeele,et al.  Alternative Assumptions for the Identification of Direct and Indirect Effects , 2011, Epidemiology.

[396]  Tianchen Qian,et al.  Deductive derivation and turing‐computerization of semiparametric efficient estimation , 2015, Biometrics.

[397]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[398]  Douglas L. Miller,et al.  Bootstrap-Based Improvements for Inference with Clustered Errors , 2007 .

[399]  S. Dudoit,et al.  Unified Cross-Validation Methodology For Selection Among Estimators and a General Cross-Validated Adaptive Epsilon-Net Estimator: Finite Sample Oracle Inequalities and Examples , 2003 .

[400]  Ursula Gather,et al.  Combining regular and irregular histograms by penalized likelihood , 2010, Comput. Stat. Data Anal..

[401]  Eric B. Laber,et al.  A Robust Method for Estimating Optimal Treatment Regimes , 2012, Biometrics.

[402]  C. Steglich,et al.  DYNAMIC NETWORKS AND BEHAVIOR: SEPARATING SELECTION FROM INFLUENCE: separating selection from influence , 2010 .

[403]  Chen Avin,et al.  Identifiability of Path-Specific Effects , 2005, IJCAI.

[404]  S. Cole,et al.  Time-modified confounding. , 2009, American journal of epidemiology.

[405]  Antoine Chambaz,et al.  Estimation of a non-parametric variable importance measure of a continuous exposure. , 2012, Electronic journal of statistics.

[406]  Ree Dawson,et al.  Adaptive treatment strategies in chronic disease. , 2008, Annual review of medicine.

[407]  Laura Balzer,et al.  Estimating Effects with Rare Outcomes and High Dimensional Covariates: Knowledge is Power , 2016, Epidemiologic methods.

[408]  Mark J van der Laan,et al.  Adaptive pre‐specification in randomized trials with and without pair‐matching , 2016, Statistics in medicine.

[409]  Onyebuchi A Arah,et al.  Bias Formulas for Sensitivity Analysis of Unmeasured Confounding for General Outcomes, Treatments, and Confounders , 2011, Epidemiology.

[410]  Romain Neugebauer,et al.  Targeted learning in real‐world comparative effectiveness research with time‐varying interventions , 2014, Statistics in medicine.

[411]  Andrea Manca,et al.  A substantial and confusing variation exists in handling of baseline covariates in randomized controlled trials: a review of trials published in leading medical journals. , 2010, Journal of clinical epidemiology.

[412]  M J van der Laan,et al.  Inference in Targeted Group‐Sequential Covariate‐Adjusted Randomized Clinical Trials , 2014, Scandinavian journal of statistics, theory and applications.

[413]  S. Murphy,et al.  Optimal dynamic treatment regimes , 2003 .

[414]  Koby Crammer,et al.  Online Passive-Aggressive Algorithms , 2003, J. Mach. Learn. Res..

[415]  D. Zucker Design and Analysis of Cluster Randomization Trials , 2003 .

[416]  Mark J van der Laan,et al.  EFFECT OF BREASTFEEDING ON GASTROINTESTINAL INFECTION IN INFANTS: A TARGETED MAXIMUM LIKELIHOOD APPROACH FOR CLUSTERED LONGITUDINAL DATA. , 2014, The annals of applied statistics.

[417]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[418]  P. McCullagh,et al.  Some aspects of analysis of covariance. , 1982, Biometrics.

[419]  James M. Robins,et al.  Causal inference for complex longitudinal data: the continuous case , 2001 .

[420]  Mark J van der Laan,et al.  Targeted Maximum Likelihood Estimation of Effect Modification Parameters in Survival Analysis , 2011, The international journal of biostatistics.

[421]  V T Farewell,et al.  The analysis of failure times in the presence of competing risks. , 1978, Biometrics.

[422]  James Robins,et al.  Quadratic semiparametric Von Mises calculus , 2009, Metrika.

[423]  M. Rudelson,et al.  Hanson-Wright inequality and sub-gaussian concentration , 2013 .

[424]  Michael J. Campbell,et al.  Cluster Randomized Trials , 2014 .

[425]  Antoine Chambaz,et al.  Targeted Covariate-Adjusted Response-Adaptive LASSO-Based Randomized Controlled Trials , 2014 .

[426]  Judea Pearl,et al.  Direct and Indirect Effects , 2001, UAI.

[427]  Mark J. van der Laan,et al.  The Highly Adaptive Lasso Estimator , 2016, 2016 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[428]  M. J. van der Laan,et al.  STATISTICAL INFERENCE FOR THE MEAN OUTCOME UNDER A POSSIBLY NON-UNIQUE OPTIMAL TREATMENT STRATEGY. , 2016, Annals of statistics.

[429]  J Mark,et al.  The Construction and Analysis of Adaptive Group Sequential Designs , 2008 .

[430]  Elizabeth L. Ogburn,et al.  Causal Inference for Social Network Data , 2017, Journal of the American Statistical Association.

[431]  Melania Pintilie,et al.  Analysing and interpreting competing risk data , 2007, Statistics in medicine.

[432]  T. Stengos,et al.  Non‐linearities in cross‐country growth regressions: a semiparametric approach , 1999 .

[433]  Mark J. van der Laan,et al.  Individualized Antiretroviral Initiation Rules , 2011 .

[434]  D. Levy,et al.  Prediction of coronary heart disease using risk factor categories. , 1998, Circulation.