Causal Inference and Estimands in Clinical Trials

Abstract The National Research Council’s report on the prevention and treatment of missing data highlighted the need to clearly specify causal estimands. This focus fundamentally changed how the missing data problem was perceived and addressed in clinical trials. The recent ICH E9(R1) addendum is another major step in promoting the use of the causal estimands framework that should further influence how clinical trial protocols and statistical analysis plans are written and implemented. The language of potential outcomes that is widely accepted in the causal inference literature is not widely recognized in the clinical trialists community and was not used in defining causal estimands in the NRC report or the ICH E9(R1). In this article, we attempt to bridge the gap between the causal inference community and clinical trialists to further advance the use of causal estimands in clinical trial settings. We illustrate how concepts from causal literature, such as potential outcomes and dynamic treatment regimens, can facilitate defining and implementing causal estimands and may provide a unifying language to describing the targets for both observational and randomized clinical trials.

[1]  J M Robins,et al.  Correction for non-compliance in equivalence trials. , 1998, Statistics in medicine.

[2]  Jiannan Lu,et al.  Principal stratification analysis using principal scores , 2016, 1602.01196.

[3]  G. Molenberghs,et al.  Choosing Estimands in Clinical Trials: Putting the ICH E9(R1) Into Practice. , 2019, Therapeutic innovation & regulatory science.

[4]  Elizabeth A Stuart,et al.  Matching methods for causal inference: A review and a look forward. , 2010, Statistical science : a review journal of the Institute of Mathematical Statistics.

[5]  Thomas Permutt,et al.  A taxonomy of estimands for regulatory clinical trials with discontinuations , 2016, Statistics in medicine.

[6]  B L De Stavola,et al.  Methods for dealing with time‐dependent confounding , 2013, Statistics in medicine.

[7]  Roderick Little,et al.  Intention‐to‐treat analysis with treatment discontinuation and missing data in clinical trials , 2015, Statistics in medicine.

[8]  Kosuke Imai,et al.  Sharp bounds on the causal effects in randomized experiments with "truncation-by-death" , 2008 .

[9]  D. Mehrotra,et al.  Rank‐based principal stratum sensitivity analyses , 2013, Statistics in medicine.

[10]  Kaspar Rufibach,et al.  Treatment effect quantification for time‐to‐event endpoints–Estimands, analysis strategies, and beyond , 2017, Pharmaceutical statistics.

[11]  R J Little,et al.  Causal effects in clinical and epidemiological studies via potential outcomes: concepts and analytical approaches. , 2000, Annual review of public health.

[12]  Tyler J VanderWeele,et al.  Causal inference under multiple versions of treatment , 2013, Journal of causal inference.

[13]  P. Gilbert,et al.  Sensitivity Analyses Comparing Time‐to‐Event Outcomes Only Existing in a Subset Selected Postrandomization and Relaxing Monotonicity , 2011, Biometrics.

[14]  Tyler J. VanderWeele,et al.  Conceptual issues concerning mediation, interventions and composition , 2009 .

[15]  Thomas Permutt,et al.  Sensitivity analysis for missing data in regulatory submissions , 2016, Statistics in medicine.

[16]  T. Speed,et al.  On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9 , 1990 .

[17]  Susan M Shortreed,et al.  Estimating the optimal dynamic antipsychotic treatment regime: evidence from the sequential multiple‐assignment randomized Clinical Antipsychotic Trials of Intervention and Effectiveness schizophrenia study , 2012, Journal of the Royal Statistical Society. Series C, Applied statistics.

[18]  Avi Feller,et al.  Bounding, An Accessible Method for Estimating Principal Causal Effects, Examined and Explained , 2017, 1701.03139.

[19]  Haoda Fu,et al.  A General Framework for Treatment Effect Estimators Considering Patient Adherence , 2020 .

[20]  A. Dawid,et al.  Causal Inference without Counterfactuals , 2000 .

[21]  Deepak L. Bhatt,et al.  On the use of propensity scores in case of rare exposure , 2016, BMC Medical Research Methodology.

[22]  Y. Lou,et al.  Estimation of causal effects in clinical endpoint bioequivalence studies in the presence of intercurrent events: noncompliance and missing data , 2018, Journal of biopharmaceutical statistics.

[23]  D. Pauler,et al.  An Estimator for Treatment Comparisons among Survivors in Randomized Trials , 2005, Biometrics.

[25]  J. Lieberman,et al.  Effectiveness of antipsychotic drugs in patients with chronic schizophrenia. , 2005, The New England journal of medicine.

[26]  D. Rubin,et al.  Principal Stratification in Causal Inference , 2002, Biometrics.

[27]  J. Pearl Causal inference in statistics: An overview , 2009 .

[28]  K. Abrams,et al.  Simultaneous analysis of quality of life and survival data , 2002, Statistical methods in medical research.

[29]  Donald B. Rubin,et al.  Estimation of Causal Effects via Principal Stratification When Some Outcomes are Truncated by “Death” , 2003 .

[30]  R. D'Agostino Adjustment Methods: Propensity Score Methods for Bias Reduction in the Comparison of a Treatment to a Non‐Randomized Control Group , 2005 .

[31]  Baldur P Magnusson,et al.  Bayesian inference for a principal stratum estimand to assess the treatment effect in a subgroup characterized by post-randomization events , 2018, 1809.03741.

[32]  Joshua D. Angrist,et al.  Identification of Causal Effects Using Instrumental Variables , 1993 .

[33]  S. Murphy,et al.  Optimal dynamic treatment regimes , 2003 .

[34]  J. Robins,et al.  Marginal Structural Models and Causal Inference in Epidemiology , 2000, Epidemiology.

[35]  T. Richardson Single World Intervention Graphs ( SWIGs ) : A Unification of the Counterfactual and Graphical Approaches to Causality , 2013 .

[36]  M. Gail,et al.  Biased estimates of treatment effect in randomized experiments with nonlinear regressions and omitted covariates , 1984 .

[37]  Feng Li,et al.  Trimmed means for symptom trials with dropouts. , 2017, Pharmaceutical statistics.

[38]  T. Permutt Effects in Adherent Subjects , 2018, Statistics in Biopharmaceutical Research.

[39]  James R Carpenter,et al.  Analysis of Longitudinal Trials with Protocol Deviation: A Framework for Relevant, Accessible Assumptions, and Inference via Multiple Imputation , 2013, Journal of biopharmaceutical statistics.

[40]  D. Rubin,et al.  MULTIPLE IMPUTATIONS IN SAMPLE SURVEYS-A PHENOMENOLOGICAL BAYESIAN APPROACH TO NONRESPONSE , 2002 .

[41]  Donald B. Rubin,et al.  Bayesian Inference for Causal Effects: The Role of Randomization , 1978 .

[42]  S. Pocock,et al.  A win ratio approach to comparing continuous non‐normal outcomes in clinical trials , 2016, Pharmaceutical statistics.

[43]  T. Permutt Treatment Effects, Comparisons, and Randomization , 2020, Statistics in Biopharmaceutical Research.

[44]  G. Shaw,et al.  Maternal pesticide exposure from multiple sources and selected congenital anomalies. , 1999 .

[45]  J. Robins A new approach to causal inference in mortality studies with a sustained exposure period—application to control of the healthy worker survivor effect , 1986 .

[46]  R. D'Agostino Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. , 2005, Statistics in medicine.

[47]  D. Rubin,et al.  Bayesian inference for causal effects in randomized experiments with noncompliance , 1997 .

[48]  A. P. Dawid,et al.  Causal inference without counterfactuals (with Discussion) , 2000 .

[49]  D. Rubin [On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9.] Comment: Neyman (1923) and Causal Inference in Experiments and Observational Studies , 1990 .

[50]  Judea Pearl,et al.  Causal Inference in the Health Sciences: A Conceptual Introduction , 2001, Health Services and Outcomes Research Methodology.

[51]  Peter C. Austin,et al.  A critical appraisal of propensity score matching in the medical literature from 1996 to 2003 , 2008 .

[52]  M. Robins James,et al.  Estimation of the causal effects of time-varying exposures , 2008 .

[53]  Peter C Austin,et al.  A critical appraisal of propensity‐score matching in the medical literature between 1996 and 2003 , 2008, Statistics in medicine.

[54]  Brent A. Johnson,et al.  Estimating Mean Response as a Function of Treatment Duration in an Observational Study, Where Duration May Be Informatively Censored , 2004, Biometrics.

[55]  D B Rubin,et al.  More powerful randomization-based p-values in double-blind trials with non-compliance. , 1998, Statistics in medicine.

[56]  G. Molenberghs,et al.  Choosing estimands in clinical trials with missing data , 2017, Pharmaceutical statistics.

[57]  Michael Rosenblum,et al.  Marginal Structural Models , 2011 .

[58]  D. Scharfstein,et al.  Cautions as Regulators Move to End Exclusive Reliance on Intention to Treat , 2018, Annals of Internal Medicine.

[59]  Nicky Best,et al.  A causal modelling framework for reference-based imputation and tipping point analysis , 2017, 1705.04506.

[60]  Sander Greenland,et al.  Causal Diagrams , 2011, International Encyclopedia of Statistical Science.

[61]  S. Murphy,et al.  An experimental design for the development of adaptive treatment strategies , 2005, Statistics in medicine.

[62]  J. Lunceford,et al.  Stratification and weighting via the propensity score in estimation of causal treatment effects: a comparative study , 2004, Statistics in medicine.

[63]  Fang Liu,et al.  Missing data in clinical trials: control‐based mean imputation and sensitivity analysis , 2017, Pharmaceutical statistics.

[64]  J. Lachin Worst-rank score analysis with informatively missing observations in clinical trials. , 1999, Controlled clinical trials.

[65]  Erica E M Moodie,et al.  Demystifying Optimal Dynamic Treatment Regimes , 2007, Biometrics.

[66]  Erik T Parner,et al.  Causal inference in survival analysis using pseudo‐observations , 2017, Statistics in medicine.

[67]  Björn Bornkamp,et al.  Estimating the Treatment Effect in a Subgroup Defined by an Early Post-Baseline Biomarker Measurement in Randomized Clinical Trials With Time-To-Event Endpoint , 2018, Statistics in Biopharmaceutical Research.

[68]  Richard J. Cook,et al.  Does Cox analysis of a randomized survival study yield a causal treatment effect? , 2015, Lifetime data analysis.

[69]  D. Mehrotra,et al.  A Comparison of Eight Methods for the Dual‐Endpoint Evaluation of Efficacy in a Proof‐of‐Concept HIV Vaccine Trial , 2006, Biometrics.

[70]  Brent A. Johnson,et al.  Semiparametric inference in observational duration-response studies, with duration possibly right-censored , 2005 .

[71]  Elizabeth A Stuart,et al.  On the use of propensity scores in principal causal effect estimation , 2009, Statistics in medicine.

[72]  D. Rubin Multiple imputation for nonresponse in surveys , 1989 .

[73]  Lena Osterhagen,et al.  Multiple Imputation For Nonresponse In Surveys , 2016 .

[74]  A. Cipriani,et al.  What is an intention to treat analysis? , 2008, Epidemiologia e Psichiatria Sociale.

[75]  Tyler J VanderWeele,et al.  Principal Stratification -- Uses and Limitations , 2011, The international journal of biostatistics.

[76]  Heinz Schmidli,et al.  Bayesian inference for a principal stratum estimand to assess the treatment effect in a subgroup characterized by postrandomization event occurrence , 2019, Statistics in medicine.

[77]  Joseph G Ibrahim,et al.  Estimating treatment effects with treatment switching via semicompeting risks models: an application to a colorectal cancer study. , 2012, Biometrika.