Model-Robust Inference for Clinical Trials that Improve Precision by Stratified Randomization and Covariate Adjustment

Two commonly used methods for improving precision and power in clinical trials are stratified randomization and covariate adjustment. However, many trials do not fully capitalize on the combined precision gains from these two methods, which can lead to wasted resources in terms of sample size and trial duration. We derive consistency and asymptotic normality of model-robust estimators that combine these two methods, and show that these estimators can lead to substantial gains in precision and power. Our theorems cover a class of estimators that handle continuous, binary, and time-to-event outcomes; missing outcomes under the missing at random assumption are handled as well. For each estimator, we give a formula for a consistent variance estimator that is model-robust and that fully captures variance reductions from stratified randomization and covariate adjustment. Also, we give the first proof (to the best of our knowledge) of consistency and asymptotic normality of the Kaplan-Meier estimator under stratified randomization, and we derive its asymptotic variance. The above results also hold for the biased-coin covariate-adaptive design. We demonstrate our results using three completed, phase 3, randomized trial data sets of treatments for substance use disorder, where the variance reduction due to stratified randomization and covariate adjustment ranges from 1% to 36%.

[1]  Federico A. Bugni,et al.  Inference under covariate-adaptive randomization with multiple treatments , 2019 .

[2]  T. Speed,et al.  On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9 , 1990 .

[3]  R. Kay Statistical Principles for Clinical Trials , 1998, The Journal of international medical research.

[4]  B. Kahan,et al.  Improper analysis of trials randomised using stratified blocks or minimisation , 2012, Statistics in medicine.

[5]  P. Lane Handling drop‐out in longitudinal clinical trials: a comparison of the LOCF and MMRM approaches , 2008, Pharmaceutical statistics.

[6]  J. Robins,et al.  Adjusting for Nonignorable Drop-Out Using Semiparametric Nonresponse Models , 1999 .

[7]  Zheng Su,et al.  The pursuit of balance: An overview of covariate-adaptive randomization techniques in clinical trials. , 2015, Contemporary clinical trials.

[8]  Pranab Kumar Sen,et al.  12 Asymptotics in finite population sampling , 1988 .

[9]  Jeffrey J. Annon,et al.  Buprenorphine tapering schedule and illicit opioid use. , 2009, Addiction.

[10]  Jun Shao,et al.  Validity of Tests under Covariate‐Adaptive Biased Coin Randomization and Generalized Linear Models , 2013, Biometrics.

[11]  Kari Lock Morgan,et al.  Rerandomization to improve covariate balance in experiments , 2012, 1207.5625.

[12]  Li Yang,et al.  Testing for Treatment Effect in Covariate-Adaptive Randomized Clinical Trials with Generalized Linear Models and Omitted Covariates , 2020, 2009.04136.

[13]  S. Sonne,et al.  Adjunctive counseling during brief and extended buprenorphine-naloxone treatment for prescription opioid dependence: a 2-phase randomized controlled trial. , 2011, Archives of general psychiatry.

[14]  B. Efron Forcing a sequential experiment to be balanced , 1971 .

[15]  M. Kosorok Introduction to Empirical Processes and Semiparametric Inference , 2008 .

[16]  M. Davidian,et al.  Covariate adjustment for two‐sample treatment comparisons in randomized clinical trials: A principled yet flexible approach , 2008, Statistics in medicine.

[17]  P. Rosenbaum Covariance Adjustment in Randomized Experiments and Observational Studies , 2002 .

[18]  J. Robins,et al.  Comment: Performance of Double-Robust Estimators When “Inverse Probability” Weights Are Highly Variable , 2007, 0804.2965.

[19]  J. Shao,et al.  Inference on Average Treatment Effect under Minimization and Other Covariate-Adaptive Randomization Methods , 2020, 2007.09576.

[20]  L. Tian,et al.  Robust Alternatives to ANCOVA for Estimating the Treatment Effect via a Randomized Comparative Study , 2019, Journal of the American Statistical Association.

[21]  Jun Shao,et al.  A theory for testing hypotheses under covariate-adaptive randomization , 2010 .

[22]  K. Das Asymptotic Optimality of Restricted Maximum Likelihood Estimates for the Mixed Model , 1979 .

[23]  Min Zhang,et al.  Robust methods to improve efficiency and reduce bias in estimating survival curves in randomized clinical trials , 2015, Lifetime data analysis.

[24]  M J van der Laan,et al.  Covariate adjustment in randomized trials with binary outcomes: Targeted maximum likelihood estimation , 2009, Statistics in medicine.

[25]  Niels Keiding,et al.  Statistical Models Based on Counting Processes , 1993 .

[26]  J P Matts,et al.  Randomization in clinical trials: conclusions and recommendations. , 1988, Controlled clinical trials.

[27]  Andrea Manca,et al.  A substantial and confusing variation exists in handling of baseline covariates in randomized controlled trials: a review of trials published in leading medical journals. , 2010, Journal of clinical epidemiology.

[28]  J. Shao,et al.  Robust tests for treatment effect in survival analysis under covariate‐adaptive randomization , 2018, Journal of the Royal Statistical Society: Series B (Statistical Methodology).

[29]  Yahong Peng,et al.  Recommendations for the Primary Analysis of Continuous Endpoints in Longitudinal Clinical Trials , 2008 .

[30]  Jiming Jiang,et al.  Asymptotic Analysis of Mixed Effects Models: Theory, Applications, and Open Problems , 2017 .

[31]  A. Tsiatis,et al.  Semiparametric estimation of treatment effect with time-lagged response in the presence of informative censoring , 2011, Lifetime Data Analysis.

[32]  J. Wellner,et al.  Empirical Processes with Applications to Statistics , 2009 .

[33]  S. Pocock,et al.  Sequential treatment assignment with balancing for prognostic factors in the controlled clinical trial. , 1975, Biometrics.

[34]  G G Koch,et al.  Issues for covariance analysis of dichotomous and ordered categorical data from randomized clinical trials and non-parametric strategies for addressing them. , 1998, Statistics in medicine.

[35]  M. J. van der Laan,et al.  Increasing Power in Randomized Trials with Right Censored Outcomes Through Covariate Adjustment , 2009, Journal of biopharmaceutical statistics.

[36]  Jon A Wellner,et al.  A Z-theorem with Estimated Nuisance Parameters and Correction Note for 'Weighted Likelihood for Semiparametric Models and Two-phase Stratified Samples, with Application to Cox Regression' , 2008, Scandinavian journal of statistics, theory and applications.

[37]  Feifang Hu,et al.  Testing Hypotheses of Covariate-Adaptive Randomized Clinical Trials , 2015 .

[38]  A. Tsiatis Semiparametric Theory and Missing Data , 2006 .

[40]  A. Tsiatis,et al.  Efficiency Study of Estimators for a Treatment Effect in a Pretest–Posttest Trial , 2001 .

[41]  P. Ding,et al.  Rerandomization and regression adjustment , 2019, Journal of the Royal Statistical Society: Series B (Statistical Methodology).

[42]  Azeem M. Shaikh,et al.  Inference Under Covariate-Adaptive Randomization , 2015, Journal of the American Statistical Association.

[43]  M. J. van der Laan,et al.  Targeted Minimum Loss Based Estimation of Causal Effects of Multiple Time Point Interventions , 2012, The international journal of biostatistics.

[44]  E. Kaplan,et al.  Nonparametric Estimation from Incomplete Observations , 1958 .

[45]  Daniel Polsky,et al.  Internet-delivered treatment for substance abuse: a multisite randomized controlled trial. , 2014, The American journal of psychiatry.

[46]  Nan M. Laird,et al.  Using the General Linear Mixed Model to Analyse Unbalanced Repeated Measures and Longitudinal Data , 1997 .

[47]  Y. Li,et al.  Statistical Inference of Covariate-Adjusted Randomized Experiments. , 2018 .

[48]  Anastasios A Tsiatis,et al.  Doubly‐Robust Estimators of Treatment‐Specific Survival Distributions in Observational Studies with Stratified Sampling , 2013, Biometrics.

[49]  Miklós Csörgő Review: Galen R. Shorack and Jon A. Wellner, Empirical processes with applications to statistics , 1987 .

[50]  J. Robins,et al.  Estimation of Regression Coefficients When Some Regressors are not Always Observed , 1994 .

[51]  M Zelen,et al.  The randomization and stratification of patients to clinical trials. , 1974, Journal of chronic diseases.

[52]  L. J. Wei,et al.  The Adaptive Biased Coin Design for Sequential Experiments , 1978 .