Adaptive randomized trial designs that cannot be dominated by any standard design at the same total sample size

Prior work has shown that the power of adaptive designs with rules for modifying the sample size can always be matched or improved by suitably chosen, standard, group sequential designs. A natural question is whether analogous results hold for other types of adaptive designs. We focus on adaptive enrichment designs, which involve preplanned rules for modifying enrollment criteria based on accrued data in a randomized trial. Such designs often involve multiple hypotheses, e.g., one for the total population and one for a predefined subpopulation, such as those with high disease severity at baseline. We fix the total sample size, and consider overall power, defined as the probability of rejecting at least one false null hypothesis. We present adaptive enrichment designs whose overall power at two alternatives cannot simultaneously be matched by any standard design. In some scenarios there is a substantial gap between the overall power achieved by these adaptive designs and that of any standard design. We also prove that such gains in overall power come at a cost. To attain overall power above what is achievable by certain standard designs, it is necessary to increase power to reject some hypotheses and reduce power to reject others. We demonstrate that adaptive enrichment designs allow certain power trade-offs that are not available when restricting to standard designs.

[1]  E. Lehmann Testing Statistical Hypotheses , 1960 .

[2]  Michael A. Proschan,et al.  A Unified Theory of Two-Stage Adaptive Designs , 2002 .

[3]  N. Simon,et al.  Adaptive enrichment designs for clinical trials. , 2013, Biostatistics.

[4]  E. Russek-Cohen,et al.  Evaluating treatments when a gender by treatment interaction may exist. , 1997, Statistics in medicine.

[5]  R. Kay Statistical Principles for Clinical Trials , 1998, The Journal of international medical research.

[6]  K. Strassburger,et al.  The partitioning principle: a powerful tool in multiple decision theory , 2002 .

[7]  Lisa L Hunter,et al.  Clinical Practice Guideline , 2016, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[8]  Sue-Jane Wang,et al.  Adaptive patient enrichment designs in therapeutic trials , 2009, Biometrical journal. Biometrische Zeitschrift.

[9]  K. Gabriel,et al.  On closed testing procedures with special reference to ordered analysis of variance , 1976 .

[10]  M. J. van der Laan,et al.  Optimizing randomized trial designs to distinguish which subpopulations benefit from treatment. , 2011, Biometrika.

[11]  Nice Depression: management of depression in primary and secondary care , 2005 .

[12]  Dean Follmann,et al.  ADAPTIVELY CHANGING SUBGROUP PROPORTIONS IN CLINICAL TRIALS , 1997 .

[13]  A. Tsiatis,et al.  On the inefficiency of the adaptive design for monitoring clinical trials , 2003 .

[14]  Y. Hochberg A sharper Bonferroni procedure for multiple tests of significance , 1988 .

[15]  Christopher Jennison,et al.  Adaptive and nonadaptive group sequential tests , 2006 .

[16]  Lorenzo Trippa,et al.  Bayesian Enrichment Strategies for Randomized Discontinuation Trials , 2012, Biometrics.

[17]  Blair T. Johnson,et al.  Initial Severity and Antidepressant Benefits: A Meta-Analysis of Data Submitted to the Food and Drug Administration , 2008, PLoS medicine.

[18]  A. Tamhane,et al.  Multiple Comparison Procedures , 1989 .

[19]  Charles Stein,et al.  Most Powerful Tests of Composite Hypotheses. I. Normal Distributions , 1948 .

[20]  Christopher Jennison,et al.  Adaptive Seamless Designs: Selection and Prospective Testing of Hypotheses , 2007, Journal of biopharmaceutical statistics.

[21]  Sue-Jane Wang,et al.  Approaches to evaluation of treatment effect in randomized clinical trials with genomic subset , 2007, Pharmaceutical statistics.

[22]  R. Simon,et al.  Adaptive Signature Design: An Adaptive Clinical Trial Design for Generating and Prospectively Testing A Gene Expression Signature for Sensitive Patients , 2005, Clinical Cancer Research.

[23]  A. Tamhane,et al.  Multiple Comparison Procedures , 2009 .

[24]  S. Holm A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[25]  A. Papoulis,et al.  Normal distributions , 1963 .