An adaptive confirmatory trial with interim treatment selection: Practical experiences and unbalanced randomization

This article has been motivated by an ongoing international adaptive confirmatory trial. At the interim analysis of this two‐stage trial, none, one or two active treatment regimens are selected for further study in the second stage. A combination test approach is used in this practical setting with an extension of the theory to unbalanced randomization. We show that a combination test with suitable weights can still preserve the overall Type I error rate provided that the test statistic is chosen appropriately and the unpooled Z‐test for proportions is not used. The accuracy of stagewise p‐values is also discussed in a more general framework. Monte Carlo simulations confirm the validity of the approach retained and evaluate the necessary sample size. Additional issues addressed during the design of the trial are also examined such as multiplicity due to testing hypotheses on key secondary endpoints, a non‐inferiority comparison to an active treatment and covariate adjusted analyses for various types of outcome. Copyright © 2011 John Wiley & Sons, Ltd.

[1]  C. Jennison,et al.  An adaptive seamless phase II/III design for oncology trials with subpopulation selection using correlated survival endpoints † , 2011, Pharmaceutical statistics.

[2]  G. Wassmer,et al.  Comments on the Draft Guidance on “Adaptive Design Clinical Trials for Drugs and Biologics” of the U.S. Food and Drug Administration , 2010, Journal of biopharmaceutical statistics.

[3]  Chris Lloyd,et al.  Bootstrap and Second‐Order Tests of Risk Difference , 2010, Biometrics.

[4]  W. Brannath,et al.  Selection and bias—Two hostile brothers , 2009, Statistics in medicine.

[5]  Elvezio Ronchetti,et al.  Robust and accurate inference for generalized linear models , 2009, J. Multivar. Anal..

[6]  Donald A. Berry,et al.  Good Practices for Adaptive Clinical Trials in Pharmaceutical Product Development , 2009 .

[7]  W. Brannath,et al.  Adaptive designs for confirmatory clinical trials , 2009, Statistics in medicine.

[8]  Antje Jahn-Eimermacher,et al.  Adaptive trial design: a general methodology for censored time to event data. , 2009, Contemporary clinical trials.

[9]  Tim Friede,et al.  A group‐sequential design for clinical trials with treatment selection , 2008, Statistics in medicine.

[10]  Shein-Chung Chow,et al.  Adaptive design methods in clinical trials – a review , 2008, Orphanet journal of rare diseases.

[11]  E Jenny Heathcote,et al.  Orphanet Journal of Rare BioMed Central Review Primary biliary cirrhosis , 2008 .

[12]  Christopher Jennison,et al.  Adaptive Seamless Designs: Selection and Prospective Testing of Hypotheses , 2007, Journal of biopharmaceutical statistics.

[13]  Alex Dmitrienko,et al.  Gatekeeping procedures with clinical trial applications , 2007, Pharmaceutical statistics.

[14]  Xin Wang,et al.  Stepwise Gatekeeping Procedures in Clinical Trial Applications , 2006, Biometrical journal. Biometrische Zeitschrift.

[15]  Joseph P. Romano,et al.  Stepup procedures for control of generalizations of the familywise error rate , 2006, math/0611266.

[16]  Thomas R Fleming,et al.  Standard versus adaptive monitoring procedures: a commentary , 2006, Statistics in medicine.

[17]  C. Burman,et al.  Are Flexible Designs Sound? , 2006, Biometrics.

[18]  Gernot Wassmer,et al.  Planning and Analyzing Adaptive Group Sequential Survival Trials , 2006, Biometrical journal. Biometrische Zeitschrift.

[19]  Frank Bretz,et al.  Confirmatory Seamless Phase II/III Clinical Trials with Hypotheses Selection at Interim: Applications and Practical Considerations , 2006, Biometrical journal. Biometrische Zeitschrift.

[20]  Frank Bretz,et al.  Confirmatory Seamless Phase II/III Clinical Trials with Hypotheses Selection at Interim: General Concepts , 2006, Biometrical journal. Biometrische Zeitschrift.

[21]  Martin Posch,et al.  Testing and estimation in flexible group sequential designs with adaptive treatment selection , 2005, Statistics in medicine.

[22]  H. Keselman,et al.  Multiple Comparison Procedures , 2005 .

[23]  Weichung J Shih,et al.  Two-Stage Adaptive Design for Clinical Trials with Survival Data , 2005, Journal of biopharmaceutical statistics.

[24]  Christopher Jennison,et al.  Meta-Analyses and Adaptive Group Sequential Designs in the Clinical Development Process , 2005, Journal of biopharmaceutical statistics.

[25]  Patrick J. Kelly,et al.  A Practical Comparison of Group-Sequential and Adaptive Designs , 2005, Journal of biopharmaceutical statistics.

[26]  P. Westfall,et al.  Gatekeeping strategies for clinical trials that do not require all primary effects to be significant , 2003, Statistics in medicine.

[27]  Devan V Mehrotra,et al.  A Cautionary Note on Exact Unconditional Inference for a Difference between Two Independent Binomial Proportions , 2003, Biometrics.

[28]  Martin Posch,et al.  Issues in designing flexible trials , 2003, Statistics in medicine.

[29]  Nigel Stallard,et al.  Sequential designs for phase III clinical trials incorporating treatment selection , 2003, Statistics in medicine.

[30]  Christopher Jennison,et al.  Mid‐course sample size modification in clinical trials based on the observed treatment effect , 2002, Statistics in medicine.

[31]  W. Brannath,et al.  Recursive Combination Tests , 2002 .

[32]  H. Schäfer,et al.  Modification of the sample size and the schedule of interim analyses in survival trials based on data inspections , 2001, Statistics in medicine.

[33]  J. Denne,et al.  Sample size recalculation using conditional power , 2001, Statistics in medicine.

[34]  G. Hommel.  Adaptive Modifications of Hypotheses After an Interim Analysis , 2001 .

[35]  KyungMann Kim.  Group Sequential Methods with Applications to Clinical Trials , 2001 .

[36]  W. Lehmacher,et al.  Adaptive Sample Size Calculations in Group Sequential Trials , 1999, Biometrics.

[37]  Sue-Jane Wang,et al.  Modification of Sample Size in Group Sequential Clinical Trials , 1999, Biometrics.

[38]  M Kieser,et al.  Combining different phases in the development of medical treatments within a single trial. , 1999, Statistics in medicine.

[39]  Meinhard Kieser,et al.  Inference on Multiple Endpoints in Clinical Trials with Adaptive Interim Analyses , 1999 .

[40]  L. Hothorn,et al.  Testing strategies in multi-dose experiments including active control. , 1998, Statistics in medicine.

[41]  L D Fisher,et al.  Self-designing clinical trials. , 1998, Statistics in medicine.

[42]  S. Sarkar.  Some probability inequalities for ordered $\rm MTP\sb 2$ random variables: a proof of the Simes conjecture , 1998 .

[43]  S. Sarkar,et al.  The Simes Method for Multiple Hypothesis Testing with Positively Dependent Test Statistics , 1997 .

[44]  George Casella,et al.  Assessing Evidence in Multiple Hypotheses , 1996 .

[45]  M. Proschan,et al.  Designed extension of studies based on conditional power. , 1995, Biometrics.

[46]  P. Bauer,et al.  Evaluation of experiments with adaptive interim analyses. , 1994, Biometrics.

[47]  S. S. Young,et al.  Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment , 1993 .

[48]  Terry M. Therneau,et al.  Optimal two-stage screening designs for survival comparisons , 1990 .

[49]  Y. Hochberg.  A sharper Bonferroni procedure for multiple tests of significance , 1988 .

[50]  Richard Simon,et al.  Two-stage selection and testing designs for comparative clinical trials , 1988 .

[51]  G. Hommel.  A stagewise rejective multiple test procedure based on a modified Bonferroni test , 1988 .

[52]  R. Simes,et al.  An improved Bonferroni procedure for multiple tests of significance , 1986 .

[53]  Michael A. Fligner,et al.  A Comparison of Two Tests for Equality of Two Proportions , 1977 .

[54]  K. Gabriel,et al.  On closed testing procedures with special reference to ordered analysis of variance , 1976 .

[55]  C. Dunnett.  A Multiple Comparison Procedure for Comparing Several Treatments with a Control , 1955 .

[56]  Draft Guidance.  Adaptive Design Clinical Trials for Drugs and Biologics , 2010 .

[57]  Betsy Jane Becker,et al.  Combining significance levels. , 1994 .

[58]  P F Thall,et al.  A two-stage design for choosing among several experimental treatments and a control in clinical trials. , 1989, Biometrics.

[59]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[60]  M. Kendall.  Statistical Methods for Research Workers , 1937, Nature.