Adaptive designs for confirmatory clinical trials

Adaptive designs play an increasingly important role in clinical drug development. Such designs use accumulating data of an ongoing trial to decide how to modify design aspects without undermining the validity and integrity of the trial. Adaptive designs thus allow for a number of possible adaptations at midterm: Early stopping either for futility or success, sample size reassessment, change of population, etc. A particularly appealing application is the use of adaptive designs in combined phase II/III studies with treatment selection at interim. The expectation has arisen that carefully planned and conducted studies based on adaptive designs increase the efficiency of the drug development process by making better use of the observed data, thus leading to a higher information value per patient.In this paper we focus on adaptive designs for confirmatory clinical trials. We review the adaptive design methodology for a single null hypothesis and how to perform adaptive designs with multiple hypotheses using closed test procedures. We report the results of an extensive simulation study to evaluate the operational characteristics of the various methods. A case study and related numerical examples are used to illustrate the key results. In addition we provide a detailed discussion of current methods to calculate point estimates and confidence intervals for relevant parameters.

[1]  F Bretz,et al.  Combining Multiple Comparisons and Modeling Techniques in Dose‐Response Studies , 2005, Biometrics.

[2]  W. J. Hall,et al.  Unbiased estimation following a group sequential test , 1999 .

[3]  K. Gabriel,et al.  On closed testing procedures with special reference to ordered analysis of variance , 1976 .

[4]  Harold B. Sackrowitz,et al.  Two stage conditionally unbiased estimators of the selected mean , 1989 .

[5]  Allan R Sampson,et al.  Drop‐the‐Losers Design: Normal Case , 2005, Biometrical journal. Biometrische Zeitschrift.

[6]  Scott R. Evans,et al.  Data Monitoring in Clinical Trials Using Prediction , 2007 .

[7]  Frank Bretz,et al.  Bayesian predictive power for interim adaptation in seamless phase II/III trials where the endpoint is survival up to some specified timepoint , 2007, Statistics in medicine.

[8]  M. Hamilton,et al.  Development of a rating scale for primary depressive illness. , 1967, The British journal of social and clinical psychology.

[9]  G. Hommel,et al.  Multiple Comparisons of Treatments with Stable Multivariate Tests in a Two‐Stage Adaptive Design, Including a Test for Non‐Inferiority , 2000 .

[10]  M A Proschan,et al.  Designed extension of studies based on conditional power. , 1995, Biometrics.

[11]  P F Thall,et al.  A two-stage design for choosing among several experimental treatments and a control in clinical trials. , 1989, Biometrics.

[12]  M. Hellmich.  Monitoring Clinical Trials with Multiple Arms , 2001, Biometrics.

[13]  Meinhard Kieser,et al.  Simple procedures for blinded sample size adjustment that do not affect the type I error rate , 2003, Statistics in medicine.

[14]  John Whitehead,et al.  Estimation following selection of the largest of two normal means. Journal of Statistical Planning and Inference 138, 1629-1638. , 2008 .

[15]  Ming-Dauh Wang,et al.  Bayesian predictive approach to interim monitoring in clinical trials , 2006, Statistics in medicine.

[16]  Frank Bretz,et al.  Type I error rate control in adaptive designs for confirmatory clinical trials with treatment selection at interim , 2011, Pharmaceutical statistics.

[17]  Paul Gallo,et al.  Operational challenges in adaptive design implementation , 2006, Pharmaceutical statistics.

[18]  Richard Simon,et al.  Two-stage selection and testing designs for comparative clinical trials , 1988 .

[19]  Michael A. Proschan,et al.  Statistical Monitoring of Clinical Trials: A Unified Approach , 2006 .

[20]  Frank Bretz,et al.  Confirmatory Seamless Phase II/III Clinical Trials with Hypotheses Selection at Interim: Applications and Practical Considerations , 2006, Biometrical journal. Biometrische Zeitschrift.

[21]  D. Gillen,et al.  Frequentist evaluation of group sequential clinical trial designs , 2007, Statistics in medicine.

[22]  Martin Posch,et al.  Adaptive Designs and ConÔ¨Årmatory Hypothesis Testing , 2009 .

[23]  W. Lehmacher,et al.  Adaptive Sample Size Calculations in Group Sequential Trials , 1999, Biometrics.

[24]  R. Simes,et al.  An improved Bonferroni procedure for multiple tests of significance , 1986 .

[25]  Martin Posch,et al.  Testing and estimation in flexible group sequential designs with adaptive treatment selection , 2005, Statistics in medicine.

[26]  D A Follmann,et al.  Monitoring pairwise comparisons in multi-armed clinical trials. , 1994, Biometrics.

[27]  Frank Bretz,et al.  Confirmatory adaptive designs with Bayesian decision tools for a targeted therapy in oncology , 2009, Statistics in medicine.

[28]  W. Brannath,et al.  Recursive Combination Tests , 2002 .

[29]  T. Fleming,et al.  Parameter estimation following group sequential hypothesis testing , 1990 .

[30]  Sue-Jane Wang,et al.  Modification of Sample Size in Group Sequential Clinical Trials , 1999, Biometrics.

[31]  L Shen,et al.  An improved method of evaluating drug effect in a multiple dose clinical trial , 2001, Statistics in medicine.

[32]  P. Bauer,et al.  The reassessment of trial perspectives from interim data—a critical view , 2006, Statistics in medicine.

[33]  Frank Bretz,et al.  Power and sample size when multiple endpoints are considered , 2007, Pharmaceutical statistics.

[34]  Nigel Stallard,et al.  Sequential designs for phase III clinical trials incorporating treatment selection , 2003, Statistics in medicine.

[35]  Frank Bretz,et al.  Confirmatory Seamless Phase II/III Clinical Trials with Hypotheses Selection at Interim: General Concepts , 2006, Biometrical journal. Biometrische Zeitschrift.

[36]  Meinhard Kieser,et al.  Inference on Multiple Endpoints in Clinical Trials with Adaptive Interim Analyses , 1999 .

[37]  Frank Bretz,et al.  Adaptive Dunnett tests for treatment selection , 2008, Statistics in medicine.

[38]  Michael A. Proschan,et al.  A Unified Theory of Two-Stage Adaptive Designs , 2002 .

[39]  G. Hommel.  Adaptive Modifications of Hypotheses After an Interim Analysis , 2001 .

[40]  Frank Bretz,et al.  Adaptivity in drug discovery and development , 2009 .

[41]  P. Bauer,et al.  Evaluation of experiments with adaptive interim analyses. , 1994, Biometrics.

[42]  Michael Krams,et al.  Implementing Adaptive Designs: Logistical and Operational Considerations , 2006 .

[43]  David J. Spiegelhalter,et al.  Bayesian Approaches to Randomized Trials , 1994, Bayesian Biostatistics.

[44]  H M James Hung,et al.  Adapting the sample size planning of a phase III trial based on phase II data , 2006, Pharmaceutical statistics.

[45]  Marc Vandemeulebroecke,et al.  Group Sequential and Adaptive Designs – A Review of Basic Concepts and Points of Discussion , 2008, Biometrical journal. Biometrische Zeitschrift.

[46]  M. Krams,et al.  Innovative Approaches for Designing and Analyzing Adaptive Dose-Ranging Trials , 2007, Journal of biopharmaceutical statistics.

[47]  Tim Friede,et al.  A group‐sequential design for clinical trials with treatment selection , 2008, Statistics in medicine.

[48]  P. O'Brien,et al.  A multiple testing procedure for clinical trials. , 1979, Biometrics.

[49]  Gernot Wassmer,et al.  A Brief Review on Software Developments for Group Sequential and Adaptive Designs , 2006, Biometrical journal. Biometrische Zeitschrift.

[50]  M Kieser,et al.  Combining different phases in the development of medical treatments within a single trial. , 1999, Statistics in medicine.

[51]  Peter F Thall,et al.  Seamlessly Expanding a Randomized Phase II Trial to Phase III , 2002, Biometrics.

[52]  K. K. Lan,et al.  Discrete sequential boundaries for clinical trials , 1983 .

[53]  Sue-Jane Wang,et al.  Approaches to evaluation of treatment effect in randomized clinical trials with genomic subset , 2007, Pharmaceutical statistics.

[54]  C. Burman,et al.  Are Flexible Designs Sound? , 2006, Biometrics.

[55]  A A Tsiatis,et al.  Exact confidence intervals following a group sequential test. , 1984, Biometrics.

[56]  A. Tamhane,et al.  Multiple Comparison Procedures , 2009 .

[57]  Jeff Maca,et al.  Adaptive Seamless Phase II/III Designs—Background, Operational Aspects, and Examples , 2006 .

[58]  H. Schäfer,et al.  A general statistical principle for changing a design any time during the course of a trial , 2004, Statistics in medicine.

[59]  H. Schäfer,et al.  Adaptive Group Sequential Designs for Clinical Trials: Combining the Advantages of Adaptive and of Classical Group Sequential Approaches , 2001, Biometrics.

[60]  B. Turnbull,et al.  Repeated confidence intervals for group sequential clinical trials. , 1984, Controlled clinical trials.

[61]  Martin Posch,et al.  Issues in designing flexible trials , 2003, Statistics in medicine.

[62]  B. Turnbull,et al.  Group Sequential Methods with Applications to Clinical Trials , 1999 .

[63]  Werner Brannath,et al.  Multiplicity and flexibility in clinical trials , 2007, Pharmaceutical statistics.

[64]  Michael D. Smith,et al.  Adaptive Bayesian Designs for Dose-Ranging Drug Trials , 2002 .

[65]  M. Krams,et al.  Adaptive Designs in Clinical Drug Development—An Executive Summary of the PhRMA Working Group , 2006, Journal of biopharmaceutical statistics.

[66]  S. Pocock.  Group sequential methods in the design and analysis of clinical trials , 1977 .

[67]  John Whitehead,et al.  On the bias of maximum likelihood estimation following a sequential test , 1986 .

[68]  Christopher Jennison,et al.  Mid‐course sample size modification in clinical trials based on the observed treatment effect , 2002, Statistics in medicine.

[69]  W. Brannath,et al.  Estimation in flexible two stage designs , 2006, Statistics in medicine.

[70]  Jack Bowden,et al.  Unbiased Estimation of Selected Treatment Means in Two‐Stage Trials , 2008, Biometrical journal. Biometrische Zeitschrift.

[71]  Tim Friede,et al.  A Comparison of Methods for Adaptive Treatment Selection , 2008, Biometrical journal. Biometrische Zeitschrift.

[72]  Peter Bauer,et al.  Adaptive designs: Looking for a needle in the haystack—A new challenge in medical research , 2008, Statistics in medicine.

[73]  C. Dunnett.  A Multiple Comparison Procedure for Comparing Several Treatments with a Control , 1955 .

[74]  Paul Gallo,et al.  Sample Size Reestimation: A Review and Recommendations , 2006 .

[75]  M. Krams,et al.  Adaptive Designs in Clinical Drug Development: Opportunities, Challenges, and Scope Reflections Following PhRMA's November 2006 Workshop , 2007, Journal of biopharmaceutical statistics.

[76]  Martin Posch,et al.  Conditional Rejection Probabilities of Student's t‐test and Design Adaptations , 2004 .

[77]  Christy Chuang-Stein,et al.  What should be the role of homogeneity testing in adaptive trials? , 2009, Pharmaceutical statistics.