Optimality criteria for futility stopping boundaries for group sequential designs with a continuous endpoint

Background In clinical trials with fixed study designs, statistical inference is only made when the trial is completed. In contrast, group sequential designs allow an early stopping of the trial at interim, either for efficacy when the treatment effect is significant or for futility when the treatment effect seems too small to justify a continuation of the trial. Efficacy stopping boundaries based on alpha spending functions have been widely discussed in the statistical literature, and there is also solid work on the choice of adequate futility stopping boundaries. Still, futility boundaries are often chosen with little or completely without theoretical justification, in particular in investigator initiated trails. Some authors contributed to fill this gap. In here, we rely on an idea of Schüler et al. (2017) who discuss optimality criteria for futility boundaries for the special case of trials with (multiple) time-to-event endpoints. Their concept can be adopted to define “optimal” futility boundaries (with respect to given performance indicators) for continuous endpoints. Methods We extend Schülers’ definition for “optimal” futility boundaries to the most common study situation of a single continuous primary endpoint compared between two groups. First, we introduce the analytic algorithm to derive these futility boundaries. Second, the new concept is applied to a real clinical trial example. Finally, the performance of a study design with an “optimal” futility boundary is compared to designs with arbitrarily chosen futility boundaries. Results The presented concept of deriving futility boundaries allows to control the probability of wrongly stopping for futility, that means stopping for futility even if the treatment effect is promizing. At the same time, the loss in power is also controlled by this approach. Moreover, “optimal” futility boundaries improve the probability of correctly stopping for futility under the null hypothesis of no difference between two groups. Conclusions The choice of futility boundaries should be thoroughly investigated at the planning stage. The sometimes met, arbitrary choice of futility boundaries can lead to a substantial negative impact on performance. Applying futility boundaries with predefined optimization criteria increases efficiency of group sequential designs. Other optimization criteria than proposed in here might be incorporated.

[1]  Anastasios A. Tsiatis,et al.  Group sequential designs for one-sided and two-sided hypothesis testing with provision for early stopping in favor of the null hypothesis , 1994 .

[2]  David L. DeMets,et al.  Group sequential methods for clinical trials with a one-sided hypothesis , 1980 .

[3]  M. Kieser,et al.  Choice of futility boundaries for group sequential designs with two endpoints , 2017, BMC Medical Research Methodology.

[4]  Implementing type I & type II error spending for two-sided group sequential designs. , 2008, Contemporary clinical trials.

[5]  Tze Leung Lai,et al.  Futility stopping in clinical trials , 2012 .

[6]  P. Gallo,et al.  Alternative Views On Setting Clinical Trial Futility Criteria , 2014, Journal of biopharmaceutical statistics.

[7]  J Whitehead,et al.  Group sequential clinical trials with triangular continuation regions. , 1983, Biometrics.

[8]  K. K. Lan,et al.  Discrete sequential boundaries for clinical trials , 1983 .

[9]  Martin Posch,et al.  Optimized adaptive enrichment designs , 2017, Statistical methods in medical research.

[10]  P. Bauer,et al.  Evaluation of experiments with adaptive interim analyses. , 1994, Biometrics.

[11]  S. Pocock Group sequential methods in the design and analysis of clinical trials , 1977 .

[12]  P. Gallo,et al.  On the Optimal Timing of Futility Interim Analyses , 2017 .

[13]  Meinhard Kieser,et al.  A variational approach to optimal two‐stage designs , 2019, Statistics in medicine.

[14]  Frank Bretz,et al.  TUTORIAL IN BIOSTATISTICS Adaptive designs for confirmatory clinical trials , 2022 .

[15]  Anastasios A. Tsiatis,et al.  Interim Monitoring of Group Sequential Trials Using Spending Functions for the Type I and Type II Error Probabilities , 2001 .

[16]  M. Büchler,et al.  ChroPac-Trial: Duodenum-preserving pancreatic head resection versus pancreatoduodenectomy for chronic pancreatitis. Trial protocol of a randomised controlled multicentre trial , 2010, Trials.

[17]  Draft Guidance Adaptive Designs for Clinical Trials of Drugs and Biologics , 2018 .

[18]  I. K. Hwang,et al.  Group sequential designs using both type I and type II error probability spending functions , 1998 .

[19]  David L. DeMets,et al.  Asymmetric group sequential boundaries for monitoring clinical trials , 1982 .

[20]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[21]  P. O'Brien,et al.  A multiple testing procedure for clinical trials. , 1979, Biometrics.

[22]  A. Tsiatis,et al.  Approximately optimal one-parameter boundaries for group sequential trials. , 1987, Biometrics.