Simultaneous confidence intervals that are compatible with closed testing in adaptive designs

Summary We describe a general method for finding a confidence region for a parameter vector that is compatible with the decisions of a two-stage closed test procedure in an adaptive experiment. The closed test procedure is characterized by the fact that rejection or nonrejection of a null hypothesis may depend on the decisions for other hypotheses and the compatible confidence region will, in general, have a complex, nonrectangular shape. We find the smallest cross-product of simultaneous confidence intervals containing the region and provide computational shortcuts for calculating the lower bounds on parameters corresponding to the rejected null hypotheses. We illustrate the method with an adaptive phase II/III clinical trial.

[1]  Jason C. Hsu,et al.  On Confidence Sets in Multiple Comparisons , 1988 .

[2]  K. Gabriel,et al.  On closed testing procedures with special reference to ordered analysis of variance , 1976 .

[3]  M Kieser,et al.  Combining different phases in the development of medical treatments within a single trial. , 1999, Statistics in medicine.

[4]  W. Brannath,et al.  Probabilistic Foundation of Confirmatory Adaptive Designs , 2012 .

[5]  Y. Benjamini,et al.  False Discovery Rate–Adjusted Multiple Confidence Intervals for Selected Parameters , 2005 .

[6]  Frank Bretz,et al.  Adaptive Dunnett tests for treatment selection , 2008, Statistics in medicine.

[7]  Anthony J. Hayter,et al.  On the Relationship between Stepwise Decision Procedures and Confidence Sets , 1994 .

[8]  S. Gupta,et al.  Statistical decision theory and related topics IV , 1988 .

[9]  Martin Posch,et al.  Testing and estimation in flexible group sequential designs with adaptive treatment selection , 2005, Statistics in medicine.

[10]  W. Brannath,et al.  Shortcuts for Locally Consonant Closed Test Procedures , 2010 .

[11]  W. Brannath,et al.  Recursive Combination Tests , 2002 .

[12]  J. Lewis,et al.  Statistical principles for clinical trials (ICH E9): an introductory note on an international guideline. , 1999, Statistics in medicine.

[13]  M A Proschan,et al.  Designed extension of studies based on conditional power. , 1995, Biometrics.

[14]  F. Bretz,et al.  Compatible simultaneous lower confidence bounds for the Holm procedure and other Bonferroni‐based closed tests , 2008, Statistics in medicine.

[15]  R. Simes,et al.  An improved Bonferroni procedure for multiple tests of significance , 1986 .

[16]  Olivier Guilbaud,et al.  Simultaneous Confidence Regions Corresponding to Holm's Step‐Down Procedure and Other Closed‐Testing Procedures , 2008, Biometrical journal. Biometrische Zeitschrift.

[17]  K. Strassburger,et al.  The partitioning principle: a powerful tool in multiple decision theory , 2002 .

[18]  G. Hommel.  Adaptive Modifications of Hypotheses After an Interim Analysis , 2001 .

[19]  Frank Bretz,et al.  TUTORIAL IN BIOSTATISTICS Adaptive designs for confirmatory clinical trials , 2022 .

[20]  M. Kendall.  Statistical Methods for Research Workers , 1937, Nature.

[21]  Stephen E. Fienberg,et al.  Testing Statistical Hypotheses , 2005 .

[22]  H. Schäfer,et al.  A general statistical principle for changing a design any time during the course of a trial , 2004, Statistics in medicine.

[23]  Peter R. Nelson,et al.  Multiple Comparisons: Theory and Methods , 1997 .

[24]  C. Dunnett.  A Multiple Comparison Procedure for Comparing Several Treatments with a Control , 1955 .