Group sequential tests for delayed responses

Group sequential methods are used routinely to monitor clinical trials and to provide early stopping when there is evidence of a treatment effect, lack of an effect, or concerns about patient safety. In many studies, the response of clinical interest is measured some time after the start of treatment and there are subjects at each interim analysis who have been treated but are yet to respond. We formulate a new form of group sequential test which gives a proper treatment of these "pipeline" subjects; these tests can be applied even when the continued accrual of data after the decision to stop the trial is unexpected. We illustrate our methods through a series of examples. We define error spending versions of these new designs which handle unpredictable group sizes and provide an information monitoring framework that can accommodate nuisance parameters, such as an unknown response variance. By studying optimal versions of our new designs, we show how the benefits of lower expected sample size normally achieved by a group sequential test are reduced when there is a delay in response. The loss of efficiency for larger delays can be ameliorated by incorporating data on a correlated short-term endpoint, fitting a joint model for the two endpoints but still making inferences on the original, longer term endpoint. We derive p-values and confidence intervals on termination of our new tests.

[1]  丹後 俊郎,et al.  Adaptive Group Sequential Designs for Clinical Trials , 2003 .

[2]  Christopher Jennison,et al.  Optimal group-sequential designs for simultaneous testing of superiority and non-inferiority. , 2010, Statistics in medicine.

[3]  M A Proschan,et al.  Designed extension of studies based on conditional power. , 1995, Biometrics.

[4]  J. Whitehead,et al.  Overrunning and underrunning in sequential clinical trials. , 1992, Controlled clinical trials.

[5]  M. Degroot Optimal Statistical Decisions , 1970 .

[6]  A A Tsiatis,et al.  Exact confidence intervals following a group sequential test. , 1984, Biometrics.

[7]  J. Andel Sequential Analysis , 2022, The SAGE Encyclopedia of Research Design.

[8]  Ian C Marschner,et al.  Interim analysis of continuous long-term endpoints in clinical trials with longitudinal outcomes. , 2003, Statistics in medicine.

[9]  R. H. Farrell Towards a Theory of Generalized Bayes Tests , 1968 .

[10]  David R. Cox,et al.  Regression models and life tables (with discussion , 1972 .

[11]  J. Kiefer,et al.  Some Properties of Generalized Sequential Probability Ratio Tests , 1957 .

[12]  Christopher Jennison,et al.  Efficient group sequential tests with unpredictable group sizes , 1987 .

[13]  Christopher Jennison,et al.  Optimal asymmetric one‐sided group sequential tests , 2002 .

[14]  Eric V. Slud,et al.  Two-Sample Repeated Significance Tests Based on the Modified Wilcoxon Statistic , 1982 .

[15]  John Whitehead,et al.  Application of Sequential Methods to a Phase III Clinical Trial in Stroke , 1993 .

[16]  R. Madsen,et al.  P values for tests using a repeated significance test design , 1982 .

[17]  P D OLDHAM,et al.  Calcium Chloride and Adrenaline as Bronchial Dilators Compared by Sequential Analysis , 1954, British medical journal.

[18]  Nigel Stallard,et al.  A New Clinical Trial Design Combining Phases 2 and 3: Sequential Designs with Treatment Selection and a Change of Endpoint , 2005 .

[19]  Christopher Jennison,et al.  Group Sequential Analysis Incorporating Covariate Information , 1997 .

[20]  C Jennison,et al.  A group sequential t-test with updating of sample size , 2000 .

[21]  Christopher Jennison,et al.  Numerical Computations for Group Sequential Tests , 1999 .

[22]  Peter Armitage,et al.  RESTRICTED SEQUENTIAL PROCEDURES , 1957 .

[23]  Christopher Jennison,et al.  Adaptive and nonadaptive group sequential tests , 2006 .

[24]  B. Rosner,et al.  On Inferences Concerning a Common Correlation Coefficient , 1980 .

[25]  Christopher Jennison,et al.  On group sequential tests for data in unequally sized groups and with unknown variance , 2001 .

[26]  A. Tsiatis,et al.  Approximately optimal one-parameter boundaries for group sequential trials. , 1987, Biometrics.

[27]  Bernard Rosner,et al.  On Inferences Concerning a Common Correlation , 1980 .

[28]  P. Armitage,et al.  Repeated Significance Tests on Accumulating Data , 1969 .

[29]  Sue-Jane Wang,et al.  Modification of Sample Size in Group Sequential Clinical Trials , 1999, Biometrics.

[30]  A. Gould,et al.  Sample size re-estimation without unblinding for normally distributed outcomes with unknown variance , 1992 .

[31]  P. Armitage,et al.  NUMERICAL STUDIES IN THE SEQUENTIAL ESTIMATION OF A BINOMIAL PARAMETER , 1958 .

[32]  HansâHelge Müller,et al.  Adaptive Group Sequential Designs for Clinical Trials: Combining the Advantages of Adaptive and of Classical Group Sequential Approaches , 2001 .

[33]  Christopher Jennison,et al.  Mid‐course sample size modification in clinical trials based on the observed treatment effect , 2002, Statistics in medicine.

[34]  Christopher Jennison,et al.  Repeated confidence intervals for the median survival time , 1985 .

[35]  Michael A Proschan,et al.  Sample size re‐estimation in clinical trials , 2009, Biometrical journal. Biometrische Zeitschrift.

[36]  Michael R. Chernick,et al.  Statistical Monitoring of Clinical Trials: a Unified Approach , 2007, Technometrics.

[37]  Qing Liu,et al.  Benefit–Risk Evaluation of Multi-Stage Adaptive Designs , 2004 .

[38]  J. Haybittle,et al.  Repeated assessment of results in clinical trials of cancer treatment. , 1971, The British journal of radiology.

[39]  Christopher Jennison,et al.  An improved method for deriving optimal one-sided group sequential tests , 1992 .

[40]  R. Kay Statistical Principles for Clinical Trials , 1998, The Journal of international medical research.

[41]  K M Facey,et al.  A sequential procedure for a phase II efficacy trial in hypercholesterolemia. , 1992, Controlled clinical trials.

[42]  James M. Robins,et al.  Semiparametric Efficiency and its Implication on the Design and Analysis of Group-Sequential Studies , 1997 .

[43]  Nigel Stallard,et al.  A confirmatory seamless phase II/III clinical trial design incorporating short‐term endpoint information , 2010, Statistics in medicine.

[44]  J. S. D. Cani,et al.  Group sequential designs using a family of type I error probability spending functions. , 1990, Statistics in medicine.

[45]  P Bauer,et al.  Application of Adaptive Designs – a Review , 2006, Biometrical journal. Biometrische Zeitschrift.

[46]  A. Lawrence Gould,et al.  Group sequential methods for clinical trials allowing early acceptance of Ho and incorporating costs , 1982 .

[47]  M. Kendall Theoretical Statistics , 1956, Nature.

[48]  Anastasios A. Tsiatis,et al.  Exact confidence intervals following a group sequential trial: A comparison of methods , 1988 .

[49]  Cyrus R. Mehta,et al.  Adaptive Design for Confirmatory Clinical Trials , 2009 .

[50]  M. Chang,et al.  Confidence intervals for a normal mean following a group sequential test. , 1989, Biometrics.

[51]  David P. Harrington,et al.  Procedures for Serial Testing in Censored Survival Data , 1984 .

[52]  N. Schmitz Optimal Sequentially Planned Decision Procedures , 1992 .

[53]  G. Lorden 2-SPRT'S and The Modified Kiefer-Weiss Problem of Minimizing an Expected Sample Size , 1976 .

[54]  L. Weiss On Sequential Tests Which Minimize the Maximum Expected Sample Size , 1962 .

[55]  John Whitehead,et al.  Incorporating Data Received after a Sequential Trial Has Stopped into the Final Analysis: Implementation and Comparison of Methods , 2003, Biometrics.

[56]  K. K. Lan,et al.  Discrete sequential boundaries for clinical trials , 1983 .

[57]  Nina Timmesfeld,et al.  Increasing the sample size during clinical trials with t‐distributed test statistics without inflating the type I error rate , 2007, Statistics in medicine.

[58]  P. O'Brien,et al.  A multiple testing procedure for clinical trials. , 1979, Biometrics.

[59]  Anastasios A. Tsiatis,et al.  Group sequential designs for one-sided and two-sided hypothesis testing with provision for early stopping in favor of the null hypothesis , 1994 .

[60]  KyungMann Kim Group Sequential Methods with Applications to Clinical Trials , 2001 .

[61]  S C Choi,et al.  Interim analyses with delayed observations in clinical trials. , 1999, Statistics in medicine.

[62]  Gerald S. Rogers,et al.  Mathematical Statistics: A Decision Theoretic Approach , 1967 .

[63]  J. Wittes,et al.  The role of internal pilot studies in increasing the efficiency of clinical trials. , 1990, Statistics in medicine.

[64]  G. A. Barnard,et al.  Sequential Tests in Industrial Statistics , 1946 .

[65]  W. J. Hall,et al.  Sequential tests and estimates after overrunning based on p-value combination , 2008, 0805.3070.

[66]  Andreas Faldum,et al.  Strategies for Including Patients Recruited During Interim Analysis of Clinical Trials , 2007, Journal of biopharmaceutical statistics.

[67]  Sue-Jane Wang,et al.  Methodological issues with adaptation of clinical trial design , 2006, Pharmaceutical statistics.

[68]  C Jennison,et al.  Estimating the sample size for a t-test using an internal pilot. , 1999, Statistics in medicine.

[69]  P. O'Brien,et al.  Confidence intervals following group sequential tests. , 1986, Controlled clinical trials.

[70]  Christopher Jennison,et al.  Adaptive Seamless Designs: Selection and Prospective Testing of Hypotheses , 2007, Journal of biopharmaceutical statistics.

[71]  J Whitehead,et al.  Group sequential clinical trials with triangular continuation regions. , 1983, Biometrics.

[72]  Andrew P Grieve,et al.  ASTIN: a Bayesian adaptive dose–response trial in acute stroke , 2005, Clinical trials.

[73]  L D Fisher,et al.  Self-designing clinical trials. , 1998, Statistics in medicine.

[74]  Innovation OR Stagnation Challenge and Opportunity on the Critical Path to New Medical Products , 2004 .

[75]  T. Friede,et al.  Re-calculating the sample size in internal pilot study designs with control of the type I error rate. , 2000, Statistics in medicine.

[76]  William E. Strawderman,et al.  Complete Classes for Sequential Tests of Hypotheses , 1980 .

[77]  Christopher Jennison,et al.  Meta-Analyses and Adaptive Group Sequential Designs in the Clinical Development Process , 2005, Journal of biopharmaceutical statistics.

[78]  Ivan G. Graham,et al.  The convergence of Nyström methods for Wiener-Hopf equations , 1987 .

[79]  J. Whitehead,et al.  A FORTRAN program for the design and analysis of sequential clinical trials. , 1983, Computers and biomedical research, an international journal.

[80]  Stephanie Green,et al.  Clinical Trials in Oncology , 1997 .

[81]  H. Fu,et al.  Bayesian Adaptive Dose-Finding Studies with Delayed Responses , 2010, Journal of biopharmaceutical statistics.

[82]  M. Proschan,et al.  Internal pilot studies I: type I error rate of the naive t-test. , 1999, Statistics in medicine.

[83]  Mark J. Schervish,et al.  Corrections: Algorithm AS 195: Multivariate Normal Probabilities with Error Bound , 1985 .

[84]  Frank Bretz,et al.  Confirmatory adaptive designs with Bayesian decision tools for a targeted therapy in oncology , 2009, Statistics in medicine.

[85]  Gernot Wassmer,et al.  A Brief Review on Software Developments for Group Sequential and Adaptive Designs , 2006, Biometrical journal. Biometrische Zeitschrift.

[86]  S. Pocock Group sequential methods in the design and analysis of clinical trials , 1977 .

[87]  I. Marschner,et al.  Interim monitoring of clinical trials based on long-term binary endpoints. , 2001, Statistics in medicine.

[88]  K Kim,et al.  Study duration for clinical trials with survival response and early stopping rule. , 1990, Biometrics.

[89]  Christopher Jennison,et al.  Confidence Intervals for a Binomial Parameter Following a Multistage Test With Application to MIL-STD 105D and Medical Trials , 1983 .

[90]  R. Fisher Statistical Methods for Research Workers , 1971 .

[91]  T. W. Anderson Sequential Analysis with Delayed Observations , 1964 .

[92]  M. Schervish Multivariate normal probabilities with error bound , 1984 .

[93]  K Kim,et al.  Confidence intervals following group sequential tests in clinical trials. , 1987, Biometrics.

[94]  Nigel Stallard,et al.  Sequential designs for phase III clinical trials incorporating treatment selection , 2003, Statistics in medicine.

[95]  Frank Bretz,et al.  Confirmatory Seamless Phase II/III Clinical Trials with Hypotheses Selection at Interim: General Concepts , 2006, Biometrical journal. Biometrische Zeitschrift.

[96]  P. Armitage,et al.  Sequential medical trials. 2nd edition. , 1975 .

[97]  William J. Hall,et al.  Sequential tests and estimators after overrunning based on maximum‐likelihood ordering , 2002 .

[98]  P. Bauer,et al.  Evaluation of experiments with adaptive interim analyses. , 1994, Biometrics.

[99]  Anastasios A Tsiatis,et al.  Adaptive two‐stage designs in phase II clinical trials , 2006, Statistics in medicine.

[100]  Anastasios A. Tsiatis,et al.  Flexible Sample Size Considerations Using Information-Based Interim Monitoring , 2001 .

[101]  E. Kaplan,et al.  Nonparametric Estimation from Incomplete Observations , 1958 .

[102]  Qing Liu,et al.  On Adaptive Extensions of Group Sequential Trials for Clinical Investigations , 2008 .

[103]  N. Mantel Evaluation of survival data and two new rank order statistics arising in its consideration. , 1966, Cancer chemotherapy reports.

[104]  Anastasios A. Tsiatis,et al.  Optimal two-stage group-sequential designs , 2008 .

[105]  I. K. Hwang,et al.  Group sequential designs using both type I and type II error probability spending functions , 1998 .

[106]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[107]  John Eales,et al.  Optimal two-sided group sequential tests , 1995 .

[108]  H. Schäfer,et al.  Adaptive Group Sequential Designs for Clinical Trials: Combining the Advantages of Adaptive and of Classical Group Sequential Approaches , 2001, Biometrics.

[109]  B. Turnbull,et al.  Repeated confidence intervals for group sequential clinical trials. , 1984, Controlled clinical trials.

[110]  W. Haenszel,et al.  Statistical aspects of the analysis of data from retrospective studies of disease. , 1959, Journal of the National Cancer Institute.

[111]  D. DeMets,et al.  Increasing the sample size when the unblinded interim result is promising , 2004, Statistics in medicine.