Comparison of Bayesian and frequentist group-sequential clinical trial designs

BackgroundThere is a growing interest in the use of Bayesian adaptive designs in late-phase clinical trials. This includes the use of stopping rules based on Bayesian analyses in which the frequentist type I error rate is controlled as in frequentist group-sequential designs.MethodsThis paper presents a practical comparison of Bayesian and frequentist group-sequential tests. Focussing on the setting in which data can be summarised by normally distributed test statistics, we evaluate and compare boundary values and operating characteristics.ResultsAlthough Bayesian and frequentist group-sequential approaches are based on fundamentally different paradigms, in a single arm trial or two-arm comparative trial with a prior distribution specified for the treatment difference, Bayesian and frequentist group-sequential tests can have identical stopping rules if particular critical values with which the posterior probability is compared or particular spending function values are chosen. If the Bayesian critical values at different looks are restricted to be equal, O’Brien and Fleming’s design corresponds to a Bayesian design with an exceptionally informative negative prior, Pocock’s design to a Bayesian design with a non-informative prior and frequentist designs with a linear alpha spending function are very similar to Bayesian designs with slightly informative priors.This contrasts with the setting of a comparative trial with independent prior distributions specified for treatment effects in different groups. In this case Bayesian and frequentist group-sequential tests cannot have the same stopping rule as the Bayesian stopping rule depends on the observed means in the two groups and not just on their difference. In this setting the Bayesian test can only be guaranteed to control the type I error for a specified range of values of the control group treatment effect.ConclusionsComparison of frequentist and Bayesian designs can encourage careful thought about design parameters and help to ensure appropriate design choices are made.

[1]  S Todd,et al.  Exact sequential tests for single samples of discrete responses using spending functions. , 2000, Statistics in medicine.

[2]  Marc Vandemeulebroecke,et al.  Secukinumab, a human anti-IL-17A monoclonal antibody, for moderate to severe Crohn's disease: unexpected results of a randomised, double-blind placebo-controlled trial , 2012, Gut.

[3]  Eric V. Slud,et al.  Two-Sample Repeated Significance Tests Based on the Modified Wilcoxon Statistic , 1982 .

[4]  S. Pocock.  Group sequential methods in the design and analysis of clinical trials , 1977 .

[5]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[6]  B. Turnbull,et al.  Group Sequential Methods with Applications to Clinical Trials , 1999 .

[7]  Draft Guidance.  Adaptive Designs for Clinical Trials of Drugs and Biologics , 2018 .

[8]  S. Pocock,et al.  Trials stopped early: too good to be true? , 1999, The Lancet.

[9]  Rachel Rosenthal,et al.  Evaluating the optimal timing of surgical antimicrobial prophylaxis: study protocol for a randomized controlled trial , 2014, Trials.

[10]  Jason T Connor,et al.  The utility of Bayesian predictive probabilities for interim monitoring of clinical trials , 2014, Clinical trials.

[11]  Christopher Jennison,et al.  Group Sequential Analysis Incorporating Covariate Information , 1997 .

[12]  Han Zhu,et al.  A Bayesian sequential design using alpha spending function to control type I error , 2017, Statistical methods in medical research.

[13]  Gregory Campbell,et al.  Similarities and Differences of Bayesian Designs and Adaptive Designs for Medical Devices: A Regulatory View , 2013 .

[14]  Duncan Young,et al.  Using Bayesian adaptive designs to improve phase III trials: a respiratory care example , 2019, BMC Medical Research Methodology.

[15]  Sue-Jane Wang,et al.  Modification of Sample Size in Group Sequential Clinical Trials , 1999, Biometrics.

[16]  Heinz Schmidli,et al.  A practical guide to Bayesian group sequential designs , 2014, Pharmaceutical statistics.

[17]  David L. DeMets,et al.  Design and analysis of group sequential tests based on the type I error spending rate function , 1987 .

[18]  Christopher Jennison,et al.  Exact calculations for sequential t, X2 and F tests , 1991 .

[19]  Daniel L Gillen,et al.  Bayesian evaluation of group sequential clinical trial designs , 2007, Statistics in medicine.

[20]  Burr Hall,et al.  Comparison of antiarrhythmic drug therapy and radiofrequency catheter ablation in patients with paroxysmal atrial fibrillation: a randomized controlled trial. , 2010, JAMA.

[21]  K. K. Lan,et al.  Discrete sequential boundaries for clinical trials , 1983 .

[22]  Nigel Stallard,et al.  Exact group‐sequential designs for clinical trials with randomized play‐the‐winner allocation , 2002, Statistics in medicine.

[23]  David J. Spiegelhalter,et al.  Bayesian Approaches to Randomized Trials , 1994, Bayesian Biostatistics.

[24]  Bradley P. Carlin,et al.  Bayesian Adaptive Methods for Clinical Trials , 2010 .

[25]  Haolun Shi,et al.  Control of Type I Error Rates in Bayesian Sequential Designs , 2019, Bayesian Analysis.

[26]  D. Gillen,et al.  Frequentist evaluation of group sequential clinical trial designs , 2007, Statistics in medicine.

[27]  Michael A. Proschan,et al.  Statistical Monitoring of Clinical Trials: A Unified Approach , 2006 .

[28]  P. O'Brien,et al.  A multiple testing procedure for clinical trials. , 1979, Biometrics.