Control of Type I Error Rates in Bayesian Sequential Designs

Bayesian approaches to phase II clinical trial designs are usually based on the posterior distribution of the parameter of interest and calibration of certain threshold for decision making. If the posterior probability is computed and assessed in a sequential manner, the design may involve the problem of multiplicity, which, however, is often a neglected aspect in Bayesian trial designs. To effectively maintain the overall type I error rate, we propose solutions to the problem of multiplicity for Bayesian sequential designs and, in particular, the determination of the cutoff boundaries for the posterior probabilities. We present both theoretical and numerical methods for finding the optimal posterior probability boundaries with α-spending functions that mimic those of the frequentist group sequential designs. The theoretical approach is based on the asymptotic properties of the posterior probability, which establishes a connection between the Bayesian trial design and the frequentist group sequential method. The numerical approach uses a sandwich-type searching algorithm, which immensely reduces the computational burden. We apply least-square fitting to find the α-spending function closest to the target. We discuss the application of our method to single-arm and doublearm cases with binary and normal endpoints, respectively, and provide a real trial example for each case. MSC 2010 subject classifications: Primary 62C10; secondary 62P10.

[1]  Bradley P Carlin,et al.  Hierarchical Commensurate and Power Prior Models for Adaptive Incorporation of Historical Information in Clinical Trials , 2011, Biometrics.

[2]  B. Efron Bayesians, Frequentists, and Scientists , 2005 .

[3]  James O. Berger,et al.  Statistical Analysis and the Illusion of Objectivity , 1988 .

[4]  S. Pocock Group sequential methods in the design and analysis of clinical trials , 1977 .

[5]  Donald A. Berry,et al.  Simulation-based sequential Bayesian design , 2007 .

[6]  J. Wason,et al.  A Bayesian adaptive design for biomarker trials with linked treatments , 2015, British Journal of Cancer.

[7]  KyungMann Kim Group Sequential Methods with Applications to Clinical Trials , 2001 .

[8]  P. Müller,et al.  Determining the Effective Sample Size of a Parametric Prior , 2008, Biometrics.

[9]  D. Heitjan,et al.  Bayesian interim analysis of phase II cancer clinical trials. , 1997, Statistics in medicine.

[10]  Donald A. Berry,et al.  Group sequential clinical trials: a classical evaluation of Bayesian decision-theoretic designs , 1994 .

[11]  G L Rosner,et al.  A Bayesian group sequential design for a multiple arm randomized clinical trial. , 1995, Statistics in medicine.

[12]  Christopher Jennison,et al.  Group Sequential Analysis Incorporating Covariate Information , 1997 .

[13]  J Jack Lee,et al.  A predictive probability design for phase II cancer clinical trials , 2008, Clinical trials.

[14]  Lorenzo Trippa,et al.  Bayesian designs and the control of frequentist characteristics: A practical solution , 2015, Biometrics.

[15]  James G. Scott,et al.  An exploration of aspects of Bayesian multiple testing , 2006 .

[16]  D. Berry,et al.  Bayesian perspectives on multiple comparisons , 1999 .

[17]  D. Berry,et al.  Bayesian multiple comparisons using dirichlet process priors , 1998 .

[18]  P. O'Brien,et al.  A multiple testing procedure for clinical trials. , 1979, Biometrics.

[19]  P F Thall,et al.  Practical Bayesian guidelines for phase IIB clinical trials. , 1994, Biometrics.

[20]  A E Gelfand,et al.  Approaches for optimal sequential decision analysis in clinical trials. , 1998, Biometrics.

[21]  Christopher Jennison,et al.  An improved method for deriving optimal one-sided group sequential tests , 1992 .

[22]  Guosheng Yin,et al.  Clinical Trial Design: Bayesian and Frequentist Adaptive Methods , 2011 .

[23]  A. Labbe,et al.  Multiple testing using the posterior probabilities of directional alternatives, with application to genomic studies , 2007 .

[24]  A. Tsiatis,et al.  Approximately optimal one-parameter boundaries for group sequential trials. , 1987, Biometrics.

[25]  Han Zhu,et al.  A Bayesian sequential design using alpha spending function to control type I error , 2017, Statistical methods in medical research.

[26]  James M. Robins,et al.  Semiparametric Efficiency and its Implication on the Design and Analysis of Group-Sequential Studies , 1997 .

[27]  R. Dudley,et al.  Asymptotic normality with small relative errors of posterior probabilities of half-spaces , 2002 .

[28]  D. Berry Bayesian clinical trials , 2006, Nature Reviews Drug Discovery.

[29]  Peter F Thall,et al.  Bayesian adaptive model selection for optimizing group sequential clinical trials , 2008, Statistics in medicine.

[30]  MENGYE GUO,et al.  Multiplicity-calibrated Bayesian hypothesis tests. , 2010, Biostatistics.

[31]  P. Thall,et al.  Bayesian sequential monitoring designs for single-arm clinical trials with multiple outcomes. , 1995, Statistics in medicine.

[32]  Peter Müller,et al.  Bayesian randomized clinical trials: A decision‐theoretic sequential design , 2004 .

[33]  Christopher Jennison,et al.  Interim analyses: the repeated confidence interval approach , 1989 .

[34]  Christopher Jennison,et al.  Optimal asymmetric one‐sided group sequential tests , 2002 .

[35]  Ying Yuan,et al.  Utility‐based designs for randomized comparative trials with categorical outcomes , 2016, Statistics in medicine.

[36]  D. Berry Adaptive clinical trials in oncology , 2012, Nature Reviews Clinical Oncology.

[37]  B. Efron Why Isn't Everyone a Bayesian? , 1986 .

[38]  Heinz Schmidli,et al.  A practical guide to Bayesian group sequential designs , 2014, Pharmaceutical statistics.

[39]  P. Müller,et al.  A Bayesian discovery procedure , 2009, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[40]  Thomas A Murray,et al.  Robust Treatment Comparison Based on Utilities of Semi-Competing Risks in Non-Small-Cell Lung Cancer , 2017, Journal of the American Statistical Association.