Adaptive treatment allocation and selection in multi-arm clinical trials: a Bayesian perspective

Background: Adaptive designs offer added flexibility in the execution of clinical trials, including the possibilities of allocating more patients to the treatments that turned out more successful, and early stopping due to either declared success or futility. Commonly applied adaptive designs, such as group sequential methods, are based on the frequentist paradigm and on ideas from statistical significance testing. Interim checks during the trial will have the effect of inflating the Type 1 error rate, or, if this rate is controlled and kept fixed, lowering the power. Results: The purpose of the paper is to demonstrate the usefulness of the Bayesian approach in the design and in the actual running of randomized clinical trials during Phase II and III. This approach is based on comparing the performance of the different treatment arm in terms of the respective joint posterior probabilities evaluated sequentially from the accruing outcome data, and then taking a control action if such posterior probabilities fall below a pre-specified critical threshold value. Two types of actions are considered: treatment allocation, putting on hold at least temporarily further accrual of patients to a treatment arm (Rule 1), and treatment selection, removing an arm from the trial permanently (Rule 2). The main development in the paper is in terms of binary outcomes, but extensions for handling time-to-event data, including data from vaccine trials, are also discussed. The performance of the proposed methodology is tested in extensive simulation experiments, with numerical results and graphical illustrations documented in a Supplement to the main text. As a companion to this paper, an implementation of the methods is provided in the form of a freely available R package. Conclusion: The proposed methods for trial design provide an attractive alternative to their frequentist counterparts.

[1]  R. Peto,et al.  COVID-19 vaccine trials should seek worthwhile efficacy , 2020, The Lancet.

[2]  P F Thall,et al.  Practical Bayesian guidelines for phase IIB clinical trials. , 1994, Biometrics.

[3]  Lisa V. Hampson,et al.  Adaptive designs in clinical trials: why use them, and how to run and report them , 2018, BMC Medicine.

[4]  S. Greenland Analysis goals, error-cost sensitivity, and analysis hacking: Essential considerations in hypothesis testing and multiple comparisons. , 2020, Paediatric and perinatal epidemiology.

[5]  Shein-Chung Chow,et al.  Adaptive design methods in clinical trials – a review , 2008, Orphanet journal of rare diseases.

[6]  Frank E. Harrell,et al.  Inference and Decision Making for 21st-Century Drug Development and Approval , 2019, The American Statistician.

[7]  M. Hernán,et al.  BNT162b2 mRNA Covid-19 Vaccine in a Nationwide Mass Vaccination Setting , 2021, The New England journal of medicine.

[8]  Mark Chang Adaptive Design - Recent Advancement in Clinical Trials , 2016, Journal of Bioanalysis & Biostatistics .

[9]  Heinz Schmidli,et al.  A practical guide to Bayesian group sequential designs , 2014, Pharmaceutical statistics.

[10]  M. A. Best Bayesian Approaches to Clinical Trials and Health‐Care Evaluation , 2005 .

[11]  Haolun Shi,et al.  Bayesian randomized clinical trials: From fixed to adaptive design. , 2017, Contemporary clinical trials.

[12]  Ying Yuan,et al.  Bayesian Designs for Phase I-II Clinical Trials , 2016 .

[13]  A. Atkinson,et al.  Randomised Response-Adaptive Designs in Clinical Trials , 2013 .

[14]  B. Zaslavsky Bayesian Hypothesis Testing in Two‐Arm Trials with Dichotomous Outcomes , 2013, Biometrics.

[15]  Andrew P Grieve,et al.  Idle thoughts of a ‘well‐calibrated’ Bayesian in clinical drug development , 2016, Pharmaceutical statistics.

[16]  E. Lesaffre Superiority, equivalence, and non-inferiority trials. , 2008, Bulletin of the NYU hospital for joint diseases.

[17]  Ethical guidelines for deliberately infecting volunteers with COVID-19 , 2020, Journal of Medical Ethics.

[18]  R. G. Cornell,et al.  Ethics and statistics in randomized clinical trials. , 1991, Statistical science : a review journal of the Institute of Mathematical Statistics.

[19]  P. Bauer,et al.  Evaluation of experiments with adaptive interim analyses. , 1994, Biometrics.

[20]  W. R. Thompson ON THE LIKELIHOOD THAT ONE UNKNOWN PROBABILITY EXCEEDS ANOTHER IN VIEW OF THE EVIDENCE OF TWO SAMPLES , 1933 .

[21]  S. Pocock Group sequential methods in the design and analysis of clinical trials , 1977 .

[22]  Seema K. Shah,et al.  Key criteria for the ethical acceptability of COVID-19 human challenge studies: Report of a WHO Working Group , 2020, Vaccine.

[23]  P. Thall,et al.  Statistical controversies in clinical research: scientific and ethical problems with adaptive randomization in comparative clinical trials. , 2015, Annals of oncology : official journal of the European Society for Medical Oncology.

[24]  D. Berry Adaptive clinical trials: the promise and the caution. , 2011, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[25]  David J. Spiegelhalter,et al.  Bayesian Approaches to Randomized Trials , 1994, Bayesian Biostatistics.

[26]  R. Mahajan,et al.  Adaptive design clinical trials: Methodology, challenges and prospect , 2010, Indian journal of pharmacology.

[27]  Bradley P. Carlin,et al.  Bayesian Adaptive Methods for Clinical Trials , 2010 .

[28]  James O. Berger,et al.  Statistical Analysis and the Illusion of Objectivity , 1988 .

[29]  M. Lipsitch,et al.  How to Test Severe Acute Respiratory Syndrome Coronavirus 2 Vaccines Ethically Even After One Is Available , 2021, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[30]  S. Goodman,et al.  Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations , 2016, European Journal of Epidemiology.

[31]  D L DeMets,et al.  Interim analysis: the alpha spending function approach. , 1994, Statistics in medicine.

[32]  J. Berger,et al.  Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence , 1987 .

[33]  P. O'Brien,et al.  A multiple testing procedure for clinical trials. , 1979, Biometrics.

[34]  S. Chevret,et al.  Evaluation of a multi-arm multi-stage Bayesian design for phase II drug selection trials – an example in hemato-oncology , 2016, BMC Medical Research Methodology.

[35]  Peter F Thall,et al.  Clinical Trial Design as a Decision Problem. , 2017, Applied Stochastic Models in Business and Industry.

[36]  D. Berry,et al.  Interim analyses in clinical trials: classical vs. Bayesian approaches. , 1985, Statistics in medicine.

[37]  M. Lipsitch,et al.  Human Challenge Studies to Accelerate Coronavirus Vaccine Licensure , 2020, The Journal of infectious diseases.

[38]  D. S. Robertson,et al.  Point estimation for adaptive trial designs , 2021 .

[39]  N. Lazar,et al.  The ASA Statement on p-Values: Context, Process, and Purpose , 2016 .

[40]  D. Berry Bayesian clinical trials , 2006, Nature Reviews Drug Discovery.

[41]  Jack Bowden,et al.  Multi-armed Bandit Models for the Optimal Design of Clinical Trials: Benefits and Challenges. , 2015, Statistical science : a review journal of the Institute of Mathematical Statistics.

[42]  Nan Chen,et al.  Phase II trial design with Bayesian adaptive randomization and predictive probability , 2012, Journal of the Royal Statistical Society. Series C, Applied statistics.

[43]  A. Giovagnoli The Bayesian Design of Adaptive Clinical Trials , 2021, International journal of environmental research and public health.

[44]  P. Yip,et al.  A Partial Likelihood Estimator of Vaccine Efficacy , 2000 .

[45]  J Jack Lee,et al.  Bayesian clinical trials in action , 2012, Statistics in medicine.

[46]  P. Wolfson The development and use of extracorporeal membrane oxygenation in neonates. , 2003, The Annals of thoracic surgery.

[47]  Haolun Shi,et al.  Control of Type I Error Rates in Bayesian Sequential Designs , 2019, Bayesian Analysis.

[48]  Shein-Chung Chow,et al.  Adaptive clinical trial design. , 2014, Annual review of medicine.

[49]  Claudio J. Struchiner,et al.  Design and Analysis of Vaccine Studies , 2009 .

[50]  Yuan Ji,et al.  A Bayesian adaptive design for multi-dose, randomized, placebo-controlled phase I/II trials. , 2012, Contemporary clinical trials.

[51]  D. Spiegelhalter,et al.  Summarizing historical information on controls in clinical trials , 2010, Clinical trials.

[52]  Colin Simpson,et al.  Interim findings from first-dose mass COVID-19 vaccination roll-out and COVID-19 hospital admissions in Scotland: a national prospective cohort study , 2021, The Lancet.

[53]  D. Spiegelhalter,et al.  Monitoring clinical trials: conditional or predictive power? , 1986, Controlled clinical trials.

[54]  G. Gurtner,et al.  Statistics in medicine. , 2011, Plastic and reconstructive surgery.

[55]  H Fluehler,et al.  Bayesian approach to bioequivalence assessment: an example. , 1983, Journal of pharmaceutical sciences.

[56]  R. G. Cornell,et al.  Extracorporeal circulation in neonatal respiratory failure: a prospective randomized study. , 1985, Pediatrics.

[57]  William H Press,et al.  Bandit solutions provide unified ethical models for randomized clinical trials and comparative effectiveness research , 2009, Proceedings of the National Academy of Sciences.

[58]  J. Grossman The Likelihood Principle , 2011 .

[59]  P. Thall,et al.  Practical Bayesian adaptive randomisation in clinical trials. , 2007, European journal of cancer.

[60]  Donald A. Berry,et al.  Group sequential clinical trials: a classical evaluation of Bayesian decision-theoretic designs , 1994 .

[61]  Nigel Stallard,et al.  Comparison of Bayesian and frequentist group-sequential clinical trial designs , 2020, BMC medical research methodology.