Evaluating Clinical Trial Designs for Investigational Treatments of Ebola Virus Disease

Background Experimental treatments for Ebola virus disease (EVD) might reduce EVD mortality. There is uncertainty about the ability of different clinical trial designs to identify effective treatments, and about the feasibility of implementing individually randomised controlled trials during an Ebola epidemic. Methods and Findings A treatment evaluation programme for use in EVD was devised using a multi-stage approach (MSA) with two or three stages, including both non-randomised and randomised elements. The probabilities of rightly or wrongly recommending the experimental treatment, the required sample size, and the consequences for epidemic outcomes over 100 d under two epidemic scenarios were compared for the MSA, a sequential randomised controlled trial (SRCT) with up to 20 interim analyses, and, as a reference case, a conventional randomised controlled trial (RCT) without interim analyses. Assuming 50% 14-d survival in the population treated with the current standard of supportive care, all designs had similar probabilities of identifying effective treatments correctly, while the MSA was less likely to recommend treatments that were ineffective. The MSA led to a smaller number of cases receiving ineffective treatments and faster roll-out of highly effective treatments. For less effective treatments, the MSA had a high probability of including an RCT component, leading to a somewhat longer time to roll-out or rejection. Assuming 100 new EVD cases per day, the MSA led to between 6% and 15% greater reductions in epidemic mortality over the first 100 d for highly effective treatments compared to the SRCT. Both the MSA and SRCT led to substantially fewer deaths than a conventional RCT if the tested interventions were either highly effective or harmful. In the proposed MSA, the major threat to the validity of the results of the non-randomised components is that referral patterns, standard of care, or the virus itself may change during the study period in ways that affect mortality. Adverse events are also harder to quantify without a concurrent control group. Conclusions The MSA discards ineffective treatments quickly, while reliably providing evidence concerning effective treatments. The MSA is appropriate for the clinical evaluation of EVD treatments.

[1]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[2]  R. Madsen,et al.  P values for tests using a repeated significance test design , 1982 .

[3]  P. Horby,et al.  Randomised controlled trials for Ebola: practical and ethical issues , 2014, The Lancet.

[4]  W. Team Ebola Virus Disease in West Africa — The First 9 Months of the Epidemic and Forward Projections , 2014 .

[5]  Peter Piot,et al.  The Ebola emergency--immediate action, ongoing strategy. , 2014, The New England journal of medicine.

[6]  John Whitehead,et al.  An exact method for analysis following a two-stage phase II cancer clinical trial. , 2010, Statistics in medicine.

[7]  Mikiko Senga,et al.  Ebola virus disease in West Africa--the first 9 months of the epidemic and forward projections. , 2014, The New England journal of medicine.

[8]  E. S. Pearson,et al.  THE USE OF CONFIDENCE OR FIDUCIAL LIMITS ILLUSTRATED IN THE CASE OF THE BINOMIAL , 1934 .

[9]  E. Emanuel,et al.  Ethical considerations of experimental interventions in the Ebola outbreak , 2014, The Lancet.

[10]  David L Heymann,et al.  Ebola: learn from the past , 2014, Nature.

[11]  J. Whitehead,et al.  A generalized Dunnett Test for Multi-arm Multi-stage Clinical Studies with Treatment Selection , 2012 .

[12]  H Merabet,et al.  The design and analysis of sequential clinical trials , 2013 .

[13]  John Whitehead,et al.  Stopping clinical trials because of treatment ineffectiveness: a comparison of a futility design with a method of stochastic curtailment , 2003, Statistics in medicine.

[14]  N Stallard,et al.  Optimal Adaptive Designs for Binary Response Trials , 2001, Biometrics.

[15]  I. Bross,et al.  Sequential Medical Plans. , 1952 .

[16]  John Whitehead,et al.  The double triangular test in practice , 2004 .

[17]  John Whitehead,et al.  Group sequential trials revisited: Simple implementation using SAS , 2011, Statistical methods in medical research.

[18]  S. Joffe Evaluating novel therapies during the Ebola epidemic. , 2014, JAMA.

[19]  C. Rout,et al.  A Reevaluation of the Role of Crystalloid Preload in the Prevention of Hypotension Associated with Spinal Anesthesia for Elective Cesarean Section , 1993, Anesthesiology.