Deciphering assumptions about stepped wedge designs: the case of Ebola vaccine research

Ethical concerns about randomising persons to a no-treatment arm in the context of Ebola epidemic led to consideration of alternative designs. The stepped wedge (SW) design, in which participants or clusters are randomised to receive an intervention at different time points, gained popularity. Common arguments in favour of using this design are (1) when an intervention is likely to do more good than harm, (2) all participants should receive the experimental intervention at some time point during the study and (3) the design might be preferable for practical reasons. We examine these assumptions when considering Ebola vaccine research. First, based on the claim that a stepped wedge design is indicated when it is likely that the intervention will do more good than harm, we reviewed published and ongoing SW trials to explore previous use of this design to test experimental drugs or vaccines, and found that SW design has never been used for trials of experimental drugs or vaccines. Given that Ebola vaccines were all experimental with no prior efficacy data, the use of a stepped wedge design would have been unprecedented. Second, we show that it is rarely true that all participants receive the intervention in SW studies, but rather, depending on certain design features, all clusters receive the intervention. Third, we explore whether the SW design is appealing for feasibility reasons and point out that there is significant complexity. In the setting of the Ebola epidemic, spatiotemporal variation may have posed problematic challenges to a stepped wedge design for vaccine research. Finally, we propose a set of points to consider for scientific reviewers and ethics committees regarding proposals for SW designs.

[1]  Celia A Taylor nee Brown,et al.  Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. , 2011, Journal of clinical epidemiology.

[2]  R. Chaisson,et al.  Effect of routine isoniazid preventive therapy on tuberculosis incidence among HIV-infected men in South Africa: a novel randomized incremental recruitment study. , 2005, JAMA.

[3]  J. Kestle Clinical Trials , 2014, World Journal of Surgery.

[4]  E. Emanuel,et al.  Ethical considerations of experimental interventions in the Ebola outbreak , 2014, The Lancet.

[5]  J. Hughes,et al.  Design and analysis of stepped wedge cluster randomized trials. , 2007, Contemporary clinical trials.

[6]  H. Whittle,et al.  Efficacy and effectiveness of infant vaccination against chronic hepatitis B in the Gambia Hepatitis Intervention Study (1986–90) and in the nationwide immunisation program , 2014, BMC Infectious Diseases.

[7]  J. Grimshaw,et al.  The Ottawa Statement on the ethical design and conduct of cluster randomised trials: précis for researchers and research ethics committees , 2013, BMJ.

[8]  J. Dushoff,et al.  Ebola virus vaccine trials: the ethical mandate for a therapeutic safety net , 2014, BMJ : British Medical Journal.

[9]  A. Hall,et al.  Population-Based Interventions to Reduce the Public Health Burden Related with Hepatitis B Virus Infection in The Gambia, West Africa , 2014, Tropical medicine and health.

[10]  D. Mohammadi Ebola vaccine trials back on track , 2015, The Lancet.

[11]  D. Gerritsen,et al.  Stepped wedge designs could reduce the required sample size in cluster randomized trials. , 2013, Journal of clinical epidemiology.

[12]  J. V. van Delden,et al.  The need to balance merits and limitations from different disciplines when considering the stepped wedge cluster randomized trial design , 2015, BMC Medical Research Methodology.

[13]  Andrew J Copas,et al.  Analysis and reporting of stepped wedge randomised controlled trials: synthesis and critical appraisal of published studies, 2010 to 2014 , 2015, Trials.

[14]  C. Grady,et al.  What makes clinical research ethical? , 2000, JAMA.

[15]  Conor P. Cahill,et al.  Design of a phase III multicenter trial to evaluate the efficacy of the RTS,S/AS01 malaria vaccine in children across diverse transmission settings in Africa , 2011, Malaria Journal.

[16]  Valérie Buthion,et al.  ColoNav: patient navigation for colorectal cancer screening in deprived areas – Study protocol , 1999, BMC Cancer.

[17]  Jeffrey S. A. Stringer,et al.  Design of the HIV Prevention Trials Network (HPTN) Protocol 054: A cluster randomized crossover trial to evaluate combined access to Nevirapine in developing countries , 2003 .

[18]  Christopher Dye,et al.  Ebola vaccine--an urgent international priority. , 2014, The New England journal of medicine.

[19]  A. Hill,et al.  Emergency Ebola response: a new approach to the rapid design and development of vaccines against emerging diseases. , 2015, The Lancet. Infectious diseases.

[20]  C. Metcalfe The analysis of cross‐over trials with baseline measurements , 2010, Statistics in Medicine.

[21]  M. Taljaard,et al.  Sample size calculations for stepped wedge and cluster randomised trials: a unified approach , 2016, Journal of clinical epidemiology.

[22]  John-Arne Røttingen,et al.  The ring vaccination trial: a novel cluster randomised controlled trial design to evaluate vaccine efficacy and effectiveness during outbreaks, with special reference to Ebola , 2015, BMJ : British Medical Journal.

[23]  Gianluca Baio,et al.  Sample size calculation for a stepped wedge trial , 2015, Trials.

[24]  S. Buchbinder,et al.  Extended follow-up confirms early vaccine-enhanced risk of HIV acquisition and demonstrates waning effect over time among participants in a randomized trial of recombinant adenovirus HIV vaccine (Step Study). , 2012, The Journal of infectious diseases.

[25]  D. Altman,et al.  CONSORT statement: extension to cluster randomised trials , 2004, BMJ : British Medical Journal.

[26]  Gianluca Baio,et al.  Designing a stepped wedge trial: three main designs, carry-over effects and randomisation approaches , 2015, Trials.

[27]  S. Joffe Evaluating novel therapies during the Ebola epidemic. , 2014, JAMA.

[28]  B. Mahon Vaccine trials during outbreaks: The Sierra Leone trial to introduce a vaccine against Ebola (STRIVE) experience , 2016 .

[29]  J. Clemens,et al.  Issues in the design and implementation of vaccine trials in less developed countries , 2006, Nature Reviews Drug Discovery.

[30]  D. Osrin,et al.  Logistic, ethical, and political dimensions of stepped wedge trials: critical review and case studies , 2015, Trials.

[31]  A. Schuchat,et al.  Comment: The Sierra Leone Trial to Introduce a Vaccine Against Ebola (STRIVE) , 2018, The Journal of infectious diseases.

[32]  Karla Hemming,et al.  Stepped-wedge cluster randomised controlled trials: a generic framework including parallel and multiple-level designs , 2014, Statistics in medicine.

[33]  Ingeborg van der Tweel,et al.  Issues in the Use of Stepped Wedge Cluster and Alternative Designs in the Case of Pandemics , 2013, The American journal of bioethics : AJOB.

[34]  Gianluca Baio,et al.  Stepped wedge randomised controlled trials: systematic review of studies published between 2010 and 2014 , 2015, Trials.

[35]  Lauren Ancel Meyers,et al.  Statistical power and validity of Ebola vaccine trials in Sierra Leone: a simulation study of trial design and analysis. , 2015, The Lancet. Infectious diseases.

[36]  R. Hayes,et al.  Simple sample size calculation for cluster-randomized trials. , 1999, International journal of epidemiology.

[37]  M. Ramsay,et al.  Planning, registration, and implementation of an immunisation campaign against meningococcal serogroup C disease in the UK: a success story. , 2001, Vaccine.

[38]  S. Edwards Response to Open Peer Commentaries on “Ethics of Clinical Science in a Public Health Emergency: Drug Discovery at the Bedside” , 2013, The American journal of bioethics : AJOB.

[39]  J. Grimshaw,et al.  The Ottawa Statement on the Ethical Design and Conduct of Cluster Randomized Trials , 2012, PLoS medicine.

[40]  John-Arne Røttingen,et al.  Efficacy and effectiveness of an rVSV-vectored vaccine expressing Ebola surface glycoprotein: interim results from the Guinea ring vaccination cluster-randomised trial , 2015, The Lancet.

[41]  P. Horby,et al.  Randomised controlled trials for Ebola: practical and ethical issues , 2014, The Lancet.

[42]  J. Piszczek,et al.  Stepped-wedge trial design to evaluate Ebola treatments. , 2015, The Lancet. Infectious diseases.

[43]  R. Temple,et al.  Evaluating Ebola therapies--the case for RCTs. , 2014, The New England journal of medicine.

[44]  R J Lilford,et al.  The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting , 2015, BMJ : British Medical Journal.

[45]  JoAnna M Scott,et al.  Finite-sample corrected generalized estimating equation of population average treatment effects in stepped wedge cluster randomized trials , 2017, Statistical methods in medical research.

[46]  Devan V Mehrotra,et al.  Efficacy assessment of a cell-mediated immunity HIV-1 vaccine (the Step Study): a double-blind, randomised, placebo-controlled, test-of-concept trial , 2008, The Lancet.

[47]  K. Holmes,et al.  Uptake and Population-Level Impact of Expedited Partner Therapy (EPT) on Chlamydia trachomatis and Neisseria gonorrhoeae: The Washington State Community-Level Randomized Trial of EPT , 2015, PLoS medicine.

[48]  Annette Rid,et al.  Ethical Rationale for the Ebola "Ring Vaccination" Trial Design. , 2016, American journal of public health.

[49]  R. Chaisson,et al.  Statistical design of THRio: a phased implementation clinic-randomized study of a tuberculosis preventive therapy intervention , 2007, Clinical trials.

[50]  A. Caplan Morality in a time of Ebola , 2015, The Lancet.

[51]  S. Edwards Ethics of Clinical Science in a Public Health Emergency: Drug Discovery at the Bedside , 2013, The American journal of bioethics : AJOB.

[52]  R. Lilford,et al.  Bmc Medical Research Methodology Open Access the Stepped Wedge Trial Design: a Systematic Review , 2022 .