Choosing the target difference and undertaking and reporting the sample size calculation for a randomised controlled trial – the development of the DELTA2 guidance

BackgroundA key step in the design of a randomised controlled trial is the estimation of the number of participants needed. The most common approach is to specify a target difference in the primary outcome between the randomised groups and then estimate the corresponding sample size. The sample size is chosen to provide reassurance that the trial will have high statistical power to detect the target difference at the planned statistical significance level. Alternative approaches are also available, though most still require specification of a target difference.The sample size has many implications for the conduct of the study, as well as incurring scientific and ethical aspects. Despite the critical role of the target difference for the primary outcome in the design of a randomised controlled trial (RCT), the manner in which it is determined has received little attention. This article reports the development of the DELTA2 guidance on the specification and reporting of the target difference for the primary outcome in a sample size calculation for a RCT.MethodsThe DELTA2 (Difference ELicitation in TriAls) project has five components comprising systematic literature reviews of recent methodological developments (stage 1) and existing funder guidance (stage 2), a Delphi study (stage 3), a 2-day consensus meeting bringing together researchers, funders and patient representatives (stage 4), and the preparation and dissemination of a guidance document (stage 5).ResultsThe project started in April 2016. The literature search identified 28 articles of methodological developments relevant to a method for specifying a target difference. A Delphi study involving 69 participants, along with a 2-day consensus meeting were conducted. In addition, further engagement sessions were held at two international conferences. The main guidance text was finalised on April 18, 2018, after revision informed by feedback gathered from stages 2 and 3 and from funder representatives.DiscussionThe DELTA2 Delphi study identified a number of areas (such as practical recommendations and examples, greater coverage of different trial designs and statistical approaches) of particular interest amongst stakeholders which new guidance was desired to meet. New relevant references were identified by the review. Such findings influenced the scope, drafting and revision of the guidance. While not all suggestions could be accommodated, it is hoped that the process has led to a more useful and practical document.

[1]  H. Glick Sample Size and Power for Cost-Effectiveness Analysis (Part 1) , 2011, PharmacoEconomics.

[2]  J. Bland,et al.  The tyranny of power: is there a better way to calculate sample size? , 2009, BMJ : British Medical Journal.

[3]  H. Glick Sample Size and Power for Cost-Effectiveness Analysis (Part 2) , 2011, PharmacoEconomics.

[4]  Steven A. Julious,et al.  Sample Sizes for Clinical Trials , 2009 .

[5]  Andrew R. Willan,et al.  Sample Size Determination for Cost-Effectiveness Trials , 2011, PharmacoEconomics.

[6]  Theresa Schilhab,et al.  Issues to Consider , 2017 .

[7]  Douglas G. Altman,et al.  Methods for Specifying the Target Difference in a Randomised Controlled Trial: The Difference ELicitation in TriAls (DELTA) Systematic Review , 2014, PLoS medicine.

[8]  E. Wilson A Practical Guide to Value of Information Analysis , 2015, PharmacoEconomics.

[9]  R. Emsley,et al.  Choosing the target difference (‘effect size’) for a randomised controlled trial - DELTA2 guidance protocol , 2017, Trials.

[10]  Jane M Blazeby,et al.  Developing core outcome sets for clinical trials: issues to consider , 2012, Trials.

[11]  Wess A. Cohen,et al.  Defining a Research Agenda for Patient-Reported Outcomes in Surgery: Using a Delphi Survey of Stakeholders. , 2016, JAMA surgery.

[12]  R. Emsley,et al.  DELTA2 guidance on choosing the target difference and undertaking and reporting the sample size calculation for a randomised controlled trial , 2018, Trials.

[13]  P. Fayers,et al.  Assessing methods to specify the target difference for a randomised controlled trial: DELTA (Difference ELicitation in TriAls) review. , 2014, Health technology assessment.

[14]  M. Ferreira,et al.  A critical review of methods used to determine the smallest worthwhile effect of interventions for low back pain. , 2012, Journal of clinical epidemiology.

[15]  Douglas G Altman,et al.  Specifying the target difference in the primary outcome for a randomised controlled trial: guidance for researchers , 2015, Trials.