Guidelines for the Content of Statistical Analysis Plans in Clinical Trials

Importance While guidance on statistical principles for clinical trials exists, there is an absence of guidance covering the required content of statistical analysis plans (SAPs) to support transparency and reproducibility. Objective To develop recommendations for a minimum set of items that should be addressed in SAPs for clinical trials, developed with input from statisticians, previous guideline authors, journal editors, regulators, and funders. Design Funders and regulators (n = 39) of randomized trials were contacted and the literature was searched to identify existing guidance; a survey of current practice was conducted across the network of UK Clinical Research Collaboration–registered trial units (n = 46, 1 unit had 2 responders) and a Delphi survey (n = 73 invited participants) was conducted to establish consensus on SAPs. The Delphi survey was sent to statisticians in trial units who completed the survey of current practice (n = 46), CONSORT (Consolidated Standards of Reporting Trials) and SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) guideline authors (n = 16), pharmaceutical industry statisticians (n = 3), journal editors (n = 9), and regulators (n = 2) (3 participants were included in 2 groups each), culminating in a consensus meeting attended by experts (N = 12) with representatives from each group. The guidance subsequently underwent critical review by statisticians from the surveyed trial units and members of the expert panel of the consensus meeting (N = 51), followed by piloting of the guidance document in the SAPs of 5 trials. Findings No existing guidance was identified. The registered trials unit survey (46 responses) highlighted diversity in current practice and confirmed support for developing guidance. The Delphi survey (54 of 73, 74% participants completing both rounds) reached consensus on 42% (n = 46) of 110 items. The expert panel (N = 12) agreed that 63 items should be included in the guidance, with an additional 17 items identified as important but may be referenced elsewhere. Following critical review and piloting, some overlapping items were combined, leaving 55 items. Conclusions and Relevance Recommendations are provided for a minimum set of items that should be addressed and included in SAPs for clinical trials. Trial registration, protocols, and statistical analysis plans are critically important in ensuring appropriate reporting of clinical trials.

[1]  Fiona Godlee,et al.  [Data sharing statements for clinical trials: a requirement of the International Committee of Medical Journal Editors]. , 2017, Ugeskrift for laeger.

[2]  M. Baker 1,500 scientists lift the lid on reproducibility , 2016, Nature.

[3]  J. Herson Strategies for dealing with fraud in clinical trials , 2016, International Journal of Clinical Oncology.

[4]  M. Sydes,et al.  How should individual participant data (IPD) from publicly funded clinical trials be shared? , 2015, BMC Medicine.

[5]  S. Lewis,et al.  Trial Steering Committees in randomised controlled trials: A survey of registered clinical trials units to establish current practice and experiences , 2015, Clinical trials.

[6]  Guido Rasi,et al.  Transparency and the European Medicines Agency--sharing of clinical trial data. , 2014, The New England journal of medicine.

[7]  C. Gamble,et al.  Prospective multicentre randomised, double-blind, equivalence study comparing clonidine and midazolam as intravenous sedative agents in critically ill children: the SLEEPS (Safety profiLe, Efficacy and Equivalence in Paediatric intensive care Sedation) study. , 2014, Health technology assessment.

[8]  N. Marlow,et al.  The SNAP trial: a randomised placebo-controlled trial of nicotine replacement therapy in pregnancy--clinical effectiveness and safety until 2 years after delivery, with economic evaluation. , 2014, Health technology assessment.

[9]  Douglas G. Altman,et al.  Evidence for the Selective Reporting of Analyses and Discrepancies in Clinical Trials: A Systematic Review of Cohort Studies of Clinical Trials , 2014, PLoS medicine.

[10]  C B Dean,et al.  The consequences of proportional hazards based model selection. , 2014, Statistics in medicine.

[11]  R. Bellomo,et al.  Statistical analysis plan for the HEAT trial: a multicentre randomised placebo-controlled trial of intravenous paracetamol in intensive care unit patients with fever and infection. , 2013, Critical care and resuscitation : journal of the Australasian Academy of Critical Care Medicine.

[12]  Kathryn M Rowan,et al.  The Protocolised Management in Sepsis (ProMISe) trial statistical analysis plan. , 2013, Critical care and resuscitation : journal of the Australasian Academy of Critical Care Medicine.

[13]  Anthony L. Johnson,et al.  A randomised trial of adaptive pacing therapy, cognitive behaviour therapy, graded exercise, and specialist medical care for chronic fatigue syndrome (PACE): statistical analysis plan , 2013, Trials.

[14]  T. Peters,et al.  The Active for Life Year 5 (AFLY5) school-based cluster randomised controlled trial protocol: detailed statistical analysis plan , 2013, Trials.

[15]  David Moher,et al.  SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials , 2013, BMJ.

[16]  C. Gamble,et al.  The use of MElatonin in children with neurodevelopmental disorders and impaired sleep: a randomised, double-blind, placebo-controlled, parallel study (MENDS). , 2012, Health technology assessment.

[17]  E. Peterson,et al.  The value of statistical analysis plans in observational research: defining high-quality research from the start. , 2012, JAMA.

[18]  H. Schünemann,et al.  [GRADE guidelines: 2. Framing the question and deciding on important outcomes]. , 2012, Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen.

[19]  R. Rosenfeld,et al.  Authority , 2010, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[20]  D. Moher,et al.  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2011, BMJ : British Medical Journal.

[21]  D. Moher,et al.  CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials , 2010, Journal of pharmacology & pharmacotherapeutics.

[22]  Douglas G Altman,et al.  The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews , 2010, BMJ : British Medical Journal.

[23]  D. Moher,et al.  CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trialsqqq , 2018 .

[24]  R. Bellomo,et al.  Why publish statistical analysis plans? , 2009, Critical care and resuscitation : journal of the Australasian Academy of Critical Care Medicine.

[25]  A. Marson,et al.  A randomised controlled trial examining the longer-term outcomes of standard versus new antiepileptic drugs. The SANAD trial. , 2007, Health technology assessment.

[26]  J. Ganju Diagnostics for assumptions in moderate to large simple clinical trials: do they really help? by Jonathan J. Shuster, Statistics in Medicine 2005; 24:2431–2438 , 2006, Statistics in medicine.

[27]  Graham Dunn,et al.  Estimating treatment effects from randomized clinical trials with noncompliance and loss to follow-up: the role of instrumental variable methods , 2005, Statistical methods in medical research.

[28]  John Hoey,et al.  Clinical trial registration: a statement from the International Committee of Medical Journal Editors. , 2005, Circulation.

[29]  Ian R White,et al.  Are missing outcome data adequately handled? A review of published randomized controlled trials in major medical journals , 2004, Clinical trials.

[30]  G M Raab,et al.  How to select covariates to include in the analysis of a clinical trial. , 2000, Controlled clinical trials.

[31]  S. Hollis,et al.  What is meant by intention to treat analysis? Survey of published randomised controlled trials , 1999, BMJ.

[32]  S. Senn Testing for baseline balance in clinical trials. , 1994, Statistics in medicine.

[33]  D. Rubin INFERENCE AND MISSING DATA , 1975 .