Choosing sensitivity analyses for randomised trials: principles

BackgroundSensitivity analyses are an important tool for understanding the extent to which the results of randomised trials depend upon the assumptions of the analysis. There is currently no guidance governing the choice of sensitivity analyses.DiscussionWe provide a principled approach to choosing sensitivity analyses through the consideration of the following questions: 1) Does the proposed sensitivity analysis address the same question as the primary analysis? 2) Is it possible for the proposed sensitivity analysis to return a different result to the primary analysis? 3) If the results do differ, is there any uncertainty as to which will be believed? Answering all of these questions in the affirmative will help researchers to identify relevant sensitivity analyses. Treating analyses as sensitivity analyses when one or more of the answers are negative can be misleading and confuse the interpretation of studies. The value of these questions is illustrated with several examples.SummaryBy removing unreasonable analyses that might have been performed, these questions will lead to relevant sensitivity analyses, which help to assess the robustness of trial results.

[1]  D. Rubin,et al.  Bayesian inference for causal effects in randomized experiments with noncompliance , 1997 .

[2]  J. Tao,et al.  The effect of Baduanjin exercise for physical and psychological wellbeing of college students: study protocol for a randomized controlled trial , 2013, Trials.

[3]  G. Perkins,et al.  Prehospital randomised assessment of a mechanical compression device in cardiac arrest (PaRAMeDIC) trial protocol , 2010, Scandinavian journal of trauma, resuscitation and emergency medicine.

[4]  Ian R White,et al.  Strategy for intention to treat analysis in randomised trials with missing outcome data , 2011, BMJ : British Medical Journal.

[5]  H. Teppler,et al.  Impact of alternate definitions of fever resolution on the composite endpoint in clinical trials of empirical antifungal therapy for neutropenic patients with persistent fever: analysis of results from the Caspofungin Empirical Therapy Study , 2006, Transplant infectious disease : an official journal of the Transplantation Society.

[6]  RAP Scott,et al.  The Multicentre Aneurysm Screening Study (MASS) into the effect of abdominal aortic aneurysm screening on mortality in men: a randomised controlled trial , 2002, The Lancet.

[7]  T. Cleophas The performance of the two-stage analysis of two-treatment, two-period crossover trials. , 1991, Statistics in medicine.

[8]  L. Mbuagbaw,et al.  A tutorial on sensitivity analyses in clinical trials: the what, why, when and how , 2013, BMC Medical Research Methodology.

[9]  Stephanie J. C. Taylor,et al.  Effectiveness and cost-effectiveness of a novel, group self-management course for adults with chronic musculoskeletal pain: study protocol for a multicentre, randomised controlled trial (COPERS) , 2013, BMJ Open.

[10]  G M Raab,et al.  How to select covariates to include in the analysis of a clinical trial. , 2000, Controlled clinical trials.

[11]  I. White Uses and limitations of randomization-based efficacy estimators , 2005, Statistical methods in medical research.

[12]  M. Humbert,et al.  Riociguat for the treatment of pulmonary arterial hypertension. , 2013, The New England journal of medicine.

[13]  F B Hu,et al.  Comparison of population-averaged and subject-specific approaches for analyzing repeated binary outcomes. , 1998, American journal of epidemiology.

[14]  Brennan C Kahan,et al.  Bias in randomised factorial trials , 2013, Statistics in medicine.

[15]  C B Dean,et al.  The consequences of proportional hazards based model selection. , 2014, Statistics in medicine.

[16]  J. Schafer Multiple imputation: a primer , 1999, Statistical methods in medical research.

[17]  B. Kahan,et al.  Assessing potential sources of clustering in individually randomised trials , 2013, BMC Medical Research Methodology.

[18]  P. Bendtsen,et al.  A Text Messaging-Based Smoking Cessation Program for Adult Smokers: Randomized Controlled Trial , 2012, Journal of medical Internet research.