The cumulative effect of reporting and citation biases on the apparent efficacy of treatments: the case of depression

Evidence-based medicine is the cornerstone of clinical practice, but it is dependent on the quality of evidence upon which it is based. Unfortunately, up to half of all randomized controlled trials (RCTs) have never been published, and trials with statistically significant findings are more likely to be published than those without (Dwan et al., 2013). Importantly, negative trials face additional hurdles beyond study publication bias that can result in the disappearance of non-significant results (Boutron et al., 2010; Dwan et al., 2013; Duyx et al., 2017). Here, we analyze the cumulative impact of biases on apparent efficacy, and discuss possible remedies, using the evidence base for two effective treatments for depression: Antidepressants and psychotherapy.

[1]  Harlan M. Krumholz,et al.  Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis , 2009, PLoS medicine.

[2]  Douglas G Altman,et al.  Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. , 2010, JAMA.

[3]  M. Munafo,et al.  Citation bias and selective focus on positive findings in the literature on the serotonin transporter gene (5-HTTLPR), life stress and depression , 2016, Psychological Medicine.

[4]  J. Meerpohl,et al.  How Psychiatry Journals Support the Unbiased Translation of Clinical Research. A Cross-Sectional Study of Editorial Policies , 2013, PloS one.

[5]  Timothy F. Platts-Mills,et al.  Comparison of registered and published outcomes in randomized controlled trials: a systematic review , 2015, BMC Medicine.

[6]  Stephanie L Harriman,et al.  When are clinical trials registered? An analysis of prospective versus retrospective registration , 2016, Trials.

[7]  M. Kicinski How does under-reporting of negative and inconclusive results affect the false-positive rate in meta-analysis? A simulation study , 2014, BMJ Open.

[8]  M. Zeegers,et al.  Scientific citations favor positive results: a systematic review and meta-analysis. , 2017, Journal of clinical epidemiology.

[9]  J. Amsterdam,et al.  Fluoxetine in major depression: a controlled study , 1986 .

[10]  Sally Hopewell,et al.  Impact of spin in the abstracts of articles reporting results of randomized controlled trials in the field of cancer: the SPIIN randomized controlled trial. , 2014, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[11]  P. Cuijpers,et al.  Is there an excess of significant findings in published studies of psychotherapy for depression? , 2014, Psychological Medicine.

[12]  R. Rosenthal,et al.  Selective publication of antidepressant trials and its influence on apparent efficacy. , 2008, The New England journal of medicine.

[13]  S. Hollon,et al.  Does Publication Bias Inflate the Apparent Efficacy of Psychological Treatment for Major Depressive Disorder? A Systematic Review and Meta-Analysis of US National Institutes of Health-Funded Trials , 2015, PloS one.