Misreporting of Results of Research in Psychiatry.

Few studies address publication and outcome reporting biases of randomized controlled trials (RCTs) in psychiatry. The objective of this study was to determine publication and outcome reporting bias in RCTs funded by the Stanley Medical Research Institute (SMRI), a U.S. based, non-profit organization funding RCTs in schizophrenia and bipolar disorder. We identified all RCTs (n = 280) funded by SMRI between 2000 and 2011, and using non-public, final study reports and published manuscripts, we classified the results as positive or negative in terms of the drug compared to placebo. Design, outcome measures and statistical methods specified in the original protocol were compared to the published manuscript. Of 280 RCTs funded by SMRI between 2000 and 2011, at the time of this writing, three RCTs were ongoing and 39 were not performed. Among the 238 completed RCTs, 86 (36.1%) reported positive and 152 (63.9%) reported negative results: 86% (74/86) of those with positive findings were published in contrast to 53% (80/152) of those with negative findings (P < .001). In 70% of the manuscripts published, there were major discrepancies between the published manuscript and the original RCT protocol (change in the primary outcome measure or statistics, change in a number of patient groups, 25% or more reduction in sample size). We conclude that publication bias and outcome reporting bias is common in papers reporting RCTs in schizophrenia and bipolar disorder. These data have major implications regarding the validity of the reports of clinical trials published in the literature.

[1]  H. Krumholz,et al.  Registration, results reporting, and publication bias of clinical trials supporting FDA approval of neuropsychiatric drugs before and after FDAAA: a retrospective cohort study , 2018, Trials.

[2]  S. Bacon,et al.  Compliance with requirement to report results on the EU Clinical Trials Register: cohort study and web resource , 2018, British Medical Journal.

[3]  T. Furukawa,et al.  Overstatements in abstract conclusions claiming effectiveness of interventions in psychiatry: A meta-epidemiological investigation , 2017, PloS one.

[4]  S. Stayer,et al.  Bias Among Peer Reviewers. , 2017, JAMA.

[5]  David Taylor Prescribing according to diagnosis: how psychiatry is different , 2016, World psychiatry : official journal of the World Psychiatric Association.

[6]  C. Tufanaru,et al.  Restoring Study 329: efficacy and harms of paroxetine and imipramine in treatment of major depression in adolescence , 2015, BMJ : British Medical Journal.

[7]  E. Dorsey,et al.  The anatomy of medical research: US and international comparisons. , 2015, JAMA.

[8]  J. Ioannidis,et al.  Non-publication and delayed publication of randomized trials on vaccines: survey , 2014, BMJ : British Medical Journal.

[9]  A. Amos A review of spin and bias use in the early intervention in psychosis literature. , 2014, The primary care companion for CNS disorders.

[10]  M. Lauer,et al.  Publication of trials funded by the National Heart, Lung, and Blood Institute. , 2013, The New England journal of medicine.

[11]  Christopher W. Jones,et al.  Non-publication of large randomized clinical trials: cross sectional analysis , 2013, BMJ.

[12]  C. Gamble,et al.  Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias — An Updated Review , 2013, PloS one.

[13]  H. Krumholz,et al.  Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis , 2012, BMJ : British Medical Journal.

[14]  D. Eyding,et al.  Reboxetine for acute treatment of major depression: systematic review and meta-analysis of published and unpublished placebo and selective serotonin reuptake inhibitor controlled trials , 2010, BMJ : British Medical Journal.

[15]  Kay Dickersin,et al.  Outcome reporting in industry-sponsored trials of gabapentin for off-label use. , 2009, The New England journal of medicine.

[16]  Sally Hopewell,et al.  Publication bias in clinical trials due to statistical significance or direction of trial results. , 2009, The Cochrane database of systematic reviews.

[17]  S. Evans,et al.  Selective reporting in clinical trials: analysis of trial protocols accepted by The Lancet , 2008, The Lancet.

[18]  A. Hrõbjartsson,et al.  Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. , 2004, JAMA.

[19]  D. Rennie,et al.  Publication bias in editorial decision making. , 2002, JAMA.

[20]  J. Ioannidis Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. , 1998, JAMA.

[21]  K. Dickersin,et al.  NIH clinical trials and publication bias. , 1993, The Online journal of current clinical trials.

[22]  K. Dickersin,et al.  Publication bias and clinical trials. , 1987, Controlled clinical trials.

[23]  I. Chalmers Proposal to outlaw the term “negative trial” , 1985 .

[24]  Sergio Sismondo,et al.  Industry sponsorship and research outcome. , 2012, The Cochrane database of systematic reviews.

[25]  Megan M. Filkowski,et al.  Publication bias and the pharmaceutical industry: the case of lamotrigine in bipolar disorder. , 2008, Medscape journal of medicine.