How Frequently Do the Results from Completed US Clinical Trials Enter the Public Domain? - A Statistical Analysis of the ClinicalTrials.gov Database

Background Achieving transparency in clinical trials, through either publishing results in a journal or posting results to the ClinicalTrials.gov (CTG) web site, is an essential public health good. However, it remains unknown what proportion of completed studies achieve public disclosure of results (PDOR), or what factors explain these differences. Methods We analyzed data from 400 randomly selected studies within the CTG database that had been listed as ‘completed’ and had at least four years in which to disclose results. Using Kaplan-Meier curves, we calculated times from completion to PDOR (defined as publishing the primary outcomes in a journal and/or posting results to CTG), and identified explanatory variables predicting these outcomes using Cox proportional hazards models. Findings Among the 400 clinical trials, 118 (29.5%) failed to achieve PDOR within four years of completion. The median day from study completion to PDOR among 282 studies (70.5%) that achieved PDOR was 602 days (mean 647 days, SD 454 days). Studies were less likely to achieve PDOR if at earlier stages (phase 2 vs. phase 3/4, adjusted HR 0.60, 95% CI 0.47–0.78), if they only included adult subjects (adjusted HR 0.61, 95% CI 0.45–0.83), involved randomization (adjusted HR 0.62, 95% CI 0.46–0.83), or had smaller sample sizes (≤50 subjects vs. >50, adjusted HR 0.60, 95% CI 0.44–0.83). Industry-funded studies were significantly less likely to be published than non-industry or blended studies (adjusted HR 0.49, 95% CI 0.36–0.66). Conclusions A significant proportion of completed studies did not achieve PDOR within the four years of follow-up, particularly smaller studies at earlier stages of development with industry funding. This constitutes reporting bias and threatens the validity of the clinical research literature in the US.

[1]  R. Simes Publication bias: the case for an international registry of clinical trials. , 1986, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[2]  Harlan M Krumholz,et al.  Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis , 2012, BMJ : British Medical Journal.

[3]  D. Zucker The Belmont Report , 2014 .

[4]  Kay Dickersin,et al.  Publication bias against negative results from clinical trials: three of the seven deadly sins , 2007, Nature Clinical Practice Neurology.

[5]  M. Lauer,et al.  Publication of trials funded by the National Heart, Lung, and Blood Institute. , 2014, The New England journal of medicine.

[6]  Tony Tse,et al.  Moving Toward Transparency of Clinical Trials , 2008, Science.

[7]  R. Rosenthal,et al.  Selective publication of antidepressant trials and its influence on apparent efficacy. , 2008, The New England journal of medicine.

[8]  Harlan M. Krumholz,et al.  Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis , 2009, PLoS medicine.

[9]  Yuko Kawasumi,et al.  Despite law, fewer than one in eight completed studies of drugs and biologics are reported on time on ClinicalTrials.gov. , 2011, Health affairs.

[10]  S. Brophy,et al.  Interventions for latent autoimmune diabetes (LADA) in adults. , 2011, The Cochrane database of systematic reviews.

[11]  A. Prochazka,et al.  Research without results: inadequate public reporting of clinical trial results. , 2012, Contemporary clinical trials.

[12]  P. Easterbrook,et al.  Publication bias in clinical research , 1991, The Lancet.

[13]  M. Lauer,et al.  Publication of trials funded by the National Heart, Lung, and Blood Institute. , 2013, The New England journal of medicine.

[14]  John Hoey,et al.  Clinical trial registration: a statement from the International Committee of Medical Journal Editors. , 2005, Circulation.

[15]  C. Gill How often do US-based human subjects research studies register on time, and how often do they post their results? A statistical analysis of the Clinicaltrials.gov database , 2012, BMJ Open.

[16]  A. Smyth,et al.  Compliance with mandatory reporting of clinical trial results on ClinicalTrials.gov: cross sectional study , 2012, BMJ : British Medical Journal.

[17]  Sally Hopewell,et al.  Publication bias in clinical trials due to statistical significance or direction of trial results. , 2009, The Cochrane database of systematic reviews.

[18]  A. Sutton,et al.  Assessment of publication bias, selection bias, and unavailable data in meta-analyses using individual participant data: a database survey , 2012, BMJ : British Medical Journal.