Adherence to the International Committee of Medical Journal Editors’ (ICMJE) prospective registration policy and implications for outcome integrity: a cross-sectional analysis of trials published in high-impact specialty society journals

BackgroundRegistration of clinical trials is critical for promoting transparency and integrity in medical research; however, trials must be registered in a prospective fashion to deter unaccounted protocol modifications or selection of alternate outcomes that may enhance favorability of reported findings. We assessed adherence to the International Committee of Medical Journal Editors’ (ICMJE) prospective registration policy and identified the frequency of registrations occurring after potential observation of primary outcome data among trials published in the highest-impact journals associated with US professional medical societies. Additionally, we examined whether trials that are unregistered or registered after potential observation of primary outcome data were more likely to report favorable findings.MethodsWe conducted a retrospective, cross-sectional analysis of the 50 most recently published clinical trials that reported primary results in each of the ten highest-impact US medical specialty society journals between 1 January 2010 and 31 December 2015. We used descriptive statistics to characterize the proportions of trials that were: registered; registered retrospectively; registered retrospectively potentially after initial ascertainment of primary outcomes; and reporting favorable findings, overall and stratified by journal and trial characteristics. Chi-squared analyses were performed to assess differences in registration by journal and trial characteristics.ResultsWe reviewed 6869 original research reports published between 1 January 2010 and 31 December 2015 to identify a total of 486 trials across 472 publications. Of these 486 trials, 47 (10%) were unregistered. Among 439 registered trials, 340 (77%) were registered prospectively and 99 (23%) retrospectively. Sixty-seven (68%) of these 99 retrospectively registered trials, or 15% of all 439 registered trials, were registered after potential observation of primary outcome data ascertained among participants enrolled at inception. Industry-funded trials, those with enrollment sites in the US, as well as those assessing FDA-regulated interventions each had lower rates of retrospective registration. Unregistered trials were more likely to report favorable findings than were registered trials (89% vs. 64%; relative risk (RR) = 1.38, 95% confidence interval (CI) = 1.20–1.58; p = 0.004), irrespective of registration timing.ConclusionsAdherence to the ICMJE’s prospective registration policy remains sub-standard, even in the highest-impact journals associated with US professional medical societies. These journals frequently published unregistered trials and trials registered after potential observation of primary outcome data.

[1]  Sally Hopewell,et al.  Publication bias in clinical trials due to statistical significance or direction of trial results. , 2009, The Cochrane database of systematic reviews.

[2]  E. Loder,et al.  Registration status and outcome reporting of trials published in core headache medicine journals , 2015, Neurology.

[3]  R. Mulder,et al.  Is Mandatory Prospective Trial Registration Working to Prevent Publication of Unregistered Trials and Selective Outcome Reporting? An Observational Study of Five Psychiatry Journals That Mandate Prospective Clinical Trial Registration , 2015, PloS one.

[4]  John P. A. Ioannidis,et al.  Reproducible Research Practices and Transparency across the Biomedical Literature , 2016, PLoS biology.

[5]  D. Korn,et al.  Clinical trial registration, reporting, publication and FDAAA compliance: a cross-sectional analysis and ranking of new drugs approved by the FDA in 2012 , 2015, BMJ Open.

[6]  Vojtech Huser,et al.  Evaluating adherence to the International Committee of Medical Journal Editors' policy of mandatory, timely clinical trial registration. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[7]  Stephanie L Harriman,et al.  When are clinical trials registered? An analysis of prospective versus retrospective registration , 2016, Trials.

[8]  Douglas G Altman,et al.  Comparison of protocols and registry entries to published reports for randomised controlled trials. , 2011, The Cochrane database of systematic reviews.

[9]  J. Mintz,et al.  Brief cognitive-behavioral therapy effects on post-treatment suicide attempts in a military sample: results of a randomized clinical trial with 2-year follow-up. , 2015, The American journal of psychiatry.

[10]  Sally Hopewell,et al.  Association between trial registration and positive study findings: cross sectional study (Epidemiological Study of Randomized Trials—ESORT) , 2017, British Medical Journal.

[11]  D. A. Korevaar,et al.  Endorsement of ICMJE's Clinical Trial Registration Policy: a survey among journal editors. , 2014, The Netherlands journal of medicine.

[12]  David Moher,et al.  Comparison of registered and published primary outcomes in randomized controlled trials. , 2009, JAMA.

[13]  John Hoey,et al.  Clinical trial registration: a statement from the International Committee of Medical Journal Editors. , 2005, The New England journal of medicine.

[14]  K. Murugiah,et al.  Publication and reporting of clinical trial results: cross sectional analysis across academic medical centers , 2016, British Medical Journal.

[15]  Nicholas C. Ide,et al.  Trial Registration at ClinicalTrials.gov between May and October 2005. , 2005, The New England journal of medicine.

[16]  Z. Ourabah,et al.  RESULTS OF A RANDOMIZED CLINICAL TRIAL , 2008 .

[17]  A. Hrõbjartsson,et al.  Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. , 2004, JAMA.

[18]  R. Horton,et al.  Clinical trial registration: a statement from the International Committee of Medical Journal Editors. , 2004, Hypertension.

[19]  J. Ross,et al.  Compliance with prospective trial registration guidance remained low in high-impact journals and has implications for primary end point reporting. , 2016, Journal of clinical epidemiology.

[20]  Kay Dickersin,et al.  Outcome reporting in industry-sponsored trials of gabapentin for off-label use. , 2009, The New England journal of medicine.

[21]  J. Ioannidis,et al.  Call to improve transparency of trials of non-regulated interventions , 2015, BMJ : British Medical Journal.

[22]  R Brian Haynes,et al.  Which journals do primary care physicians and specialists access from an online service? , 2007, Journal of the Medical Library Association : JMLA.

[23]  C. Gill.  How often do US-based human subjects research studies register on time, and how often do they post their results? A statistical analysis of the Clinicaltrials.gov database , 2012, BMJ Open.

[24]  Joanna IntHout,et al.  Differences between information in registries and articles did not influence publication acceptance. , 2015, Journal of clinical epidemiology.

[25]  Tony Tse,et al.  Update on Trial Registration 11 Years after the ICMJE Policy Was Established. , 2017, The New England journal of medicine.

[26]  Christopher W. Jones,et al.  Quality of registration for clinical trials published in emergency medicine journals. , 2012, Annals of emergency medicine.

[27]  Cameron Rhudy,et al.  How Congress May Have Failed Consumers with the Food and Drug Administration Amendments Act of 2007 , 2008 .

[28]  G. Meyer,et al.  Compliance with trial registration in five core journals of clinical geriatrics: a survey of original publications on randomised controlled trials from 2008 to 2012. , 2014, Age and ageing.

[29]  M. Buxton,et al.  The role of the national general medical journal: surveys of which journals UK clinicians read to inform their clinical practice. , 2008, Medicina clinica.

[30]  Peter Williams,et al.  “Hardly worth the effort”? Medical journals’ policies and their editors’ and publishers’ views on trial registration and publication bias: quantitative and qualitative study , 2013, BMJ : British Medical Journal.

[31]  D. Altman,et al.  Association of cardiovascular trial registration with positive study findings: Epidemiological Study of Randomized Trials (ESORT). , 2015, JAMA internal medicine.

[32]  R. Rosenthal,et al.  Selective publication of antidepressant trials and its influence on apparent efficacy. , 2008, The New England journal of medicine.