Open science practices in clinical psychology journals: An audit study.

We conducted an audit of 60 clinical psychology journals, covering the first 2 quartiles by impact factor on Web of Science. We evaluated editorial policies in 5 domains crucial to reproducibility and transparency (prospective registration, data sharing, preprints, endorsement of reporting guidelines and conflict of interest [COI] disclosure). We examined implementation in a randomly selected cross-sectional sample of 201 articles published in 2017 in the "best practice" journals, defined as having explicit supportive policies in 4 out of 5 domains. Our findings showed that 15 journals cited prospective registration, 40 data sharing, 15 explicitly permitted preprints, 28 endorsed reporting guidelines, and 52 had mandatory policies for COI disclosure. Except for COI disclosure, few policies were mandatory: registration in 15 journals, data sharing in 1, and reporting guidelines for randomized trials in 18 and for meta-analyses in 15. Seventeen journals were identified as "best practice." An analysis of recent articles showed extremely low compliance for prospective registration (3% articles) and data sharing (2%). One preprint could be identified. Reporting guidelines were endorsed in 19% of the articles, though for most articles this domain was rated as nonapplicable. Only half of the articles included a COI disclosure. Desired open science policies should become clear and mandatory, and their enforcement streamlined by reducing the multiplicity of guidelines and templates. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

[1]  Jessica D. Ritchie,et al.  Ethical Obligations Regarding Short-Term Global Health Clinical Experiences , 2018, Annals of Internal Medicine.

[2]  J. Ioannidis,et al.  Improving Disclosure of Financial Conflicts of Interest for Research on Psychosocial Interventions , 2018, JAMA psychiatry.

[3]  Richard Horton,et al.  Preprints with The Lancet: joining online research discussion platforms , 2018, The Lancet.

[4]  Victoria Stodden,et al.  An empirical analysis of journal policy effectiveness for computational reproducibility , 2018, Proceedings of the National Academy of Sciences.

[5]  A. Seidler,et al.  Prospective registration trends, reasons for retrospective registration and mechanisms to increase prospective registration compliance: descriptive analysis and survey , 2018, BMJ Open.

[6]  David Moher,et al.  Data sharing and reanalysis of randomized controlled trials in leading biomedical journals with a full data sharing policy: survey of studies published in The BMJ and PLOS Medicine , 2018, British Medical Journal.

[7]  D. Moher,et al.  Interventions to improve adherence to reporting guidelines in health research: a scoping review protocol , 2017, BMJ Open.

[8]  Christopher J Patrick,et al.  It’s Time to Broaden the Replicability Conversation: Thoughts for and From Clinical Psychological Science , 2017, Perspectives on psychological science : a journal of the Association for Psychological Science.

[9]  L. Bero Addressing Bias and Conflict of Interest Among Biomedical Researchers. , 2017, JAMA.

[10]  Michael A. Keller,et al.  Biomedical Journals and Preprint Services: Friends or Foes? , 2017, Clinical chemistry.

[11]  A. Karch,et al.  Measuring inter-rater reliability for nominal data – which coefficients and confidence intervals are appropriate? , 2016, BMC Medical Research Methodology.

[12]  Evan Mayo-Wilson,et al.  Improving transparency and reproducibility through registration: The status of intervention trials published in clinical psychology journals. , 2016, Journal of consulting and clinical psychology.

[13]  C. Barbui Sharing all types of clinical data and harmonizing journal standards , 2016, BMC Medicine.

[14]  H. Bauchner,et al.  Sharing Clinical Trial Data: A Proposal from the International Committee of Medical Journal Editors , 2016, PLoS medicine.

[15]  Brian A. Nosek,et al.  Promoting an open research culture , 2015, Science.

[16]  V. Stodden,et al.  Toward Reproducible Computational Research: An Empirical Analysis of Data and Code Policy Adoption by Journals , 2013, PloS one.

[17]  E. Mayo-Wilson,et al.  Reporting Quality of Social and Psychological Intervention Trials: A Systematic Review of Reporting Guidelines and Trial Publications , 2013, PloS one.