Protocol for a systematic review on the extent of non-publication of research studies and associated study characteristics

AbstractBackgroundMethodological research has found that non-published studies often have different results than those that are published, a phenomenon known as publication bias. When results are not published, or are published selectively based on the direction or the strength of the findings, healthcare professionals and consumers of healthcare cannot base their decision-making on the full body of current evidence.MethodsAs part of the OPEN project (http://www.open-project.eu) we will conduct a systematic review with the following objectives:1.To determine the proportion and/or rate of non-publication of studies by systematically reviewing methodological research projects that followed up a cohort of studies thata.received research ethics committee (REC) approval,b.were registered in trial registries, orc.were presented as abstracts at conferences.2.To assess the association of study characteristics (for example, direction and/or strength of findings) with likelihood of full publication. To identify reports of relevant methodological research projects we will conduct electronic database searches, check reference lists, and contact experts. Published and unpublished projects will be included. The inclusion criteria are as follows:a.RECs: methodological research projects that examined the subsequent proportion and/or rate of publication of studies that received approval from RECs;b.Trial registries: methodological research projects that examine the subsequent proportion and/or rate of publication of studies registered in trial registries;c.Conference abstracts: methodological research projects that examine the subsequent proportion and/or rate of full publication of studies which were initially presented at conferences as abstracts. Primary outcomes: Proportion/rate of published studies; time to full publication (mean/median; cumulative publication rate by time).Secondary outcomes: Association of study characteristics with full publication.The different questions (a, b, and c) will be investigated separately. Data synthesis will involve a combination of descriptive and statistical summaries of the included methodological research projects.DiscussionResults are expected to be publicly available in mid 2013.

[1]  K. Dickersin,et al.  Publication Bias: The Problem That Won't Go Away , 1993, Annals of the New York Academy of Sciences.

[2]  J. Ioannidis.  Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. , 1998, JAMA.

[3]  Harlan M. Krumholz,et al.  Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis , 2009, PLoS medicine.

[4]  M Stevenson,et al.  School-linked sexual health services for young people (SSHYP): a survey and systematic review concerning current models, effectiveness, cost-effectiveness and research opportunities. , 2010, Health technology assessment.

[5]  J. Harrison,et al.  Delay and failure to publish dental research , 2005, Evidence-Based Dentistry.

[6]  M. Bhandari,et al.  Comparison of published orthopaedic trauma trials following registration in Clinicaltrials.gov , 2011, BMC musculoskeletal disorders.

[7]  J. Ioannidis,et al.  Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias , 2008, PloS one.

[8]  M Egger,et al.  Grey literature in meta-analyses of randomized trials of health care interventions. , 2007, The Cochrane database of systematic reviews.

[9]  Ian Harvey,et al.  Extent of publication bias in different categories of research cohorts: a meta-analysis of empirical studies , 2009, BMC medical research methodology.

[10]  R. Rosenthal.  The file drawer problem and tolerance for null results , 1979 .

[11]  K. Dickersin,et al.  Full publication of results initially presented in abstracts. A meta-analysis. , 1994 .

[12]  K. Dickersin,et al.  Publication bias and clinical trials. , 1987, Controlled clinical trials.

[13]  E. von Elm,et al.  Full publication of results initially presented in abstracts. , 2007, The Cochrane database of systematic reviews.

[14]  F. Song,et al.  Dissemination and publication of research findings: an updated review of related biases. , 2010, Health technology assessment.

[15]  J. Ioannidis,et al.  Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials , 2011, BMJ : British Medical Journal.

[16]  Sally Hopewell,et al.  Publication bias in clinical trials due to statistical significance or direction of trial results. , 2009, The Cochrane database of systematic reviews.