Publication bias in editorial decision making.

CONTEXT Studies with positive results are more likely to be published than studies with negative results (publication bias). One reason this occurs is that authors are less likely to submit manuscripts reporting negative results to journals. There is no evidence that publication bias occurs once manuscripts have been submitted to a medical journal. We assessed whether submitted manuscripts that report results of controlled trials are more likely to be published if they report positive results. METHODS Prospective cohort study of manuscripts submitted to JAMA from February 1996 through August 1999. We classified results as positive if there was a statistically significant difference (P<.05) reported for the primary outcome. Study characteristics and indicators for quality were also appraised. We included manuscripts that reported prospective studies in which participants were assigned to an intervention or comparison group and statistical tests compared differences between groups. RESULTS Among 745 manuscripts, 133 (17.9%) were published: 78 (20.4%) of 383 with positive results, 51 (15.0%) of 341 with negative results, and 4 (19.0%) of 21 with unclear results. The crude relative risk for publication of studies with positive results compared with negative results was 1.36 (95% confidence interval [CI], 0.99-1.88). After being adjusted simultaneously for study characteristics and quality indicators, the odds ratio for publishing studies with positive results was 1.30 (95% CI, 0.87-1.96). CONCLUSIONS Among submitted manuscripts, we did not find a statistically significant difference in publication rates between those with positive vs negative results.

[1]  K. Dickersin,et al.  Publication bias and clinical trials. , 1987, Controlled clinical trials.

[2]  Cheryl Iverson,et al.  American Medical Association manual of style , 1989 .

[3]  I. Chalmers,et al.  A cohort study of summary reports of controlled trials. , 1990, JAMA.

[4]  A. Agresti An introduction to categorical data analysis , 1997 .

[5]  Construction, consent, and condemnation in research on peer review. , 1991, Journal of clinical epidemiology.

[6]  P. Easterbrook,et al.  Publication bias in clinical research , 1991, The Lancet.

[7]  I. Tannock,et al.  The fate of abstracts submitted to a cancer meeting: factors which influence presentation and subsequent publication. , 1992, Annals of oncology : official journal of the European Society for Medical Oncology.

[8]  D. Henry,et al.  10. Meta‐analysis: Part 2: assessing the quality of published meta‐analyses , 1992, The Medical journal of Australia.

[9]  K. Dickersin,et al.  NIH clinical trials and publication bias. , 1993, The Online journal of current clinical trials.

[10]  K. Dickersin,et al.  Publication Bias: The Problem That Won't Go Away , 1993, Annals of the New York Academy of Sciences.

[11]  D. Moher,et al.  Statistical power, sample size, and their reporting in randomized controlled trials. , 1994, JAMA.

[12]  J. R. Gilbert,et al.  Is there gender bias in JAMA's peer review process? , 1994, JAMA.

[13]  K. Dickersin,et al.  Full publication of results initially presented in abstracts. A meta-analysis. , 1994 .

[14]  Richard Smith,et al.  An amnesty for unpublished trials , 1997, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[15]  R. Simes,et al.  Publication bias: evidence of delayed publication in a cohort study of clinical research projects , 1997, BMJ.

[16]  H S Sacks,et al.  The relationship between study design, results, and reporting of randomized clinical trials of HIV infection. , 1997, Controlled clinical trials.

[17]  L. Bero,et al.  Publication bias and research on passive smoking: comparison of published and unpublished studies. , 1998, JAMA.

[18]  R. Wears,et al.  Positive-outcome bias and other limitations in the outcome of research abstracts submitted to a scientific meeting. , 1998, JAMA.

[19]  A. Link US and non-US submissions: an analysis of reviewer bias. , 1998, JAMA.

[20]  M. Petticrew,et al.  Lost information? The fate of papers presented at the 40th society for Social Medicine Conference. , 1999, Journal of epidemiology and community health.

[21]  F. Song,et al.  The role of electronic journals in reducing publication bias. , 1999, Medical informatics and the Internet in medicine.

[22]  S. Thacker,et al.  Characteristics of meta-analyses related to acceptance for publication in a medical journal. , 2001, Journal of clinical epidemiology.