Evidence of publication bias in reporting acute stroke clinical trials

Objective: To ascertain the extent of publication bias in the reporting of acute stroke clinical trials. Methods: We identified controlled acute ischemic stroke clinical trials reported in English over a 45-year period from 1955 to 1999 through systematic search of MEDLINE, the Cochrane Controlled Stroke Trials Register, and additional databases. We analyzed trial methodology, quality, outcome, study sponsorship, and timing of publication to identify various forms of publication bias, including nonpublication bias, abbreviated publication bias, and time-lag bias. Results: One hundred seventy-eight acute ischemic stroke trials, enrolling 73,949 subjects, evaluated 75 agents or nonpharmacologic interventions. A greater proportion of harmful outcomes in unpublished studies (n = 4) compared with published trials (0.75 vs 0.06, p < 0.0001) and underreporting of smaller, nonbeneficial studies in acute stroke suggest nonpublication bias. Although a definite time-lag bias was not evident, nonbeneficial studies were slower to proceed from enrollment completion to publication (2.3 vs 2.0 years, p = 0.207), with an even longer delay for nonbeneficial corporate pharmaceutical sponsored trials (2.8 vs 2.1 years, p = 0.086), despite superior trial report quality scores for corporate-sponsored studies when compared with nonprofit/governmental studies (mean 69.2 ± 95% CI 3.9 vs 53.4 ± 95% CI 9.2, p < 0.005). Conclusion: Publication bias is evident in the acute stroke research literature, supporting the need for prospective trial registration.

[1]  M. Budoff,et al.  National Institute of Neurological Disorders and Stroke , 2008 .

[2]  Peter C Gøtzsche,et al.  Registries and registration of clinical trials. , 2005, The New England journal of medicine.

[3]  J. Drazen,et al.  Trial registration report card. , 2005, The New England journal of medicine.

[4]  Nicholas C. Ide,et al.  Trial Registration at ClinicalTrials.gov between May and October 2005. , 2005, The New England journal of medicine.

[5]  A. Hanks Canada , 2002 .

[6]  Peter Jüni,et al.  Direction and impact of language bias in meta-analyses of controlled trials: empirical study. , 2002, International journal of epidemiology.

[7]  J. Sterne,et al.  Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. , 2001, Journal of clinical epidemiology.

[8]  R Platt,et al.  Is There a “Best” Way to Detect and Minimize Publication Bias? , 2001, Evaluation & the health professions.

[9]  D. Liebeskind,et al.  Trends in Acute Ischemic Stroke Trials Through the 20th Century , 2001, Stroke.

[10]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. , 2001, Journal of the American Podiatric Medical Association.

[11]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials , 2001, The Lancet.

[12]  S Duval,et al.  Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis , 2000, Biometrics.

[13]  P. Lee,et al.  Publication bias in meta-analysis: its causes and consequences. , 2000, Journal of clinical epidemiology.

[14]  R. Higashida,et al.  Intra-arterial Prourokinase for Acute Ischemic Stroke: The PROACT II Study: A Randomized Controlled Trial , 1999 .

[15]  D. Rennie Fair conduct and fair reporting of clinical trials. , 1999, JAMA.

[16]  P Sandercock,et al.  Reports of randomized trials in acute stroke, 1955 to 1995. What proportions were commercially sponsored? , 1999, Stroke.

[17]  F. Song,et al.  The role of electronic journals in reducing publication bias. , 1999, Medical informatics and the Internet in medicine.

[18]  L. Goldstein,et al.  Clinical stroke trials: guarding against bias. , 1999, Stroke.

[19]  P. Bath,et al.  Quality of full and final publications reporting acute stroke trials: a systematic review. , 1998, Stroke.

[20]  L. Bero,et al.  Publication bias and research on passive smoking: comparison of published and unpublished studies. , 1998, JAMA.

[21]  R. Wears,et al.  Unpublished research from a medical specialty meeting: why investigators fail to publish. , 1998, JAMA.

[22]  L. Bero,et al.  Why review articles on the health effects of passive smoking reach different conclusions. , 1998, JAMA.

[23]  M. Callaham,et al.  Medical Editors Trial Amnesty. , 1998, Annals of emergency medicine.

[24]  J. Ioannidis Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. , 1998, JAMA.

[25]  R. Simes,et al.  Publication bias: evidence of delayed publication in a cohort study of clinical research projects , 1997, BMJ.

[26]  I. Roberts Pharmaceutical industry is invited to respond to amnesty for unreported trials , 1997, BMJ.

[27]  Zheng-Ming Chen,et al.  CAST: randomised placebo-controlled trial of early aspirin use in 20 000 patients with acute ischaemic stroke , 1997, The Lancet.

[28]  Peter Sandercock,et al.  The International Stroke Trial (IST): a randomised trial of aspirin, subcutaneous heparin, both, or neither among 19 435 patients with acute ischaemic stroke , 1997, The Lancet.

[29]  P. Sandercock,et al.  Informed consent in medical research. Failure to publish completed randomised controlled trials is unethical in itself. , 1997, BMJ.

[30]  Hulbert Mf Informed consent in medical research. Studies with important conclusions but without patient consent should be published. , 1997 .

[31]  P. Dorman,et al.  Considerations in the design of clinical trials of neuroprotective therapy in acute stroke. , 1996, Stroke.

[32]  Koroshetz Wj,et al.  Tissue plasminogen activator for acute ischemic stroke. , 1996, The New England journal of medicine.

[33]  A. Ahuja,et al.  Low-molecular-weight heparin for the treatment of acute ischemic stroke , 1995 .

[34]  Joseph P. Broderick,et al.  Tissue plasminogen activator for acute ischemic stroke. The National Institute of Neurological Disorders and Stroke rt-PA Stroke Study Group. , 1995 .

[35]  Kay Dickersin,et al.  Keeping posted Why register clinical trials?-Revisited , 1992 .

[36]  C D Naylor,et al.  Incorporating variations in the quality of individual randomized trials into meta-analysis. , 1992, Journal of clinical epidemiology.

[37]  P. Easterbrook,et al.  Publication bias in clinical research , 1991, The Lancet.

[38]  I. Chalmers,et al.  A cohort study of summary reports of controlled trials. , 1990, JAMA.

[39]  I Chalmers,et al.  Underreporting research is scientific misconduct. , 1990, JAMA.

[40]  K. Dickersin,et al.  Publication bias and clinical trials. , 1987, Controlled clinical trials.

[41]  R. Simes Publication bias: the case for an international registry of clinical trials. , 1986, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[42]  I. Leviton,et al.  Registering clinical trials. , 2003, Journal of the American Medical Association (JAMA).

[43]  G Eysenbach,et al.  Evaluation of the usefulness of Internet searches to identify unpublished clinical trials for systematic reviews. , 2001, Medical informatics and the Internet in medicine.

[44]  A J Sutton,et al.  Publication and related biases. , 2000, Health technology assessment.

[45]  K R Abrams,et al.  Modelling publication bias in meta-analysis: a review. , 2000, Statistical methods in medical research.

[46]  Milicic Biljana,et al.  Bias in meta-analysis and funnel plot asymmetry , 1999, MIE.

[47]  K. Dickersin,et al.  Why register clinical trials?--Revisited. , 1992, Controlled clinical trials.