Assessment of adherence to the CONSORT statement for quality of reports on randomized controlled trial abstracts from four high-impact general medical journals

BackgroundThe extended Consolidated Standards of Reporting Trials (CONSORT) Statement for Abstracts was developed to improve the quality of reports of randomized controlled trials (RCTs) because readers often base their assessment of a trial solely on the abstract. To date, few data exist regarding whether it has achieved this goal. We evaluated the extent of adherence to the CONSORT for Abstract statement for quality of reports on RCT abstracts by four high-impact general medical journals.MethodsA descriptive analysis of published RCT abstracts in The New England Journal of Medicine (NEJM), The Lancet, The Journal of American Medical Association (JAMA), and the British Medical Journal (BMJ) in the year 2010 was conducted by two reviewers, independently extracting data from a MEDLINE/PubMed search.ResultsWe identified 271 potential RCT abstracts meeting our inclusion criteria. More than half of the abstracts identified the study as randomized in the title (58.7%; 159/271), reported the specific objective/hypothesis (72.7%; 197/271), described participant eligibility criteria with settings for data collection (60.9%; 165/271), detailed the interventions for both groups (90.8%; 246/271), and clearly defined the primary outcome (94.8%; 257/271). However, the methodological quality domains were inadequately reported: allocation concealment (11.8%; 32/271) and details of blinding (21.0%; 57/271). Reporting the primary outcome results for each group was done in 84.1% (228/271). Almost all of the abstracts reported trial registration (99.3%; 269/271), whereas reports of funding and of harm or side effects from the interventions were found in only 47.6% (129/271) and 42.8% (116/271) of the abstracts, respectively.ConclusionsThese findings show inconsistencies and non-adherence to the CONSORT for abstract guidelines, especially in the methodological quality domains. Improvements in the quality of RCT reports can be expected by adhering to existing standards and guidelines as expressed by the CONSORT group.

[1]  R. Horton,et al.  WHO facilitates international collaboration in setting standards for clinical trial registration , 2005, The Lancet.

[2]  D. Moher,et al.  CONSORT for Reporting Randomized Controlled Trials in Journal and Conference Abstracts: Explanation and Elaboration , 2008, PLoS medicine.

[3]  A. Walker,et al.  Improving the quality of reporting in randomised controlled trials. , 2004, Journal of wound care.

[4]  B. Djulbegovic,et al.  Pharmaceutical industry sponsorship and research outcome and quality: systematic review , 2003, BMJ : British Medical Journal.

[5]  Robert L Kane,et al.  Reporting in randomized clinical trials improved after adoption of the CONSORT statement. , 2007, Journal of clinical epidemiology.

[6]  D. Moher,et al.  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2010, BMJ : British Medical Journal.

[7]  N. Freemantle,et al.  An assessment of the quality of randomised controlled trials conducted in China , 2008, Trials.

[8]  D. Cook,et al.  The quality of reporting of trial abstracts is suboptimal: survey of major general medical journals. , 2009, Journal of clinical epidemiology.

[9]  David Moher,et al.  The STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration , 2003, Annals of Internal Medicine [serial online].

[10]  John Hoey,et al.  Is this clinical trial fully registered? A statement from the International Committee of Medical Journal Editors , 2005, Canadian Medical Association Journal.

[11]  G. Meyer,et al.  Reporting quality of conference abstracts on randomised controlled trials in gerontology and geriatrics: a cross-sectional investigation. , 2011, Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen.

[12]  Robert W. Matthews,et al.  Uniform requirements for manuscripts submitted to biomedical journals: Writing and editing for biomedical publication , 2010, Journal of pharmacology & pharmacotherapeutics.

[13]  R. Urquhart,et al.  Are leading medical journals following their own policies on CONSORT reporting? , 2008, Contemporary Clinical Trials.

[14]  Joel Gagnier,et al.  The quality of randomized trial reporting in leading medical journals since the revised CONSORT statement. , 2005, Contemporary clinical trials.

[15]  T R Einarson,et al.  Quality of nonstructured and structured abstracts of original research articles in the British Medical Journal, the Canadian Medical Association Journal and the Journal of the American Medical Association. , 1994, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[16]  John Hoey,et al.  Is this clinical trial fully registered? A statement from the International Committee of Medical Journal Editors , 2005, The Lancet.

[17]  Jing Li,et al.  Chinese authors do need CONSORT: reporting quality assessment for five leading Chinese medical journals. , 2008, Contemporary clinical trials.

[18]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. , 2001, Journal of the American Podiatric Medical Association.

[19]  I. Olkin,et al.  Improving the quality of reporting of randomized controlled trials. The CONSORT statement. , 1996, JAMA.

[20]  D. Polit,et al.  Intention-to-treat in randomized controlled trials: recommendations for a total trial strategy. , 2010, Research in nursing & health.

[21]  Carlos Alberto Guimarães,et al.  Uniform requirements for manuscripts submitted to biomedical journals: Writing and editing for biomedical publication , 2008, Revista espanola de cardiologia.

[22]  Shigeaki Yamazaki,et al.  Adoption of structured abstracts by general medical journals and format for a structured abstract. , 2005, Journal of the Medical Library Association : JMLA.

[23]  T. Wachs,et al.  CONSORT for reporting randomised trials in journal and conference abstracts , 2008 .

[24]  D. Altman,et al.  CONSORT statement: extension to cluster randomised trials , 2004, BMJ : British Medical Journal.

[25]  N. Black.  CONSORT , 1996, The Lancet.

[26]  Patrice Morel,et al.  Quality of abstracts in 3 clinical dermatology journals. , 2003, Archives of dermatology.

[27]  D. Moher,et al.  Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. , 2001, JAMA.

[28]  D. Moher,et al.  Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review , 2006, The Medical journal of Australia.

[29]  R. Bender,et al.  Calculation of NNTs in RCTs with time-to-event outcomes: A literature review , 2009, BMC medical research methodology.

[30]  M. Clarke,et al.  Reporting of trials presented in conference abstracts needs to be improved. , 2006, Journal of clinical epidemiology.

[31]  N. Villate,et al.  The quality of reporting of randomized clinical trials published in Ophthalmology. , 2001, Ophthalmology.

[32]  A. Viera,et al.  Understanding interobserver agreement: the kappa statistic. , 2005, Family medicine.

[33]  D. Moher,et al.  CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials , 2010, Journal of clinical epidemiology.

[34]  D. Moher,et al.  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2010, BMJ : British Medical Journal.

[35]  S. Hopewell,et al.  Open Access METHODOLOGY , 2010 .

[36]  Sally Hopewell,et al.  Better reporting of randomized trials in biomedical journal and conference abstracts , 2008, J. Inf. Sci..

[37]  J. Concato,et al.  Randomized, controlled trials, observational studies, and the hierarchy of research designs. , 2000, The New England journal of medicine.

[38]  Kenneth F. Schulz,et al.  The CONSORT Statement , 1996 .

[39]  Ermenegyldo Munhoz Junior.  Requisitos uniformes para manuscritos submetidos a periódicos biomédicos: escrevendo e editando para publicações biomédicas , 2006 .

[40]  D. Moher,et al.  CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials , 2010, BMC medicine.