Impact of an online writing aid tool for writing a randomized trial report: the COBWEB (Consort-based WEB tool) randomized controlled trial

BackgroundIncomplete reporting is a frequent waste in research. Our aim was to evaluate the impact of a writing aid tool (WAT) based on the CONSORT statement and its extension for non-pharmacologic treatments on the completeness of reporting of randomized controlled trials (RCTs).MethodsWe performed a ‘split-manuscript’ RCT with blinded outcome assessment. Participants were masters and doctoral students in public health. They were asked to write, over a 4-hour period, the methods section of a manuscript based on a real RCT protocol, with a different protocol provided to each participant. Methods sections were divided into six different domains: ‘trial design’, ‘randomization’, ‘blinding’, ‘participants’, ‘interventions’, and ‘outcomes’. Participants had to draft all six domains with access to the WAT for a random three of six domains. The random sequence was computer-generated and concealed. For each domain, the WAT comprised reminders of the corresponding CONSORT item(s), bullet points detailing all the key elements to be reported, and examples of good reporting. The control intervention consisted of no reminders. The primary outcome was the mean global score for completeness of reporting (scale 0–10) for all domains written with or without the WAT.ResultsForty-one participants wrote 41 different manuscripts of RCT methods sections, corresponding to 246 domains (six for each of the 41 protocols). All domains were analyzed. For the primary outcome, the mean (SD) global score for completeness of reporting was higher with than without use of the WAT: 7.1 (1.2) versus 5.0 (1.6), with a mean (95 % CI) difference 2.1 (1.5–2.7; P <0.01). Completeness of reporting was significantly higher with the WAT for all domains except for blinding and outcomes.ConclusionUse of the WAT could improve the completeness of manuscripts reporting the results of RCTs.Trial registrationClinicaltrials.gov (http://clinicaltrials.govNCT02127567, registration date first received April 29, 2014)

[1]  D. Moher,et al.  Does journal endorsement of reporting guidelines influence the completeness of reporting of health research? A systematic review protocol , 2012, Systematic Reviews.

[2]  P. Glasziou,et al.  Avoidable waste in the production and reporting of research evidence , 2009, The Lancet.

[3]  Carl Heneghan,et al.  What is missing from descriptions of treatment in trials and reviews? , 2008, BMJ : British Medical Journal.

[4]  S. Yurdakul,et al.  Brief Report: Inadequate Description and Discussion of Enrolled Patient Characteristics and Potential Inter–Study Site Differences in Reports of Randomized Controlled Trials: A Systematic Survey in Six Rheumatology Journals , 2014, Arthritis & rheumatology.

[5]  M. Grocott,et al.  Quality of reporting in randomized trials published in high-quality surgical journals. , 2009, Journal of the American College of Surgeons.

[6]  S. Pocock,et al.  Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement. , 2006, JAMA.

[7]  Gary S Collins,et al.  Impact of peer review on reports of randomised trials published in open peer review journals: retrospective before and after study , 2014, BMJ : British Medical Journal.

[8]  D. Moher,et al.  Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal 'Instructions to Authors' , 2008, Trials.

[9]  D. Altman,et al.  Are Peer Reviewers Encouraged to Use Reporting Guidelines? A Survey of 116 Health Research Journals , 2012, PloS one.

[10]  David Moher,et al.  Improving the reporting of randomised trials: the CONSORT Statement and beyond , 2012, Statistics in medicine.

[11]  A. Jadad,et al.  Are Reports of Randomized Controlled Trials Improving over Time? A Systematic Review of 284 Articles Published in High-Impact General and Specialized Medical Journals , 2013, PloS one.

[12]  Sally Hopewell,et al.  The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed , 2010, BMJ : British Medical Journal.

[13]  A. Sheikh,et al.  The quality of reporting of randomised controlled trials in asthma: a systematic review , 2013, Primary care respiratory journal : journal of the General Practice Airways Group.

[14]  D. Moher,et al.  Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. , 2008, Annals of internal medicine.

[15]  T. Hoffmann,et al.  Poor description of non-pharmacological interventions: analysis of consecutive sample of randomised trials , 2013, BMJ : British Medical Journal.

[16]  D. Moher,et al.  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2010, BMJ : British Medical Journal.

[17]  D. Moher,et al.  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2010, BMJ : British Medical Journal.

[18]  I. Boutron,et al.  Improving the reporting of clinical research , 2009, The British journal of surgery.

[19]  Meinhard Kieser,et al.  Quality of reporting of clinical non-inferiority and equivalence randomised trials - update and extension , 2012, Trials.

[20]  Eunyoung Kim,et al.  Assessment of adherence to the CONSORT statement for quality of reports on randomized controlled trial abstracts from four high-impact general medical journals , 2012, Trials.

[21]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[22]  Tim Croudace,et al.  Analysis of cluster randomized cross‐over trial data: a comparison of methods , 2007, Statistics in medicine.

[23]  A Donner,et al.  Sample size calculation for cluster randomized cross‐over trials , 2008, Statistics in medicine.

[24]  Joy Adamson,et al.  Poor reporting quality of key Randomization and Allocation Concealment details is still prevalent among published RCTs in 2011: a review. , 2013, Journal of evaluation in clinical practice.

[25]  J. Ioannidis,et al.  Better Reporting of Harms in Randomized Trials: An Extension of the CONSORT Statement , 2004, Annals of Internal Medicine.

[26]  David Moher,et al.  Reducing waste from incomplete or unusable reports of biomedical research , 2014, The Lancet.

[27]  David J Torgerson,et al.  Adequacy and reporting of allocation concealment: review of recent trials published in four general medical journals , 2005, BMJ : British Medical Journal.

[28]  G. Piaggio,et al.  Consort 2010 statement: extension to cluster randomised trials , 2012, BMJ : British Medical Journal.

[29]  David Moher,et al.  Does use of the CONSORT Statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane reviewa , 2012, Systematic Reviews.

[30]  D. Altman,et al.  Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial , 2011, BMJ : British Medical Journal.

[31]  Sally Hopewell,et al.  Effect of editors’ implementation of CONSORT guidelines on the reporting of abstracts in high impact medical journals: interrupted time series analysis , 2012, BMJ : British Medical Journal.