Completeness of Reporting in Diet- and Nutrition-Related Randomized Controlled Trials and Systematic Reviews With Meta-Analysis: Protocol for 2 Independent Meta-Research Studies

Background Journal articles describing randomized controlled trials (RCTs) and systematic reviews with meta-analysis of RCTs are not optimally reported and often miss crucial details. This poor reporting makes assessing these studies’ risk of bias or reproducing their results difficult. However, the reporting quality of diet- and nutrition-related RCTs and meta-analyses has not been explored. Objective We aimed to assess the reporting completeness and identify the main reporting limitations of diet- and nutrition-related RCTs and meta-analyses of RCTs, estimate the frequency of reproducible research practices among these RCTs, and estimate the frequency of distorted presentation or spin among these meta-analyses. Methods Two independent meta-research studies will be conducted using articles published in PubMed-indexed journals. The first will include a sample of diet- and nutrition-related RCTs; the second will include a sample of systematic reviews with meta-analysis of diet- and nutrition-related RCTs. A validated search strategy will be used to identify RCTs of nutritional interventions and an adapted strategy to identify meta-analyses in PubMed. We will search for RCTs and meta-analyses indexed in 1 calendar year and randomly select 100 RCTs (June 2021 to June 2022) and 100 meta-analyses (July 2021 to July 2022). Two reviewers will independently screen the titles and abstracts of records yielded by the searches, then read the full texts to confirm their eligibility. The general features of these published RCTs and meta-analyses will be extracted into a research electronic data capture database (REDCap; Vanderbilt University). The completeness of reporting of each RCT will be assessed using the items in the CONSORT (Consolidated Standards of Reporting Trials), its extensions, and the TIDieR (Template for Intervention Description and Replication) statements. Information about practices that promote research transparency and reproducibility, such as the publication of protocols and statistical analysis plans will be collected. There will be an assessment of the completeness of reporting of each meta-analysis using the items in the Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) statement and collection of information about spin in the abstracts and full-texts. The results will be presented as descriptive statistics in diagrams or tables. These 2 meta-research studies are registered in the Open Science Framework. Results The literature search for the first meta-research retrieved 20,030 records and 2182 were potentially eligible. The literature search for the second meta-research retrieved 10,918 records and 850 were potentially eligible. Among them, random samples of 100 RCTs and 100 meta-analyses were selected for data extraction. Data extraction is currently in progress, and completion is expected by the beginning of 2023. Conclusions Our meta-research studies will summarize the main limitation on reporting completeness of nutrition- or diet-related RCTs and meta-analyses and provide comprehensive information regarding the particularities in the reporting of intervention studies in the nutrition field. International Registered Report Identifier (IRRID) DERR1-10.2196/43537

[1]  E. Mayo-Wilson,et al.  Toward more rigorous and informative nutritional epidemiology: The rational space between dismissal and defense of the status quo , 2021, Critical reviews in food science and nutrition.

[2]  Kevin W. Boyack,et al.  Assessment of transparency indicators across the biomedical literature: How open is open? , 2020, bioRxiv.

[3]  A. Ferdinand,et al.  High impact nutrition and dietetics journals’ use of publication procedures to increase research transparency , 2020, Research integrity and peer review.

[4]  Tianjing Li,et al.  CONSORT 2010 statement: extension to randomised crossover trials , 2019, BMJ.

[5]  J. Ioannidis,et al.  Reproducible research practices, transparency, and open access data in the biomedical literature, 2015–2017 , 2018, PLoS biology.

[6]  John P A Ioannidis,et al.  The Challenge of Reforming Nutritional Epidemiologic Research. , 2018, JAMA.

[7]  J. Ioannidis,et al.  Perspective: Limiting Dependence on Nonrandomized Studies and Improving Randomized Trials in Human Nutrition Research: Why and How. , 2018, Advances in nutrition.

[8]  L. Williams,et al.  Quality of development and reporting of dietetic intervention studies in primary care: a systematic review of randomised controlled trials , 2018, Journal of human nutrition and dietetics : the official journal of the British Dietetic Association.

[9]  C. Bonner,et al.  ‘It has saved thousands of lives, so why change it?’ Content analysis of objections to cervical screening programme changes in Australia , 2018, BMJ Open.

[10]  David Moher,et al.  Evaluations of the uptake and impact of the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) Statement and extensions: a scoping review , 2017, Systematic Reviews.

[11]  W. Willett,et al.  The Misuse of Meta-analysis in Nutrition Research. , 2017, JAMA.

[12]  C. la Vecchia,et al.  Evidence-based practice within nutrition: what are the barriers for improving the evidence and how can they be dealt with? , 2017, Trials.

[13]  Quinn Grundy,et al.  ‘Spin’ in published biomedical literature: A methodological systematic review , 2017, PLoS biology.

[14]  Zhen Wang,et al.  Guidelines for reporting meta-epidemiological methodology research , 2017, Evidence-Based Medicine.

[15]  David Moher,et al.  CONSORT Statement for Randomized Trials of Nonpharmacologic Treatments: A 2017 Update and a CONSORT Extension for Nonpharmacologic Trial Abstracts. , 2017, Annals of internal medicine.

[16]  Solange Durão,et al.  Scope and quality of Cochrane reviews of nutrition interventions: a cross-sectional study , 2017, Nutrition Journal.

[17]  David Moher,et al.  A new classification of spin in systematic reviews and meta-analyses was developed and ranked according to the severity. , 2016, Journal of clinical epidemiology.

[18]  J. Ioannidis We need more randomized trials in nutrition-preferably large, long-term, and with negative results. , 2016, The American journal of clinical nutrition.

[19]  Solange Durão,et al.  Validation of a search strategy to identify nutrition trials in PubMed using the relative recall method. , 2015, Journal of clinical epidemiology.

[20]  J. Wyatt,et al.  Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide , 2014, BMJ : British Medical Journal.

[21]  David Moher,et al.  Reducing waste from incomplete or unusable reports of biomedical research , 2014, The Lancet.

[22]  David Moher,et al.  Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. , 2012, The Cochrane database of systematic reviews.

[23]  I. Romieu,et al.  Assessment of dietary patterns in nutritional epidemiology: principal component analysis compared with confirmatory factor analysis. , 2012, The American journal of clinical nutrition.

[24]  K. Northstone,et al.  Dietary patterns obtained through principal components analysis: the effect of input variable quantification , 2012, British Journal of Nutrition.

[25]  D. Allison,et al.  Is funding source related to study reporting quality in obesity or nutrition randomized control trials in top-tier medical journals? , 2012, International Journal of Obesity.

[26]  G. Piaggio,et al.  Consort 2010 statement: extension to cluster randomised trials , 2012, BMJ : British Medical Journal.

[27]  J. Parrott,et al.  Funding Source and Research Report Quality in Nutrition Practice-Related Research , 2011, PloS one.

[28]  Douglas G Altman,et al.  Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. , 2010, JAMA.

[29]  D. Moher,et al.  A catalogue of reporting guidelines for health research , 2010, European journal of clinical investigation.

[30]  Lisa Bero,et al.  Randomized trials assessing calcium supplementation in healthy children: relationship between industry sponsorship and study outcomes , 2009, Public Health Nutrition.

[31]  L. Lesser Reducing potential bias in industry-funded nutrition research. , 2009, American Journal of Clinical Nutrition.

[32]  P. Glasziou,et al.  Avoidable waste in the production and reporting of research evidence , 2009, The Lancet.

[33]  Ethan M Balk,et al.  Reporting of Systematic Reviews of Micronutrients and Health: A Critical Appraisal , 2009, The American journal of clinical nutrition.

[34]  D. Allison,et al.  Industry funding and the reporting quality of large long-term weight loss trials , 2008, International Journal of Obesity.

[35]  D. Moher,et al.  CONSORT for reporting randomised trials in journal and conference abstracts , 2008, The Lancet.

[36]  M. Katan Does Industry Sponsorship Undermine the Integrity of Nutrition Research? , 2007, PLoS medicine.

[37]  L. Fernández-Celemín,et al.  What should be the role of the media in nutrition communication? , 2006, British Journal of Nutrition.

[38]  J. Ioannidis,et al.  Better Reporting of Harms in Randomized Trials: An Extension of the CONSORT Statement , 2004, Annals of Internal Medicine.

[39]  A. Walker,et al.  Improving the quality of reporting in randomised controlled trials. , 2004, Journal of wound care.

[40]  W C Willett,et al.  Adjustment for total energy intake in epidemiologic studies. , 1997, The American journal of clinical nutrition.