GRADE approach to drawing conclusions from a network meta-analysis using a minimally contextualised framework

This article describes GRADE (grading of recommendations assessment, development and evaluation) guidance on how to draw conclusions from a network meta-analysis of interventions that includes individual randomised controlled trials addressing a single outcome. The guidance uses a minimally contextualised approach that avoids value judgments regarding the magnitude of intervention effects. The framework is based on two principles: interventions should be grouped in categories, from the most to the least effective or harmful; and the judgments that place interventions in such categories should simultaneously consider the estimates of effect, the certainty of the evidence, and the rankings. The framework includes five steps, which we describe and illustrate using an example. The framework is simple, methodologically sound, and flexible, allowing for modifications to resolve situations in which additional complexity or value judgments might be appropriate.

[1]  G. Raghu,et al.  Treatment of idiopathic pulmonary fibrosis: a network meta-analysis , 2016, BMC Medicine.

[2]  Gordon H Guyatt,et al.  GRADE approach to rate the certainty from a network meta-analysis: addressing incoherence. , 2019, Journal of clinical epidemiology.

[3]  G. Guyatt,et al.  Completing ‘Summary of findings’ tables and grading the certainty of the evidence , 2019, Cochrane Handbook for Systematic Reviews of Interventions.

[4]  Alonso Carrasco-Labra,et al.  GRADE Evidence to Decision (EtD) frameworks for adoption, adaptation, and de novo development of trustworthy recommendations: GRADE-ADOLOPMENT. , 2017, Journal of clinical epidemiology.

[5]  G. Guyatt,et al.  Comparative effectiveness and safety of interventions for acute diarrhea and gastroenteritis in children: A systematic review and network meta-analysis , 2018, PloS one.

[6]  G. Guyatt,et al.  Efficacy and safety of stress ulcer prophylaxis in critically ill patients: a network meta-analysis of randomized trials , 2017, Intensive Care Medicine.

[7]  G. Guyatt,et al.  Individual opioids, and long- versus short-acting opioids, for chronic noncancer pain , 2019, Medicine.

[8]  Philippe Ravaud,et al.  Uncertainty in Treatment Rankings: Reanalysis of Network Meta-analyses of Randomized Trials , 2016, Annals of Internal Medicine.

[9]  Gordon H Guyatt,et al.  Advances in the GRADE approach to rate the certainty in estimates from a network meta-analysis. , 2018, Journal of clinical epidemiology.

[10]  Yuan Zhang,et al.  Development of the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Summary of Findings (SoF) Table for Network Meta-analysis. , 2019, Journal of clinical epidemiology.

[11]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions , 2010, International Coaching Psychology Review.

[12]  G. Guyatt,et al.  What is a network meta-analysis and how can we use it to inform clinical practice? , 2014, Polskie Archiwum Medycyny Wewnetrznej.

[13]  Elie A Akl,et al.  GRADE Guidelines: 16. GRADE evidence to decision frameworks for tests in clinical practice and public health. , 2016, Journal of clinical epidemiology.

[14]  G. Guyatt,et al.  Efficacy and Safety of Pharmacologic Interventions in Patients Experiencing a Gout Flare: A Systematic Review and Network Meta‐Analysis , 2020, Arthritis care & research.

[15]  Gordon H Guyatt,et al.  GRADE approach to rate the certainty from a network meta-analysis: avoiding spurious judgments of imprecision in sparse networks. , 2019, Journal of clinical epidemiology.

[16]  Mohammed T Ansari,et al.  The GRADE Working Group clarifies the construct of certainty of evidence. , 2017, Journal of clinical epidemiology.

[17]  C. Bombardier,et al.  Methotrexate monotherapy and methotrexate combination therapy with traditional and biologic disease modifying anti-rheumatic drugs for rheumatoid arthritis: A network meta-analysis. , 2016, The Cochrane database of systematic reviews.

[18]  G. Guyatt,et al.  β-Blockers in heart failure--are all created equal? , 2013, Polskie Archiwum Medycyny Wewnetrznej.

[19]  Gordon H Guyatt,et al.  GRADE Evidence to Decision (EtD) frameworks: a systematic and transparent approach to making well informed healthcare choices. 1: Introduction , 2016, British Medical Journal.

[20]  G. Guyatt,et al.  GRADE approach to drawing conclusions from a network meta-analysis using a partially contextualised framework , 2020, BMJ.

[21]  S. Haque Ethics approval This study was conducted with the approval of the East London and City Health Authority Ethic Committee. Provenance and peer review Not commissioned; externally peer reviewed. , 2011 .

[22]  C. Bombardier,et al.  Methotrexate monotherapy and methotrexate combination therapy with traditional and biologic disease modifying antirheumatic drugs for rheumatoid arthritis: abridged Cochrane systematic review and network meta-analysis , 2016, British Medical Journal.

[23]  G. Guyatt,et al.  GRADE guidelines 26: Informative statements to communicate the findings of systematic reviews of interventions. , 2019, Journal of clinical epidemiology.

[24]  I. Flórez,et al.  Antiemetics in Children With Acute Gastroenteritis: A Meta-analysis , 2020, Pediatrics.

[25]  S. Duffy,et al.  Methods for Development of the European Commission Initiative on Breast Cancer Guidelines , 2019, Annals of Internal Medicine.

[26]  B. Sadeghirad,et al.  Probiotics Reduce Mortality and Morbidity in Preterm, Low Birth Weight Infants: a Systematic Review and Network Meta-analysis of Randomized Trials. , 2020, Gastroenterology.

[27]  H. Schünemann Interpreting GRADE's levels of certainty or quality of the evidence: GRADE for statisticians, considering review information size or less emphasis on imprecision? , 2016, Journal of clinical epidemiology.

[28]  G. Guyatt,et al.  GRADE guidelines: 20. Assessing the certainty of evidence in the importance of outcomes or values and preferences-inconsistency, imprecision, and other domains. , 2018, Journal of clinical epidemiology.

[29]  D. Bassler,et al.  Probiotics for prevention of mortality and morbidity in preterm infants , 2005 .

[30]  G. Guyatt,et al.  GRADE Evidence to Decision (EtD) frameworks: a systematic and transparent approach to making well informed healthcare choices. 2: Clinical practice guidelines , 2016, British Medical Journal.

[31]  Gordon H. Guyatt,et al.  GRADE Guidelines: 19. Assessing the certainty of evidence in the importance of outcomes or values and preferences-Risk of bias and indirectness. , 2018, Journal of clinical epidemiology.

[32]  David Rind,et al.  GRADE guidelines: 15. Going from evidence to recommendation-determinants of a recommendation's direction and strength. , 2013, Journal of clinical epidemiology.

[33]  Mohammad Hassan Murad,et al.  A GRADE Working Group approach for rating the quality of treatment effect estimates from network meta-analysis , 2014, BMJ : British Medical Journal.