Proposed triggers for retiring a living systematic review

Living systematic reviews (LSRs) are systematic reviews that are continually updated, incorporating relevant new evidence as it becomes available. LSRs are critical for decision-making in topics where the evidence continues to evolve. It is not feasible to continue to update LSRs indefinitely; however, guidance on when to retire LSRs from the living mode is not clear. We propose triggers for making such a decision. The first trigger is to retire LSRs when the evidence becomes conclusive for the outcomes that are required for decision-making. Conclusiveness of evidence is best determined based on the GRADE certainty of evidence construct, which is more comprehensive than solely relying on statistical considerations. The second trigger to retire LSRs is when the question becomes less pertinent for decision-making as determined by relevant stakeholders, including people affected by the problem, healthcare professionals, policymakers and researchers. LSRs can also be retired from a living mode when new studies are not anticipated to be published on the topic and when resources become unavailable to continue updating. We describe examples of retired LSRs and apply the proposed approach using one LSR about adjuvant tyrosine kinase inhibitors in high-risk renal cell carcinoma that we retired from a living mode and published its last update.

[1]  E. Akl,et al.  A Framework for the Development of Living Practice Guidelines in Health Care , 2022, Annals of Internal Medicine.

[2]  T. Ho,et al.  Quantifying Absolute Benefit for Adjuvant Treatment Options in Renal Cell Carcinoma: A Living Interactive Systematic Review and Network Meta-analysis. , 2022, Critical reviews in oncology/hematology.

[3]  D. Pieper,et al.  When is the evidence conclusive? Analysis of systematic reviews for which Cochrane declared that conclusions will not change with further studies , 2022, Research synthesis methods.

[4]  Zhen Wang,et al.  Thresholds for interpreting the fragility index derived from sample of randomised controlled trials in cardiology: a meta-epidemiologic study , 2022, BMJ Evidence-Based Medicine.

[5]  Lara A. Kahale,et al.  Extension of the PRISMA 2020 statement for living systematic reviews (LSRs): protocol , 2022, F1000Research.

[6]  Neal R Haddaway,et al.  Tailored PRISMA 2020 flow diagrams for living systematic reviews: a methodological survey and a proposal , 2022, F1000Research.

[7]  E. Akl,et al.  Update Alert 3: Ventilation Techniques and Risk for Transmission of Coronavirus Disease, Including COVID-19 , 2021, Annals of Internal Medicine.

[8]  J. Burns,et al.  Methodological challenges for living systematic reviews conducted during the COVID-19 pandemic: A concept paper , 2021, Journal of Clinical Epidemiology.

[9]  V. Montori,et al.  TEMPORARY REMOVAL: Direct Oral Anticoagulants Compared With Dalteparin for Treatment of Cancer-Associated Thrombosis: A Living, Interactive Systematic Review and Network Meta-analysis. , 2021, Mayo Clinic proceedings.

[10]  L. Quintans-Júnior,et al.  Efficacy and safety of hydroxychloroquine as pre-and post-exposure prophylaxis and treatment of COVID-19: A systematic review and meta-analysis of blinded, placebo-controlled, randomized clinical trials. , 2021, The Lancet Regional Health - Americas.

[11]  J. Warner,et al.  Adjuvant Tyrosine Kinase Inhibitors in Renal Cell Carcinoma: A Concluded Living Systematic Review and Meta-Analysis. , 2021, JCO clinical cancer informatics.

[12]  G. Guyatt,et al.  GRADE guidelines 32: GRADE offers guidance on choosing targets of GRADE certainty of evidence ratings. , 2021, Journal of clinical epidemiology.

[13]  T. Ho,et al.  A Living, Interactive Systematic Review and Network Meta-analysis of First-line Treatment of Metastatic Renal Cell Carcinoma. , 2021, European urology.

[14]  D. Pieper,et al.  How to decide whether a systematic review is stable and not in need of updating: Analysis of Cochrane reviews , 2020, Research synthesis methods.

[15]  W. Aronow Faculty Opinions recommendation of Risks and Impact of Angiotensin-Converting Enzyme Inhibitors or Angiotensin-Receptor Blockers on SARS-CoV-2 Infection in Adults: A Living Systematic Review. , 2020, Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature.

[16]  B. Rochwerg,et al.  Update Alert 2: Ventilation Techniques and Risk for Transmission of Coronavirus Disease, Including COVID-19 , 2020, Annals of Internal Medicine.

[17]  G. Guyatt,et al.  Drug treatments for covid-19: living systematic review and network meta-analysis , 2020, BMJ.

[18]  M. Murad,et al.  Efficacy of chloroquine or hydroxychloroquine in COVID-19 patients: a systematic review and meta-analysis , 2020, medRxiv.

[19]  E. Akl,et al.  Ventilation Techniques and Risk for Transmission of Coronavirus Disease, Including COVID-19 , 2020, Annals of Internal Medicine.

[20]  M. Clarke Partially systematic thoughts on the history of systematic reviews , 2018, Systematic Reviews.

[21]  Georgia Salanti,et al.  Living systematic reviews: 3. Statistical methods for updating meta-analyses. , 2017, Journal of clinical epidemiology.

[22]  Elie A Akl,et al.  SERIES: LIVING SYSTEMATIC REVIEWS Living systematic review: 1. Introduction d the why, what, when, and how , 2022 .

[23]  Mohammed T Ansari,et al.  The GRADE Working Group clarifies the construct of certainty of evidence. , 2017, Journal of clinical epidemiology.

[24]  G. Guyatt,et al.  When and how to update systematic reviews: consensus and checklist , 2016, British Medical Journal.

[25]  G. Guyatt,et al.  GRADE guidelines 6. Rating the quality of evidence--imprecision. , 2011, Journal of clinical epidemiology.

[26]  Victor M. Montori,et al.  Efficacy of Continuous Glucose Monitoring in Improving Glycemic Control and Reducing Hypoglycemia: A Systematic Review and Meta-Analysis of Randomized Trials , 2011, Journal of diabetes science and technology.

[27]  K. Thorlund,et al.  Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. , 2008, Journal of clinical epidemiology.

[28]  K. Shojania,et al.  How Quickly Do Systematic Reviews Go Out of Date? A Survival Analysis , 2007, Annals of Internal Medicine.

[29]  G. Guyatt,et al.  Grading quality of evidence and strength of recommendations , 2004, BMJ : British Medical Journal.

[30]  S. Yusuf,et al.  Cumulating evidence from randomized trials: utilizing sequential monitoring boundaries for cumulative meta-analysis. , 1997, Controlled clinical trials.