Uptake of systematic reviews and meta-analyses based on individual participant data in clinical practice guidelines: descriptive study

Objective To establish the extent to which systematic reviews and meta-analyses of individual participant data (IPD) are being used to inform the recommendations included in published clinical guidelines. Design Descriptive study. Setting Database maintained by the Cochrane IPD Meta-analysis Methods Group, supplemented by records of published IPD meta-analyses held in a separate database. Population A test sample of systematic reviews of randomised controlled trials that included a meta-analysis of IPD, and a separate sample of clinical guidelines, matched to the IPD meta-analyses according to medical condition, interventions, populations, and dates of publication. Data extraction Descriptive information on each guideline was extracted along with evidence showing use or critical appraisal, or both, of the IPD meta-analysis within the guideline; recommendations based directly on its findings and the use of other systematic reviews in the guideline. Results Based on 33 IPD meta-analyses and 177 eligible, matched clinical guidelines there was evidence that IPD meta-analyses were being under-utilised. Only 66 guidelines (37%) cited a matched IPD meta-analysis. Around a third of these (n=22, 34%) had critically appraised the IPD meta-analysis. Recommendations based directly on the matched IPD meta-analyses were identified for only 18 of the 66 guidelines (27%). For the guidelines that did not cite a matched IPD meta-analysis (n=111, 63%), search dates had preceded the publication of the IPD meta-analysis in 23 cases (21%); however, for the remainder, there was no obvious reasons why the IPD meta-analysis had not been cited. Conclusions Our results indicate that systematic reviews and meta-analyses based on IPD are being under-utilised. Guideline developers should routinely seek good quality and up to date IPD meta-analyses to inform guidelines. Increased use of IPD meta-analyses could lead to improved guidelines ensuring that routine patient care is based on the most reliable evidence available.

[1]  Z. Kmietowicz A third of recommendations in Scottish guidelines are based on poorest evidence, finds study , 2014, BMJ : British Medical Journal.

[2]  K. Chalkidou About the National Institute for Health and Care Excellence - NICE. , 2013, Acta medica portuguesa.

[3]  C. Gamble,et al.  Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias — An Updated Review , 2013, PloS one.

[4]  L. V. Van Bortel,et al.  Naftidrofuryl for intermittent claudication. , 2012, The Cochrane database of systematic reviews.

[5]  M. Clarke,et al.  Making evidence more wanted: a systematic review of facilitators to enhance the uptake of evidence from systematic reviews and meta-analyses. , 2012, International journal of evidence-based healthcare.

[6]  Günter Ollenschläger,et al.  Guidelines International Network: Toward International Standards for Clinical Practice Guidelines , 2012, Annals of Internal Medicine.

[7]  A. Sutton,et al.  Assessment of publication bias, selection bias, and unavailable data in meta-analyses using individual participant data: a database survey , 2012, BMJ : British Medical Journal.

[8]  J. Sterne,et al.  The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials , 2011, BMJ : British Medical Journal.

[9]  Rod J. Rohrich,et al.  The Levels of Evidence and Their Role in Evidence-Based Medicine , 2011, Plastic and reconstructive surgery.

[10]  G. Guyatt,et al.  GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. , 2011, Journal of clinical epidemiology.

[11]  K. Ang,et al.  Hyperfractionated or accelerated radiotherapy for head and neck cancer. , 2010 .

[12]  M. Rovers,et al.  Grommets (ventilation tubes) for hearing loss associated withotitis media with effusion in children , 2010, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[13]  R. Collins,et al.  Efficacy and safety of more intensive lowering of LDL cholesterol: a meta-analysis of data from 170 000 participants in 26 randomised trials , 2010, The Lancet.

[14]  M. Gnant,et al.  Efficacy and safety of more intensive lowering of LDL cholesterol: a meta-analysis of data from 170 000 participants in 26 randomised trials , 2010 .

[15]  K. Khan,et al.  Individual patient data meta-analysis of randomized evidence to assess the effectiveness of laparoscopic uterosacral nerve ablation in chronic pelvic pain. , 2010, Human reproduction update.

[16]  P. Langhorne,et al.  Early Mobilization After Stroke: An Example of an Individual Patient Data Meta-Analysis of a Complex Intervention , 2010, Stroke.

[17]  R. Peto,et al.  Overview of the randomized trials of radiotherapy in ductal carcinoma in situ of the breast. , 2010, Journal of the National Cancer Institute. Monographs.

[18]  R Gray,et al.  Hysterectomy, endometrial destruction, and levonorgestrel releasing intrauterine system (Mirena) for heavy menstrual bleeding: systematic review and meta-analysis of data from individual patients , 2010, BMJ : British Medical Journal.

[19]  James M. Wright,et al.  Treatment of hypertension in patients 80 years and older: the lower the better? A meta-analysis of randomized controlled trials , 2010, Journal of hypertension.

[20]  Neil Marlow,et al.  Elective high-frequency oscillatory versus conventional ventilation in preterm infants: a systematic review and meta-analysis of individual patients' data , 2010, The Lancet.

[21]  P. Langhorne,et al.  Stroke liaison workers for stroke patients and carers: an individual patient data meta-analysis. , 2010, The Cochrane database of systematic reviews.

[22]  Jose Belderbos,et al.  Meta-analysis of concomitant versus sequential radiochemotherapy in locally advanced non-small-cell lung cancer. , 2010, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[23]  L. Stewart,et al.  Adjuvant chemotherapy, with or without postoperative radiotherapy, in operable non-small-cell lung cancer: two meta-analyses of individual patient data , 2010, The Lancet.

[24]  R. Pieters,et al.  Systematic review of the addition of vincristine plus steroid pulses in maintenance treatment for childhood acute lymphoblastic leukaemia – an individual patient data meta‐analysis involving 5659 children , 2010, British journal of haematology.

[25]  Douglas G Altman,et al.  The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews , 2010, BMJ : British Medical Journal.

[26]  J. Pignon,et al.  Meta-analysis of chemotherapy in head and neck cancer (MACH-NC): an update on 93 randomised trials and 17,346 patients. , 2009, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[27]  R. Collins,et al.  Aspirin in the primary and secondary prevention of vascular disease: collaborative meta-analysis of individual participant data from randomised trials , 2009, The Lancet.

[28]  R. Collins,et al.  Aspirin in the primary and secondary prevention of vascular disease: collaborative meta-analysis of individual participant data from randomised trials. , 2009, Lancet.

[29]  R. Pieters,et al.  Beneficial and harmful effects of anthracyclines in the treatment of childhood acute lymphoblastic leukaemia: a systematic review and meta-analysis. , 2009, British journal of haematology.

[30]  N. Cullum,et al.  Four layer bandage compared with short stretch bandage for venous leg ulcers: systematic review and meta-analysis of randomised controlled trials with data from individual patients , 2009, BMJ : British Medical Journal.

[31]  R. Califf,et al.  Scientific evidence underlying the ACC/AHA clinical practice guidelines. , 2009, JAMA.

[32]  D. Alberts,et al.  Reducing uncertainties about the effects of chemoradiotherapy for cervical cancer: a systematic review and meta-analysis of individual patient data from 18 randomized trials. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[33]  Jayne Tierney,et al.  Chemotherapy in addition to supportive care improves survival in advanced non-small-cell lung cancer: a systematic review and meta-analysis of individual patient data from 16 randomized controlled trials. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[34]  P. Moayyedi,et al.  Meta‐analysis: Helicobacter pylori‘test and treat’ compared with empirical acid suppression for managing dyspepsia , 2008, Alimentary pharmacology & therapeutics.

[35]  C. Cates,et al.  Regular treatment with formoterol for chronic asthma: serious adverse events. , 2008, The Cochrane database of systematic reviews.

[36]  C. Cates,et al.  Regular treatment with salmeterol for chronic asthma: serious adverse events. , 2008, The Cochrane database of systematic reviews.

[37]  H. Diener,et al.  Dipyridamole plus aspirin versus aspirin alone in secondary prevention after TIA or stroke: a meta-analysis by risk , 2008, Journal of Neurology, Neurosurgery, and Psychiatry.

[38]  G. Biondi-Zoccai,et al.  Early glycoprotein IIb–IIIa inhibitors in primary angioplasty (EGYPT) cooperation: an individual patient data meta-analysis , 2008, Heart.

[39]  N Waugh,et al.  Systematic review of the clinical effectiveness and cost-effectiveness of 64-slice or higher computed tomography angiography as an alternative to invasive coronary angiography in the investigation of coronary artery disease. , 2008, Health technology assessment.

[40]  Tomasz Burzykowski,et al.  Taxanes alone or in combination with anthracyclines as first-line therapy of patients with metastatic breast cancer. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[41]  Jim Young,et al.  Antibiotics for adults with clinically diagnosed acute rhinosinusitis: a meta-analysis of individual patient data , 2008, The Lancet.

[42]  R. Guerrini,et al.  Severe myoclonic epilepsy in infancy: A systematic review and a meta‐analysis of individual patient data , 2008, Epilepsia.

[43]  A. Hoes,et al.  Antibiotic therapy to prevent the development of asymptomatic middle ear effusion in children with acute otitis media: a meta-analysis of individual patient data. , 2008, Archives of otolaryngology--head & neck surgery.

[44]  P Aveyard,et al.  'Cut down to quit' with nicotine replacement therapies in smoking cessation: a systematic review of effectiveness and economic analysis. , 2008, Health technology assessment.

[45]  A Engert,et al.  High-dose chemotherapy with autologous stem cell transplantation in the first line treatment of aggressive non-Hodgkin lymphoma (NHL) in adults. , 2008, The Cochrane database of systematic reviews.

[46]  A. Abernethy,et al.  Oxygen for relief of dyspnoea in mildly- or non-hypoxaemic patients with cancer: a systematic review and meta-analysis , 2008, British Journal of Cancer.

[47]  R. Peto,et al.  Adjuvant chemotherapy in oestrogen-receptor-poor breast cancer: patient-level meta-analysis of randomised trials. , 2008, Lancet.

[48]  A. Marson,et al.  Multiple treatment comparisons in epilepsy monotherapy trials , 2007, Trials.

[49]  A. Oxman,et al.  Use of evidence in WHO recommendations , 2007, The Lancet.

[50]  A. Hoes,et al.  Antibiotics for acute otitis media: a meta-analysis with individual patient data , 2006, The Lancet.

[51]  Lesley A. Stewart,et al.  Do Systematic Reviews Based on Individual Patient Data Offer a Means of Circumventing Biases Associated with Trial Publications , 2006 .

[52]  M. Borenstein,et al.  Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments , 2006 .

[53]  P. Vineis,et al.  Quality of systematic reviews used in guidelines for oncology practice. , 2006, Annals of oncology : official journal of the European Society for Medical Oncology.

[54]  Lesley A Stewart,et al.  Investigating patient exclusion bias in meta-analysis. , 2004, International journal of epidemiology.

[55]  G. Schwarzer,et al.  High-Dose Chemotherapy with Autologous Stem Cell Support Is Not Superior to Conventional-Dose Chemotherapy in the First-Line Treatment of Aggressive Non-Hodgkin Lymphoma - Results of a Comprehensive Meta-Analysis. , 2004 .

[56]  G. Feder,et al.  Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project , 2003, Quality & safety in health care.

[57]  Lesley A Stewart,et al.  PUBLICATION BIAS AND META-ANALYSES , 2003, International Journal of Technology Assessment in Health Care.

[58]  L. Stewart,et al.  To IPD or not to IPD? , 2002, Evaluation & the health professions.

[59]  L. Stewart,et al.  Practical methodology of meta-analyses (overviews) using updated individual patient data. Cochrane Working Group. , 1995, Statistics in medicine.

[60]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. The Cochrane Collaboration , 2013 .

[61]  S. Greenfield,et al.  Clinical practice guidelines we can trust , 2011 .

[62]  J. Thigpen Meta-Analysis of Breast Cancer Outcomes in Adjuvant Trials of Aromatase Inhibitors Versus Tamoxifen , 2010 .

[63]  F. Cluzeau,et al.  Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project , 2003 .

[64]  Global Programme on Evidence for Health Policy World Health Organization , 2001 .