Deficiencies in addressing effect modification in network meta-analyses: a meta-epidemiological survey.

OBJECTIVE The objectives of this study were to evaluate the current state of reporting and handling of effect modification in network meta-analyses (NMAs) and perform exploratory analyses to identify variables that are potentially associated with incomplete reporting of effect modifiers in NMAs. STUDY DESIGN AND SETTING We conducted a meta-epidemiological survey using a systematic review of NMAs published in 2013 and identified through MEDLINE and Embase databases. RESULTS The review identified 77 NMAs. The most common type of effect modifiers identified and explored were patient characteristics (50.7% or 39/77), and the most common adjustment method used was sensitivity analysis (51.7% or 30/58). Over 45% (35/77) of studies did not describe a plan, nearly 40% (30/77) did not report the results of analyses, and approximately 47% (36/77) of studies had incomplete reporting. Exploratory univariate regression analyses yielded a statistically significant association for the variables of journal impact factor, ratio of randomized controlled trials to number of comparisons, and total number of randomized controlled trials. CONCLUSION Current reporting practices are largely deficient, given that almost half of identified published NMAs do not explore or report effect modification. Journal impact factor and amount of available information in a network were associated with completeness of reporting.

[1]  Chris Cameron,et al.  Efficacy and safety outcomes of oral anticoagulants and antiplatelet drugs in the secondary prevention of venous thromboembolism: systematic review and network meta-analysis , 2013, BMJ.

[2]  B. V. Van Tassell,et al.  Benefits of β blockers in patients with heart failure and reduced ejection fraction: network meta-analysis , 2013, BMJ.

[3]  P. Royle,et al.  Denosumab for treatment of bone metastases secondary to solid tumours: systematic review and network meta-analysis. , 2013, European journal of cancer.

[4]  K. Boye,et al.  A network meta‐analysis to compare glycaemic control in patients with type 2 diabetes treated with exenatide once weekly or liraglutide once daily in comparison with insulin glargine, exenatide twice daily or placebo , 2013, Diabetes, obesity & metabolism.

[5]  David C Hoaglin,et al.  Conducting indirect-treatment-comparison and network-meta-analysis studies: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 2. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[6]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[7]  K. Thorlund,et al.  Direct-acting antiviral therapies for hepatitis C genotype 1 infection: a multiple treatment comparison meta-analysis , 2012, QJM : monthly journal of the Association of Physicians.

[8]  M. Orme,et al.  The Efficacy and Safety of Oral Anticoagulants in Warfarin-Suitable Patients With Nonvalvular Atrial Fibrillation , 2013, Clinical and applied thrombosis/hemostasis : official journal of the International Academy of Clinical and Applied Thrombosis/Hemostasis.

[9]  N. Freemantle,et al.  Putting the record straight on aprotinin as safe and effective: results from a mixed treatment meta-analysis of trials of aprotinin. , 2013, The Journal of thoracic and cardiovascular surgery.

[10]  G. Rücker,et al.  Differential effectiveness of placebo treatments: a systematic review of migraine prophylaxis. , 2013, JAMA internal medicine.

[11]  Huseyin Naci,et al.  Comparative Tolerability and Harms of Individual Statins: A Study-Level Network Meta-Analysis of 246 955 Participants From 135 Randomized, Controlled Trials , 2013, Circulation. Cardiovascular quality and outcomes.

[12]  B. Djulbegovic,et al.  Pharmaceutical industry sponsorship and research outcome and quality: systematic review , 2003, BMJ : British Medical Journal.

[13]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement , 2009, BMJ : British Medical Journal.

[14]  Joseph C Cappelleri,et al.  Indirect treatment comparison/network meta-analysis study questionnaire to assess relevance and credibility to inform health care decision making: an ISPOR-AMCP-NPC Good Practice Task Force report. , 2014, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[15]  T. Trikalinos,et al.  Comparative efficacy of first-line therapies for advanced-stage chronic lymphocytic leukemia: a multiple-treatment meta-analysis. , 2013, Cancer treatment reviews.

[16]  Philippe Charlier,et al.  Which placebo to cure depression? A thought-provoking network meta-analysis , 2013, BMC Medicine.

[17]  M. Büchler,et al.  ENERgized vessel sealing systems versus CONventional hemostasis techniques in thyroid surgery—the ENERCON systematic review and network meta-analysis , 2013, Langenbeck's Archives of Surgery.

[18]  Sergio Sismondo,et al.  Industry sponsorship and research outcome. , 2012, The Cochrane database of systematic reviews.

[19]  Janet E Brown,et al.  Comparative Efficacy of Bisphosphonates in Metastatic Breast and Prostate Cancer and Multiple Myeloma: A Mixed-Treatment Meta-analysis , 2013, Clinical Cancer Research.

[20]  A. Darzi,et al.  Which hemostatic device in thyroid surgery? A network meta-analysis of surgical technologies. , 2013, Thyroid : official journal of the American Thyroid Association.

[21]  D. Hoaglin,et al.  Use of mixed-treatment-comparison methods in estimating efficacy of treatments for heavy menstrual bleeding , 2013, European Journal of Medical Research.

[22]  G. Biondi‐Zoccai,et al.  New oral anticoagulants and the risk of intracranial hemorrhage: traditional and Bayesian meta-analysis and mixed treatment comparison of randomized trials of new oral anticoagulants in atrial fibrillation. , 2013, JAMA neurology.

[23]  Lei Wang,et al.  Comparative Efficacy and Acceptability of Antidepressants in Parkinson's Disease: A Network Meta-Analysis , 2013, PloS one.

[24]  G. Bakalos,et al.  A network meta‐analysis of randomized controlled trials for comparing the effectiveness and safety profile of treatments with marketing authorization for relapsing multiple sclerosis , 2013, Journal of clinical pharmacy and therapeutics.

[25]  G. Biondi-Zoccai,et al.  Anaesthetic Drugs and Survival: A Bayesian Network Meta-analysis of Randomized Trials in Cardiac Surgery , 2014 .

[26]  N. Hawkins,et al.  The relative efficacy of imatinib, dasatinib and nilotinib for newly diagnosed chronic myeloid leukemia: a systematic review and network meta-analysis , 2013, Experimental Hematology & Oncology.

[27]  B. Duncan,et al.  Impact of statin dose on major cardiovascular events: a mixed treatment comparison meta-analysis involving more than 175,000 patients. , 2013, International journal of cardiology.

[28]  G. Dranitsaris,et al.  Small molecule targeted therapies for the second-line treatment for metastatic renal cell carcinoma: a systematic review and indirect comparison of safety and efficacy , 2013, Journal of Cancer Research and Clinical Oncology.

[29]  R. Pontarolo,et al.  Insulin analogues versus human insulin in type 1 diabetes: direct and indirect meta-analyses of efficacy and safety , 2013 .

[30]  G. Stone,et al.  Clinical outcomes with drug-eluting and bare-metal stents in patients with ST-segment elevation myocardial infarction: evidence from a comprehensive network meta-analysis. , 2013, Journal of the American College of Cardiology.

[31]  K. Ellenbogen,et al.  Comparative effectiveness of novel oral anticoagulants for atrial fibrillation: evidence from pair-wise and warfarin-controlled network meta-analyses , 2013, HSR proceedings in intensive care & cardiovascular anesthesia.

[32]  N. Hawkins,et al.  The efficacy and tolerability of perampanel and other recently approved anti-epileptic drugs for the treatment of refractory partial onset seizure: a systematic review and Bayesian network meta-analysis , 2013, Current Medical Research and Opinion.

[33]  S. de Servi,et al.  Meta-analysis of impact of different types and doses of statins on new-onset diabetes mellitus. , 2013, The American journal of cardiology.

[34]  R. Perera,et al.  Pharmacological interventions for smoking cessation: an overview and network meta-analysis. , 2013, The Cochrane database of systematic reviews.

[35]  P. Cuijpers,et al.  Comparative Efficacy of Seven Psychotherapeutic Interventions for Patients with Depression: A Network Meta-Analysis. , 2016, Focus.

[36]  Alex J. Sutton,et al.  Heterogeneity: Subgroups, Meta-Regression, Bias And Bias-Adjustment , 2011 .

[37]  A. Goralczyk,et al.  Treatment of chronic HCV genotype 1 infection with telaprevir: a Bayesian mixed treatment comparison of fixed-length and response-guided treatment regimens in treatment-naïve and –experienced patients , 2013, BMC Gastroenterology.

[38]  M. Zheng,et al.  Secondary prophylaxis of variceal bleeding for cirrhotic patients: a multiple‐treatments meta‐analysis , 2013, European journal of clinical investigation.

[39]  V. Diehl,et al.  Effect of initial treatment strategy on survival of patients with advanced-stage Hodgkin's lymphoma: a systematic review and network meta-analysis. , 2013, The Lancet. Oncology.

[40]  H. Naci,et al.  Comparative benefits of statins in the primary and secondary prevention of major coronary events and all-cause mortality: a network meta-analysis of placebo-controlled and active-comparator trials , 2013, European journal of preventive cardiology.

[41]  M. Hochberg,et al.  Mixed treatment comparison of efficacy and tolerability of biologic agents in patients with rheumatoid arthritis , 2013, Current medical research and opinion.

[42]  G. Stone,et al.  Risk of stroke with percutaneous coronary intervention compared with on-pump and off-pump coronary artery bypass graft surgery: Evidence from a comprehensive network meta-analysis. , 2013, American heart journal.

[43]  Georgia Salanti,et al.  Indirect and mixed‐treatment comparison, network, or multiple‐treatments meta‐analysis: many names, many benefits, many concerns for the next generation evidence synthesis tool , 2012, Research synthesis methods.

[44]  Joseph C Cappelleri,et al.  Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 1. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[45]  A. Messori,et al.  New and old anti-thrombotic treatments for patients with atrial fibrillation , 2013, International Journal of Clinical Pharmacy.

[46]  Wei-Chih Liao,et al.  Comparative effectiveness of renin-angiotensin system blockers and other antihypertensive drugs in patients with diabetes: systematic review and bayesian network meta-analysis , 2013, BMJ.

[47]  C. Di Pietrantonj,et al.  Immunomodulators and immunosuppressants for multiple sclerosis: a network meta-analysis. , 2013, The Cochrane database of systematic reviews.

[48]  H. Naci,et al.  Dose-comparative effects of different statins on serum lipid levels: a network meta-analysis of 256,827 individuals in 181 randomized controlled trials , 2013, European journal of preventive cardiology.

[49]  C. A. Jones,et al.  Efficacy of supplemental peripheral nerve blockade for hip fracture surgery: multiple treatment comparison , 2013, Canadian Journal of Anesthesia/Journal canadien d'anesthésie.

[50]  D. Mukherjee,et al.  Comparing newer oral anti-platelets prasugrel and ticagrelor in reduction of ischemic events-evidence from a network meta-analysis , 2013, Journal of Thrombosis and Thrombolysis.

[51]  J. Donovan,et al.  Evaluation of antiplatelet agents for secondary prevention of stroke using mixed treatment comparison meta-analysis. , 2013, Clinical therapeutics.

[52]  M. Paquet,et al.  Network meta‐analysis of the outcome ‘participant complete clearance’ in nonimmunosuppressed participants of eight interventions for actinic keratosis: a follow‐up on a Cochrane review , 2013, The British journal of dermatology.

[53]  L. Smeeth,et al.  Comparative efficacy and tolerability of anti‐epileptic drugs for refractory focal epilepsy: systematic review and network meta‐analysis reveals the need for long term comparator trials , 2013, British journal of clinical pharmacology.

[54]  K. Chien,et al.  In-office treatment for dentin hypersensitivity: a systematic review and network meta-analysis. , 2013, Journal of clinical periodontology.

[55]  M. K. Siddiqui,et al.  Efficacy and tolerability of naproxen/esomeprazole magnesium tablets compared with non-specific NSAIDs and COX-2 inhibitors: a systematic review and network analyses , 2013, Open access rheumatology : research and reviews.

[56]  G. Zaccara,et al.  Neurological adverse events of new generation sodium blocker antiepileptic drugs. Meta-analysis of randomized, double-blinded studies with eslicarbazepine acetate, lacosamide and oxcarbazepine , 2013, Seizure.

[57]  N. Freemantle,et al.  Results of indirect and mixed treatment comparison of fracture efficacy for osteoporosis treatments: a meta-analysis , 2012, Osteoporosis International.

[58]  S. Fénix-Caballero,et al.  Direct and indirect comparison of the efficacy and safety of adalimumab, etanercept, infliximab and golimumab in psoriatic arthritis , 2013, Journal of clinical pharmacy and therapeutics.

[59]  M. Baccini,et al.  Bayesian network meta-analysis of root coverage procedures: ranking efficacy and identification of best treatment. , 2013, Journal of clinical periodontology.

[60]  Peter Jüni,et al.  Comparative efficacy of pharmacological and non-pharmacological interventions in fibromyalgia syndrome: network meta-analysis , 2012, Annals of the rheumatic diseases.

[61]  M. Pedroso,et al.  Comparative Efficacy of Oral Nucleoside or Nucleotide Analog Monotherapy Used in Chronic Hepatitis B: A Mixed‐Treatment Comparison Meta‐analysis , 2013, Pharmacotherapy.

[62]  A. Sutton,et al.  Acupuncture and other physical treatments for the relief of pain due to osteoarthritis of the knee: network meta-analysis☆ , 2013, Osteoarthritis and cartilage.

[63]  Atle Fretheim,et al.  Flexible sigmoidoscopy versus faecal occult blood testing for colorectal cancer screening in asymptomatic individuals. , 2013, The Cochrane database of systematic reviews.

[64]  D. Wonderling,et al.  Topical therapies for the treatment of plaque psoriasis: systematic review and network meta‐analyses , 2013, The British journal of dermatology.

[65]  A. Bhansali,et al.  Comparative efficacy and safety of six antidepressants and anticonvulsants in painful diabetic neuropathy: a network meta-analysis. , 2013, Pain physician.

[66]  A. Messori,et al.  New endovascular devices for acute ischemic stroke: summarizing evidence by multiple treatment comparison meta-analysis. , 2013, Annals of vascular surgery.

[67]  Shaona Niu,et al.  Lenalidomide versus thalidomide based regimens as first-line therapy for patients with multiple myeloma , 2013, Leukemia & lymphoma.

[68]  O. Uthman,et al.  Exercise for lower limb osteoarthritis: systematic review incorporating trial sequential analysis and network meta-analysis , 2013, BMJ : British Medical Journal.

[69]  Wei-Chih Liao,et al.  Adjuvant treatments for resected pancreatic adenocarcinoma: a systematic review and network meta-analysis. , 2013, The Lancet. Oncology.

[70]  H. Suryapranata,et al.  Safety and efficacy outcomes of first and second generation durable polymer drug eluting stents and biodegradable polymer biolimus eluting stents in clinical practice: comprehensive network meta-analysis , 2013, BMJ.

[71]  Jack Y. B. Lee,et al.  Comparative effectiveness and safety of oral phosphodiesterase type 5 inhibitors for erectile dysfunction: a systematic review and network meta-analysis. , 2013, European urology.

[72]  E. Huisman,et al.  Comparative efficacy of aclidinium versus glycopyrronium and tiotropium, as maintenance treatment of moderate to severe COPD patients: a systematic review and network meta-analysis , 2013, International journal of chronic obstructive pulmonary disease.

[73]  M. Bennett,et al.  Efficacy of rapid-onset oral fentanyl formulations vs. oral morphine for cancer-related breakthrough pain: a meta-analysis of comparative trials. , 2013, Journal of pain and symptom management.

[74]  J. Dumville,et al.  Preoperative skin antiseptics for preventing surgical wound infections after clean surgery. , 2013, The Cochrane database of systematic reviews.

[75]  M. Kraemer,et al.  Comparative efficacy of long-acting bronchodilators for COPD - a network meta-analysis , 2013, Respiratory Research.

[76]  Philippe Ravaud,et al.  Analysis of the systematic reviews process in reports of network meta-analyses: methodological systematic review , 2013, BMJ.

[77]  B. Riveros,et al.  Efficacy of topical antifungals in the treatment of dermatophytosis: a mixed-treatment comparison meta-analysis involving 14 treatments. , 2013, JAMA dermatology.

[78]  N. Hawkins,et al.  A comparison of national guidelines for network meta-analysis. , 2014, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[79]  M. Barry,et al.  The relative efficacy of boceprevir and telaprevir in the treatment of hepatitis C virus genotype 1. , 2013, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[80]  L. Rong,et al.  Indirect comparison of anti-TNF-α agents for active ankylosing spondylitis: mixed treatment comparison of randomized controlled trials. , 2013, Clinical and experimental rheumatology.

[81]  J. Jansen,et al.  Progression-free survival with fulvestrant 500 mg and alternative endocrine therapies as second-line treatment for advanced breast cancer: a network meta-analysis with parametric survival models. , 2013, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[82]  Hsien-Ho Lin,et al.  Comparative safety of inhaled medications in patients with chronic obstructive pulmonary disease: systematic review and mixed treatment comparison meta-analysis of randomised controlled trials , 2012, Thorax.