Network meta-analysis of multiple outcome measures accounting for borrowing of information across outcomes

BackgroundNetwork meta-analysis (NMA) enables simultaneous comparison of multiple treatments while preserving randomisation. When summarising evidence to inform an economic evaluation, it is important that the analysis accurately reflects the dependency structure within the data, as correlations between outcomes may have implication for estimating the net benefit associated with treatment. A multivariate NMA offers a framework for evaluating multiple treatments across multiple outcome measures while accounting for the correlation structure between outcomes.MethodsThe standard NMA model is extended to multiple outcome settings in two stages. In the first stage, information is borrowed across outcomes as well across studies through modelling the within-study and between-study correlation structure. In the second stage, we make use of the additional assumption that intervention effects are exchangeable between outcomes to predict effect estimates for all outcomes, including effect estimates on outcomes where evidence is either sparse or the treatment had not been considered by any one of the studies included in the analysis. We apply the methods to binary outcome data from a systematic review evaluating the effectiveness of nine home safety interventions on uptake of three poisoning prevention practices (safe storage of medicines, safe storage of other household products, and possession of poison centre control telephone number) in households with children. Analyses are conducted in WinBUGS using Markov Chain Monte Carlo (MCMC) simulations.ResultsUnivariate and the first stage multivariate models produced broadly similar point estimates of intervention effects but the uncertainty around the multivariate estimates varied depending on the prior distribution specified for the between-study covariance structure. The second stage multivariate analyses produced more precise effect estimates while enabling intervention effects to be predicted for all outcomes, including intervention effects on outcomes not directly considered by the studies included in the analysis.ConclusionsAccounting for the dependency between outcomes in a multivariate meta-analysis may or may not improve the precision of effect estimates from a network meta-analysis compared to analysing each outcome separately.

[1]  Yinghui Wei,et al.  Estimating within-study covariances in multivariate meta-analysis with multiple outcomes , 2012, Statistics in medicine.

[2]  Xiao-Li Meng,et al.  Modeling covariance matrices in terms of standard deviations and correlations, with application to shrinkage , 2000 .

[3]  Dan Jackson,et al.  Multivariate meta-analysis: Potential and promise , 2011, Statistics in medicine.

[4]  P. Mccarthy,et al.  Safety education in a pediatric primary care setting. , 1987, Pediatrics.

[5]  Alex J Sutton,et al.  Interspecies extrapolation in environmental exposure standard setting: A Bayesian synthesis approach. , 2009, Regulatory toxicology and pharmacology : RTP.

[6]  P C Lambert,et al.  An evaluation of bivariate random‐effects meta‐analysis for the joint synthesis of two correlated outcomes , 2007, Statistics in medicine.

[7]  Theo Stijnen,et al.  Combining multiple outcome measures in a meta‐analysis: an application , 2003, Statistics in medicine.

[8]  Richard D Riley,et al.  Bivariate random-effects meta-analysis and the estimation of between-study correlation , 2007, BMC Medical Research Methodology.

[9]  Theo Stijnen,et al.  Advanced methods in meta‐analysis: multivariate approach and meta‐regression , 2002, Statistics in medicine.

[10]  A E Ades,et al.  Mixed treatment comparison with multiple outcomes reported inconsistently across trials: Evaluation of antivirals for treatment of influenza A and B , 2008, Statistics in medicine.

[11]  Julian P T Higgins,et al.  A case study of multiple-treatments meta-analysis demonstrates that covariates should be considered. , 2009, Journal of clinical epidemiology.

[12]  Jennie Popay,et al.  Testing Methodological Guidance on the Conduct of Narrative Synthesis in Systematic Reviews , 2009 .

[13]  Tatyana Shamliyan,et al.  A Bayesian Missing Data Framework for Multiple Continuous Outcome Mixed Treatment Comparisons , 2013 .

[14]  Alex J. Sutton,et al.  Evidence Synthesis for Decision Making 2 , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[15]  A E Ades,et al.  Use of evidence in economic decision models: practical issues and methodological challenges. , 2007, Health economics.

[16]  G. Lu,et al.  Combination of direct and indirect evidence in mixed treatment comparisons , 2004, Statistics in medicine.

[17]  Nicola J Cooper,et al.  Mixed comparison of stroke prevention treatments in individuals with nonrheumatic atrial fibrillation. , 2006, Archives of internal medicine.

[18]  Richard D Riley,et al.  Multivariate meta‐analysis: the effect of ignoring within‐study correlation , 2009 .

[19]  P. Raina,et al.  A randomized trial to assess the effectiveness of an infant home safety programme , 2007, International journal of injury control and safety promotion.

[20]  W DuMouchel,et al.  A Bayesian methodology for scaling radiation studies from animals to man. , 1989, Health physics.

[21]  Nicky J Welton,et al.  Mixed treatment comparison of repeated measurements of a continuous endpoint: an example using topical treatments for primary open‐angle glaucoma and ocular hypertension , 2011, Statistics in medicine.

[22]  Deborah M Caldwell,et al.  Mixed treatment comparison analysis provides internally coherent treatment effect estimates based on overviews of reviews and can reveal inconsistency. , 2010, Journal of clinical epidemiology.

[23]  Nicola J Cooper,et al.  Multivariate meta-analysis of mixed outcomes: a Bayesian approach , 2013, Statistics in medicine.

[24]  Dimitris Mavridis,et al.  An approach for modelling multiple correlated outcomes in a network of interventions using odds ratios , 2014, Statistics in medicine.

[25]  Yinghui Wei,et al.  Bayesian multivariate meta‐analysis with multiple outcomes , 2013, Statistics in medicine.

[26]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..

[27]  Nicky J Welton,et al.  Network meta-analysis with competing risk outcomes. , 2010, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[28]  Georgia Salanti,et al.  Evaluation of networks of randomized trials , 2008, Statistical methods in medical research.

[29]  Georgia Salanti,et al.  Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. , 2011, Journal of clinical epidemiology.

[30]  A. Sutton,et al.  Mixed treatment comparisons using aggregate and individual participant level data , 2012, Statistics in medicine.

[31]  Kerrie Mengersen,et al.  Multivariate meta‐analysis , 2003, Statistics in medicine.

[32]  David R. Jones,et al.  How vague is vague? A simulation study of the impact of the use of vague prior distributions in MCMC using WinBUGS , 2005, Statistics in medicine.

[33]  Deborah M Caldwell,et al.  Simultaneous comparison of multiple treatments: combining direct and indirect evidence , 2005, BMJ : British Medical Journal.

[34]  Richard D Riley,et al.  An alternative model for bivariate random-effects meta-analysis when the within-study correlations are unknown. , 2008, Biostatistics.

[35]  Richard D Riley,et al.  A multivariate meta‐analysis approach for reducing the impact of outcome reporting bias in systematic reviews , 2012, Statistics in medicine.

[36]  S Dias,et al.  Checking consistency in mixed treatment comparison meta‐analysis , 2010, Statistics in medicine.

[37]  D. Kendrick,et al.  Home safety education and provision of safety equipment for injury prevention. , 2007, The Cochrane database of systematic reviews.

[38]  Guobing Lu,et al.  Modeling between-trial variance structure in mixed treatment comparisons. , 2009, Biostatistics.

[39]  Richard D Riley,et al.  Rejoinder to commentaries on ‘Multivariate meta‐analysis: Potential and promise’ , 2011 .

[40]  Haitao Chu,et al.  Meta‐analysis of diagnostic accuracy studies accounting for disease prevalence: Alternative parameterizations and model selection , 2009, Statistics in medicine.

[41]  T. Lumley.  Network meta‐analysis for indirect treatment comparisons , 2002, Statistics in medicine.

[42]  Nicky J Welton,et al.  NICE DSU Technical Support Document 2: A Generalised Linear Modelling Framework for Pairwise and Network Meta-Analysis of Randomised Controlled Trials , 2011 .

[43]  F Mosteller,et al.  Meta-analysis of multiple outcomes by regression with random effects. , 1998, Statistics in medicine.

[44]  M. A. Best.  Bayesian Approaches to Clinical Trials and Health‐Care Evaluation , 2005 .

[45]  Jeffrey E. Harris,et al.  Bayes Methods for Combining the Results of Cancer Studies in Humans and other Species , 1983 .

[46]  J W Williamson,et al.  Prevention of childhood household injuries: a controlled clinical trial. , 1977, American journal of public health.

[47]  Alex J. Sutton,et al.  Methods for Meta-Analysis in Medical Research , 2000 .

[48]  K. Khunti,et al.  A Mediterranean diet improves HbA1c but not fasting blood glucose compared to alternative dietary strategies: a network meta-analysis. , 2014, Journal of human nutrition and dietetics : the official journal of the British Dietetic Association.

[49]  A. Gelman.  Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[50]  Robert S. Thompson,et al.  Healthy steps in an integrated delivery system: child and parent outcomes at 30 months. , 2006, Archives of pediatrics & adolescent medicine.

[51]  A E Ades,et al.  Meta‐analysis of mixed treatment comparisons at multiple follow‐up times , 2007, Statistics in medicine.

[52]  David S. Moore,et al.  Statistics in Practice , 2014 .

[53]  Nicky J Welton,et al.  A Generalised Linear Modelling Framework for Pairwise and Network Meta-Analysis of Randomised Controlled Trials , 2014 .

[54]  Dimitris Mavridis,et al.  A practical introduction to multivariate meta-analysis , 2013, Statistical methods in medical research.

[55]  J. Popay,et al.  Ownership and Function Systematic Reviews: Effectiveness of Interventions to Promote Smoke Alarm Testing Methodological Guidance on the Conduct of Narrative Synthesis in , 2010 .

[56]  A E Ades,et al.  Accounting for correlation in network meta‐analysis with multi‐arm trials , 2012, Research synthesis methods.