Incorporating external evidence on between‐trial heterogeneity in network meta‐analysis

In a network meta‐analysis, between‐study heterogeneity variances are often very imprecisely estimated because data are sparse, so standard errors of treatment differences can be highly unstable. External evidence can provide informative prior distributions for heterogeneity and, hence, improve inferences. We explore approaches for specifying informative priors for multiple heterogeneity variances in a network meta‐analysis. First, we assume equal heterogeneity variances across all pairwise intervention comparisons (approach 1); incorporating an informative prior for the common variance is then straightforward. Models allowing unequal heterogeneity variances are more realistic; however, care must be taken to ensure implied variance‐covariance matrices remain valid. We consider three strategies for specifying informative priors for multiple unequal heterogeneity variances. Initially, we choose different informative priors according to intervention comparison type and assume heterogeneity to be proportional across comparison types and equal within comparison type (approach 2). Next, we allow all heterogeneity variances in the network to differ, while specifying a common informative prior for each. We explore two different approaches to this: placing priors on variances and correlations separately (approach 3) or using an informative inverse Wishart distribution (approach 4). Our methods are exemplified through application to two network metaanalyses. Appropriate informative priors are obtained from previously published evidence‐based distributions for heterogeneity. Relevant prior information on between‐study heterogeneity can be incorporated into network meta‐analyses, without needing to assume equal heterogeneity across treatment comparisons. The approaches proposed will be beneficial in sparse data sets and provide more appropriate intervals for treatment differences than those based on imprecise heterogeneity estimates.

[1]  Matt Simpson,et al.  Bayesian inference for a covariance matrix , 2014, 1408.4050.

[2]  Guobing Lu,et al.  Modeling between-trial variance structure in mixed treatment comparisons. , 2009, Biostatistics.

[3]  Xiao-Li Meng,et al.  Modeling covariance matrices in terms of standard deviations and correlations, with application to shrinkage , 2000 .

[4]  G. Lu,et al.  Combination of direct and indirect evidence in mixed treatment comparisons , 2004, Statistics in medicine.

[5]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..

[6]  Kristian Thorlund,et al.  Modelling heterogeneity variances in multiple treatment comparison meta-analysis – Are informative priors the better solution? , 2013, BMC Medical Research Methodology.

[7]  Simon G Thompson,et al.  Predicting the extent of heterogeneity in meta-analysis, using empirical data from the Cochrane Database of Systematic Reviews , 2012, International journal of epidemiology.

[8]  A Whitehead,et al.  Borrowing strength from external trials in a meta-analysis. , 1996, Statistics in medicine.

[9]  Alex J. Sutton,et al.  Evidence Synthesis for Decision Making 2 , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[10]  Andrew W Lee,et al.  Review of mixed treatment comparisons in published systematic reviews shows marked increase since 2009. , 2014, Journal of clinical epidemiology.

[11]  Rebecca M Turner,et al.  Characteristics of meta-analyses and their component studies in the Cochrane Database of Systematic Reviews: a cross-sectional, descriptive analysis , 2011, BMC medical research methodology.

[12]  G. Lu,et al.  Assessing Evidence Inconsistency in Mixed Treatment Comparisons , 2006 .

[13]  Christopher H. Schmid,et al.  Characteristics of Networks of Interventions: A Description of a Database of 186 Published Networks , 2014, PloS one.

[14]  Dan Jackson,et al.  Predictive distributions for between-study heterogeneity and simple methods for their application in Bayesian meta-analysis , 2014, Statistics in medicine.

[15]  Julian P T Higgins,et al.  Comparative efficacy and safety of treatments for localised prostate cancer: an application of network meta-analysis , 2014, BMJ Open.

[16]  Jeremy E. Oakley,et al.  Incorporating Genuine Prior Information about Between-Study Heterogeneity in Random Effects Pairwise and Network Meta-analyses , 2017, Medical decision making : an international journal of the Society for Medical Decision Making.

[17]  D. Bates,et al.  Mixed-Effects Models in S and S-PLUS , 2001 .

[18]  V. Hasselblad,et al.  Meta-analysis of Multitreatment Studies , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[19]  Georgia Salanti,et al.  Evaluation of networks of randomized trials , 2008, Statistical methods in medical research.

[20]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[21]  Rebecca M. Turner,et al.  Predictive distributions were developed for the extent of heterogeneity in meta-analyses of continuous outcome data , 2015, Journal of clinical epidemiology.

[22]  Andrew Thomas,et al.  The BUGS project: Evolution, critique and future directions , 2009, Statistics in medicine.

[23]  Tom Leonard,et al.  Bayesian Inference for a Covariance Matrix , 1992 .