Guidance on the implementation and reporting of a drug safety Bayesian network meta‐analysis

The Drug Information Association Bayesian Scientific Working Group (BSWG) was formed in 2011 with a vision to ensure that Bayesian methods are well understood and broadly utilized for design and analysis and throughout the medical product development process, and to improve industrial, regulatory, and economic decision making. The group, composed of individuals from academia, industry, and regulatory, has as its mission to facilitate the appropriate use and contribute to the progress of Bayesian methodology. In this paper, the safety sub-team of the BSWG explores the use of Bayesian methods when applied to drug safety meta-analysis and network meta-analysis. Guidance is presented on the conduct and reporting of such analyses. We also discuss different structural model assumptions and provide discussion on prior specification. The work is illustrated through a case study involving a network meta-analysis related to the cardiovascular safety of non-steroidal anti-inflammatory drugs.

[1]  William J. Browne,et al.  Bayesian and likelihood-based methods in multilevel modeling 1 A comparison of Bayesian and likelihood-based methods for fitting multilevel models , 2006 .

[2]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. , 2001, Journal of the American Podiatric Medical Association.

[3]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[4]  M. Egger,et al.  Risk of cardiovascular events and rofecoxib: cumulative meta-analysis , 2004, The Lancet.

[5]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..

[6]  G. Lu,et al.  Assessing Evidence Inconsistency in Mixed Treatment Comparisons , 2006 .

[7]  Jill Hayden,et al.  Seven items were identified for inclusion when reporting a Bayesian analysis of a clinical study. , 2005, Journal of clinical epidemiology.

[8]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2009, Journal of clinical epidemiology.

[9]  A. Laupacis,et al.  Cyclo-oxygenase-2 inhibitors versus non-selective non-steroidal anti-inflammatory drugs and congestive heart failure outcomes in elderly patients: a population-based cohort study , 2004, The Lancet.

[10]  S. Nissen,et al.  Effect of rosiglitazone on the risk of myocardial infarction and death from cardiovascular causes. , 2007, The New England journal of medicine.

[11]  David C Hoaglin,et al.  Conducting indirect-treatment-comparison and network-meta-analysis studies: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 2. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[12]  Hans-Peter Piepho,et al.  The Use of Two‐Way Linear Mixed Models in Multitreatment Meta‐Analysis , 2012, Biometrics.

[13]  Scott M Berry,et al.  Accounting for Multiplicities in Assessing Drug Safety: A Three‐Level Hierarchical Mixture Model , 2004, Biometrics.

[14]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[15]  Guobing Lu,et al.  Modeling between-trial variance structure in mixed treatment comparisons. , 2009, Biostatistics.

[16]  Jesse A. Berlin,et al.  Meta-analysis of clinical trial safety data in a drug development program: Answers to frequently asked questions , 2013, Clinical trials.

[17]  M. Egger,et al.  Cardiovascular safety of non-steroidal anti-inflammatory drugs: network meta-analysis , 2011, BMJ : British Medical Journal.

[18]  Simon G Thompson,et al.  Predicting the extent of heterogeneity in meta-analysis, using empirical data from the Cochrane Database of Systematic Reviews , 2012, International journal of epidemiology.

[19]  David Gavaghan,et al.  Using evidence from different sources : an example using paracetamol 1000 mg plus codeine 60 mg , 2001 .

[20]  Robert E Weiss,et al.  Bayesian methods for data analysis. , 2010, American journal of ophthalmology.

[21]  Nicky J Welton,et al.  NICE DSU TECHNICAL SUPPORT DOCUMENT 5: EVIDENCE SYNTHESIS IN THE BASELINE NATURAL HISTORY MODEL , 2011 .

[22]  Gregory Campbell,et al.  Bayesian Statistics in Medical Devices: Innovation Sparked by the FDA , 2011, Journal of biopharmaceutical statistics.

[23]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[24]  Keming Yu,et al.  Bayesian Mode Regression , 2012, 1208.0579.

[25]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data: Little/Statistical Analysis with Missing Data , 2002 .

[26]  Deborah M Caldwell,et al.  NICE DSU Technical Support Document 7: Evidence Synthesis of Treatment Efficacy in Decision Making: A Reviewer’s Checklist , 2012 .

[27]  Xuefeng Li,et al.  Bayesian Approaches in Medical Device Clinical Trials: A Discussion with Examples in the Regulatory Setting , 2011, Journal of biopharmaceutical statistics.

[28]  A Whitehead,et al.  A general parametric approach to the meta-analysis of randomized clinical trials. , 1991, Statistics in medicine.

[29]  Daniel H Solomon,et al.  Nonsteroidal anti-inflammatory drug use and acute myocardial infarction. , 2002, Archives of internal medicine.

[30]  Georgia Salanti,et al.  Evaluation of networks of randomized trials , 2008, Statistical methods in medical research.

[31]  Gary H Lyman,et al.  The strengths and limitations of meta-analyses based on aggregate data , 2005, BMC Medical Research Methodology.

[32]  M. A. Best.  Bayesian Approaches to Clinical Trials and Health‐Care Evaluation , 2005 .

[33]  Simon G Thompson,et al.  Flexible parametric models for random‐effects distributions , 2008, Statistics in medicine.

[34]  Jonathan J Deeks,et al.  Much ado about nothing: a comparison of the performance of meta‐analytical methods with rare events , 2007, Statistics in medicine.

[35]  Stephen Senn,et al.  The Many Modes of Meta , 2000 .

[36]  Nicky J Welton,et al.  NICE DSU Technical Support Document 2: A Generalised Linear Modelling Framework for Pairwise and Network Meta-Analysis of Randomised Controlled Trials , 2011 .

[37]  L. Hayduk,et al.  Structural equation model testing and the quality of natural killer cell activity measurements , 2005 .

[38]  G. Lu,et al.  Combination of direct and indirect evidence in mixed treatment comparisons , 2004, Statistics in medicine.

[39]  William DuMouchel,et al.  Multivariate Bayesian Logistic Regression for Analysis of Clinical Study Safety Issues , 2012, 1210.0385.

[40]  C Michael Stein,et al.  COX-2 selective non-steroidal anti-inflammatory drugs and risk of serious coronary heart disease , 2002, The Lancet.

[41]  M J Daniels,et al.  Meta-analysis for the evaluation of potential surrogate markers. , 1997, Statistics in medicine.

[42]  D J Spiegelhalter,et al.  Bayesian approaches to random-effects meta-analysis: a comparative study. , 1995, Statistics in medicine.

[43]  S. Mallal,et al.  IL28B, HLA-C, and KIR Variants Additively Predict Response to Therapy in Chronic Hepatitis C Virus Infection in a European Cohort: A Cross-Sectional Study , 2011, PLoS medicine.

[44]  Byron Jones,et al.  Statistical approaches for conducting network meta‐analysis in drug development , 2011, Pharmaceutical statistics.

[45]  Ram C Tiwari,et al.  Meta-analysis using Dirichlet process , 2016, Statistical methods in medical research.

[46]  D. Symmons,et al.  Cancer risk with tumor necrosis factor alpha (TNF) inhibitors: meta‐analysis of randomized controlled trials of adalimumab, etanercept, and infliximab using patient level data , 2011, Pharmacoepidemiology and drug safety.

[47]  D. Madigan,et al.  Bayesian Model Averaging for Linear Regression Models , 1997 .

[48]  D. Spiegelhalter,et al.  Summarizing historical information on controls in clinical trials , 2010, Clinical trials.

[49]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. The Cochrane Collaboration , 2013 .

[50]  L. McCandless.  Bayesian methods for data analysis (3rd edn). Bradley P. Carlin and Thomas A. Louis, Chapman & Hall/CRC, Boca Raton, 2008. No. of pages: 552. Price: $69.95. ISBN 9781584886976 , 2009 .

[51]  K R Abrams,et al.  Bayesian methods in meta-analysis and evidence synthesis. , 2001, Statistical methods in medical research.

[52]  Robert Riddell,et al.  Cardiovascular events associated with rofecoxib in a colorectal adenoma chemoprevention trial. , 2005, The New England journal of medicine.

[53]  Peter C Austin,et al.  Effect of selective cyclooxygenase 2 inhibitors and naproxen on short-term risk of acute myocardial infarction in the elderly. , 2003, Archives of internal medicine.

[54]  S. Shoor,et al.  Risk of acute myocardial infarction and sudden cardiac death in patients treated with cyclo-oxygenase 2 selective and non-selective non-steroidal anti-inflammatory drugs: nested case-control study , 2005, The Lancet.

[55]  David J Spiegelhalter,et al.  A re-evaluation of random-effects meta-analysis , 2009, Journal of the Royal Statistical Society. Series A,.

[56]  Simon Day,et al.  Structured approach to the elicitation of expert beliefs for a Bayesian‐designed clinical trial: a case study , 2013, Pharmaceutical statistics.

[57]  David Madigan,et al.  Bayesian methods for design and analysis of safety trials , 2014, Pharmaceutical statistics.

[58]  Douglas G Altman,et al.  Bayesian random effects meta‐analysis of trials with binary outcomes: methods for the absolute risk difference and relative risk scales by D. E. Warn, S. G. Thompson and D. J. Spiegelhalter, Statistics in Medicine 2002; 21: 1601–1623 , 2005, Statistics in medicine.

[59]  Russell V. Lenth,et al.  Statistical Analysis With Missing Data (2nd ed.) (Book) , 2004 .

[60]  David R. Jones,et al.  How vague is vague? A simulation study of the impact of the use of vague prior distributions in MCMC using WinBUGS , 2005, Statistics in medicine.

[61]  Alexander J Sutton,et al.  What to add to nothing? Use and avoidance of continuity corrections in meta-analysis of sparse data. , 2004, Statistics in medicine.

[62]  Jeremy E. Oakley,et al.  Uncertain Judgements: Eliciting Experts' Probabilities , 2006 .

[63]  P. McGettigan,et al.  Cardiovascular risk and inhibition of cyclooxygenase: a systematic review of the observational studies of selective and nonselective inhibitors of cyclooxygenase 2. , 2006, JAMA.

[64]  Karen L. Price,et al.  Identifying Potential Adverse Events Dose-Response Relationships Via Bayesian Indirect and Mixed Treatment Comparison Models , 2013, Journal of biopharmaceutical statistics.

[65]  A. Pariente,et al.  Stroke risk and NSAIDs: a systematic review of observational studies , 2011, Pharmacoepidemiology and drug safety.

[66]  David J. Spiegelhalter,et al.  Conflict Diagnostics in Directed Acyclic Graphs, with Applications in Bayesian Evidence Synthesis , 2013, 1310.0628.

[67]  A J Sutton,et al.  Meta‐analysis of individual‐ and aggregate‐level data , 2008, Statistics in medicine.

[68]  S Dias,et al.  Checking consistency in mixed treatment comparison meta‐analysis , 2010, Statistics in medicine.

[69]  A. Gelman.  Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[70]  J. Carlin.  Meta-analysis for 2 x 2 tables: a Bayesian approach. , 1992, Statistics in medicine.

[71]  B. Carlin,et al.  Comparing Bayesian and Frequentist Approaches for Multiple Outcome Mixed Treatment Comparisons , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[72]  Dimitris Mavridis,et al.  A practical introduction to multivariate meta-analysis , 2013, Statistical methods in medical research.

[73]  J. Higgins.  Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. The Cochrane Collaboration , 2011 .

[74]  H C Van Houwelingen,et al.  A bivariate approach to meta-analysis. , 1993, Statistics in medicine.

[75]  Michael Branson,et al.  Bayesian models for subgroup analysis in clinical trials , 2011, Clinical trials.

[76]  Bradley P. Carlin,et al.  Bayesian Hierarchical Modeling for Detecting Safety Signals in Clinical Trials , 2011, Journal of biopharmaceutical statistics.

[77]  E. Franssen.  How to Report Statistics in Medicine , 2008, Nature Medicine.

[78]  W. White,et al.  Effects of celecoxib and rofecoxib on blood pressure and edema in patients > or =65 years of age with systemic hypertension and osteoarthritis. , 2002, The American journal of cardiology.

[79]  Bradley P Carlin,et al.  A Bayesian missing data framework for generalized multiple outcome mixed treatment comparisons , 2016, Research synthesis methods.

[80]  David J Spiegelhalter,et al.  Bias modelling in evidence synthesis , 2009, Journal of the Royal Statistical Society. Series A,.

[81]  P. McGettigan,et al.  Cardiovascular Risk with Non-Steroidal Anti-Inflammatory Drugs: Systematic Review of Population-Based Controlled Observational Studies , 2011, PLoS medicine.

[82]  T. Lumley.  Network meta‐analysis for indirect treatment comparisons , 2002, Statistics in medicine.

[83]  Alan E. Gelfand,et al.  Model choice: A minimum posterior predictive loss approach , 1998, AISTATS.