Using clinical trial registries to inform Copas selection model for publication bias in meta‐analysis

Prospective registration of study protocols in clinical trial registries is a useful way to minimize the risk of publication bias in meta-analysis, and several clinical trial registries are available nowadays. However, they are mainly used as a tool for searching studies and information submitted to the registries has not been utilized as efficiently as it could. In addressing publication bias in meta-analyses, sensitivity analysis with the Copas selection model is a more objective alternative to widely-used graphical methods such as the funnel-plot and the trim-and-fill method. Despite its ability to quantify the potential impact of publication bias, a drawback of the model is that some parameters not to be specified. This may result in some difficulty in interpreting the results of the sensitivity analysis. In this paper, we propose an alternative inference procedure for the Copas selection model by utilizing information from clinical trial registries. Our method provides a simple and accurate way to estimate all unknown parameters in the Copas selection model. A simulation study revealed that our proposed method resulted in smaller biases and more accurate confidence intervals than existing methods. Furthermore, two published meta-analyses had been re-analysed to demonstrate how to implement the proposed method in practice.

[1]  Daisuke Ogino,et al.  Characteristics of clinical trial websites: information distribution between ClinicalTrials.gov and 13 primary registries in the WHO registry network , 2014, Trials.

[2]  Dan Jackson,et al.  A Bound for Publication Bias Based on the Fraction of Unpublished Studies , 2004, Biometrics.

[3]  J. Sterne,et al.  Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. , 2000, Journal of clinical epidemiology.

[4]  J. Copas,et al.  Meta-analysis, funnel plots and sensitivity analysis. , 2000, Biostatistics.

[5]  Yachen Zhang,et al.  High-Maintenance-Dose Clopidogrel in Patients Undergoing Percutaneous Coronary Intervention: A Systematic Review and Meta-Analysis , 2013, PloS one.

[6]  Ingram Olkin,et al.  Adjusting for publication bias in the presence of heterogeneity , 2003, Statistics in medicine.

[7]  Christopher W. Jones,et al.  Clinical trials registries are under-utilized in the conduct of systematic reviews: a cross-sectional analysis , 2014, Systematic Reviews.

[8]  J Q Shi,et al.  A sensitivity analysis for publication bias in systematic reviews , 2001, Statistical methods in medical research.

[9]  Gerta Rücker,et al.  Empirical evaluation suggests Copas selection model preferable to trim-and-fill method for selection bias in meta-analysis. , 2010, Journal of clinical epidemiology.

[10]  E. Loder,et al.  Characteristics and publication fate of unregistered and retrospectively registered clinical trials submitted to The BMJ over 4 years , 2018, BMJ Open.

[11]  J. Hartung,et al.  A refined method for the meta‐analysis of controlled clinical trials with binary outcome , 2001, Statistics in medicine.

[12]  R. Tweedie,et al.  A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis , 2000 .

[13]  Wolfgang Viechtbauer,et al.  Conducting Meta-Analyses in R with the metafor Package , 2010 .

[14]  Deborah A Zarin,et al.  How to avoid common problems when using ClinicalTrials.gov in research: 10 issues to consider , 2018, British Medical Journal.

[15]  D A Follmann,et al.  Valid Inference in Random Effects Meta‐Analysis , 1999, Biometrics.

[16]  Xiao-Hua Zhou,et al.  Statistical methods for dealing with publication bias in meta‐analysis , 2015, Statistics in medicine.

[17]  P. Poole,et al.  Tiotropium versus placebo for chronic obstructive pulmonary disease. , 2014, The Cochrane database of systematic reviews.

[18]  Harlan M Krumholz,et al.  Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis , 2012, BMJ : British Medical Journal.

[19]  Jennifer Cook Middleton,et al.  Does information from ClinicalTrials.gov increase transparency and reduce bias? Results from a five-report case series , 2018, Systematic Reviews.

[20]  S D Walter,et al.  A comparison of methods to detect publication bias in meta‐analysis , 2001, Statistics in medicine.

[21]  Steven Duffy,et al.  Searching ClinicalTrials.gov and the International Clinical Trials Registry Platform to inform systematic reviews: what are the optimal search approaches? , 2014, Journal of the Medical Library Association : JMLA.

[22]  P. Poole,et al.  Tiotropium versus placebo for chronic obstructive pulmonary disease. , 2012, The Cochrane database of systematic reviews.

[23]  Dimitris Mavridis,et al.  A fully Bayesian application of the Copas selection model for publication bias extended to network meta‐analysis , 2013, Statistics in medicine.

[24]  J. Heckman Sample selection bias as a specification error , 1979 .

[25]  Gerta Rücker,et al.  copas: An R package for Fitting the Copas Selection Model , 2009, R J..

[26]  J. Copas What works?: selectivity models and meta‐analysis , 1999 .

[27]  Alex J Sutton,et al.  Performance of the trim and fill method in the presence of publication bias and between‐study heterogeneity , 2007, Statistics in medicine.

[28]  C. Begg,et al.  Operating characteristics of a rank correlation test for publication bias. , 1994, Biometrics.

[29]  B. Goldacre,et al.  Prevalence of clinical trial status discrepancies: A cross-sectional study of 10,492 trials registered on both ClinicalTrials.gov and the European Union Clinical Trials Register , 2018, PloS one.

[30]  O Kuss,et al.  Statistical methods for meta‐analyses including information from studies without any events—add nothing to nothing and succeed nevertheless , 2015, Statistics in medicine.

[31]  J. Hartung,et al.  On tests of the overall treatment effect in meta‐analysis with normally distributed responses , 2001, Statistics in medicine.

[32]  Guido Knapp,et al.  Improved tests for a random effects meta‐regression with a single covariate , 2003, Statistics in medicine.

[33]  S. Patrick,et al.  Lay Summaries of Clinical Study Results: An Overview , 2019, Pharmaceutical Medicine.

[34]  Tony Tse,et al.  ClinicalTrials.gov and Drugs@FDA: A Comparison of Results Reporting for New Drug Approval Trials , 2016, Annals of Internal Medicine.

[35]  C. Hamada,et al.  Improvement of Statistical Power to Detect Publication Bias in Meta-analysis Using the Clinical Trial Registration System , 2011 .

[36]  Gerta Rücker,et al.  Empirical evaluation showed that the Copas selection model provided a useful summary in 80% of meta-analyses. , 2009, Journal of clinical epidemiology.

[37]  P. Lee,et al.  Publication bias in meta-analysis: its causes and consequences. , 2000, Journal of clinical epidemiology.

[38]  Jing Ning,et al.  Maximum likelihood estimation and EM algorithm of Copas-like selection model for publication bias correction. , 2017, Biostatistics.

[39]  R. Horton,et al.  Clinical trial registration: a statement from the International Committee of Medical Journal Editors. , 2005, Arteriosclerosis, thrombosis, and vascular biology.

[40]  Isabelle Boutron,et al.  Impact of searching clinical trial registries in systematic reviews of pharmaceutical treatments: methodological systematic review and reanalysis of meta-analyses , 2017, British Medical Journal.

[41]  Christopher W. Jones,et al.  Non-publication of large randomized clinical trials: cross sectional analysis , 2013, BMJ.

[42]  Guido Schwarzer,et al.  A test for publication bias in meta‐analysis with sparse binary data , 2007, Statistics in medicine.

[43]  Shinto Eguchi,et al.  Confidence Intervals and P‐Values for Meta‐Analysis with Publication Bias , 2007, Biometrics.

[44]  Roderik F Viergever,et al.  Trends in global clinical trial registration: an analysis of numbers of registered clinical trials in different parts of the world from 2004 to 2013 , 2015, BMJ Open.

[45]  John B. Copas,et al.  A likelihood‐based sensitivity analysis for publication bias in meta‐analysis , 2013 .