Selection models with monotone weight functions in meta analysis

Publication bias, the fact that studies identified for inclusion in a meta analysis do not represent all studies on the topic of interest, is commonly recognized as a threat to the validity of a meta analysis. One way to explicitly model publication bias is via weighted probability distributions. We adopt the non-parametric approach initially introduced by Dear and Begg (1992) but impose that the weight function w is monotonely non-increasing as a function of the p-value. Since in meta analysis one typically only has few studies or "observations," regularization of the estimation problem seems sensible. In addition, virtually all parametric weight functions proposed so far in the literature are in fact decreasing. We discuss how to estimate a decreasing weight function in the above model and illustrate the new methodology on two well-known examples. Some basic properties of the log-likelihood function and computation of a p-value quantifying the evidence against the null hypothesis of a constant weight function are indicated. In addition, we provide an approximate selection bias adjusted profile likelihood confidence interval for the treatment effect. The corresponding software and the data sets used to illustrate it are provided as the R package selectMeta (Rufibach, 2011).

[1]  Julian P T Higgins,et al.  Recent developments in meta‐analysis , 2008, Statistics in medicine.

[2]  Deborah Ashby,et al.  Adjusting for publication bias: modelling the selection process. , 2004, Journal of evaluation in clinical practice.

[3]  Leslie Lamport,et al.  LaTeX - A Document Preparation System: User's Guide and Reference Manual, Second Edition , 1994 .

[4]  Roger D. Peng,et al.  Caching and Distributing Statistical Analyses in R , 2008 .

[5]  Larry V. Hedges,et al.  Selection Method Approaches , 2006 .

[6]  Larry V. Hedges,et al.  Estimation of effect size under nonrandom sampling , 1984 .

[7]  R. Kelly Stochastic reduction of loss in estimating normal means by isotonic regression , 1989 .

[8]  J Q Shi,et al.  A sensitivity analysis for publication bias in systematic reviews , 2001, Statistical methods in medical research.

[9]  池内 健二,et al.  Document preparation system , 2006 .

[10]  Satish Iyengar,et al.  Maximum likelihood estimation for weighted distributions , 1994 .

[11]  Friedrich Leisch,et al.  Sweave: Dynamic Generation of Statistical Reports Using Literate Data Analysis , 2002, COMPSTAT.

[12]  R. Tweedie,et al.  Publication Bias in Meta-Analysis: A Bayesian Data-Augmentation Approach to Account for Issues Exempli(cid:12)ed in the Passive Smoking Debate , 1997 .

[13]  Joel B. Greenhouse,et al.  Selection Models and the File Drawer Problem , 1988 .

[14]  Xiao-Hua Zhou,et al.  Statistical Methods for Meta‐Analysis , 2008 .

[15]  L. Hedges Modeling publication selection effects in meta-analysis , 1992 .

[16]  Colin B. Begg,et al.  An Approach for Assessing Publication Bias Prior to Performing a Meta-Analysis , 1992 .

[17]  Larry V. Hedges,et al.  Estimating Effect Size Under Publication Bias: Small Sample Properties and Robustness of a Random Effects Selection Model , 1996 .

[18]  J. Copas,et al.  A robust P‐value for treatment effect in meta‐analysis with publication bias , 2008, Statistics in medicine.

[19]  M. Borenstein,et al.  Publication Bias in Meta-Analysis , 2006 .

[20]  Nancy Paul Silliman,et al.  Hierarchical Selection Models with Applications in Meta-Analysis , 1997 .

[21]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[22]  Donald E. Knuth,et al.  Literate Programming , 1984, Comput. J..

[23]  J. Copas,et al.  Reanalysis of epidemiological evidence on lung cancer and passive smoking , 2000, BMJ : British Medical Journal.

[24]  S D Walter,et al.  A comparison of methods to detect publication bias in meta‐analysis , 2001, Statistics in medicine.

[25]  David Ardia,et al.  Differential Evolution (DEoptim) for Non-Convex Portfolio Optimization , 2010 .

[26]  J. Copas What works?: selectivity models and meta‐analysis , 1999 .

[27]  Nancy Paul Silliman,et al.  Nonparametric classes of weight functions to model publication bias , 1997 .

[28]  On Profile Likelihood: Comment , 2000 .

[29]  Jiayang Sun,et al.  SEMI-PARAMETRIC ESTIMATES UNDER BIASED SAMPLING , 1997 .

[30]  Kaspar Rufibach,et al.  reporttools: R Functions to Generate LaTeX Tables of Descriptive Statistics , 2009 .

[31]  Larry V. Hedges,et al.  [Selection Models and the File Drawer Problem]: Comment , 1988 .

[32]  A. W. van der Vaart,et al.  On Profile Likelihood , 2000 .

[33]  Jaeyong Lee ON POSTERIOR CONSISTENCY IN SELECTION MODELS , 2001 .

[34]  D. Ghosh Incorporating monotonicity into the evaluation of a biomarker. , 2007, Biostatistics.

[35]  K R Abrams,et al.  Modelling publication bias in meta-analysis: a review. , 2000, Statistical methods in medical research.

[36]  N J Wald,et al.  The accumulated evidence on lung cancer and environmental tobacco smoke , 1997, BMJ.

[37]  Jiayang Sun,et al.  Testing uniformity versus a monotone density , 1999 .

[38]  Kaspar Rubach reporttools: R Functions to Generate L A T E X Tables of Descriptive Statistics , 2009 .

[39]  Gerta Rücker,et al.  copas: An R package for Fitting the Copas Selection Model , 2009, R J..