Standard error estimation in meta-analysis of studies reporting medians

We consider the setting of an aggregate data meta-analysis of a continuous outcome of interest. When the distribution of the outcome is skewed, it is often the case that some primary studies report the sample mean and standard deviation of the outcome and other studies report the sample median along with the first and third quartiles and/or minimum and maximum values. To perform meta-analysis in this context, a number of approaches have recently been developed to impute the sample mean and standard deviation from studies reporting medians. Then, standard meta-analytic approaches with inverse-variance weighting are applied based on the (imputed) study-specific sample means and standard deviations. In this article, we illustrate how this common practice can severely underestimate the within-study standard errors, which results in poor coverage for the pooled mean in common effect meta-analyses and overestimation of between-study heterogeneity in random effects meta-analyses. We propose a straightforward bootstrap approach to estimate the standard errors of the imputed sample means. Our simulation study illustrates how the proposed approach can improve the estimation of the within-study standard errors and consequently improve coverage for the pooled mean in common effect meta-analyses and estimation of between-study heterogeneity in random effects meta-analyses. Moreover, we apply the proposed approach in a meta-analysis to identify risk factors of a severe course of COVID-19.

[1]  J. Rychtář,et al.  Unified approach to optimal estimation of mean and standard deviation from sample summaries , 2022, Statistical methods in medical research.

[2]  Alan D. Hutson,et al.  A generalized BLUE approach for combining location and scale information in a meta-analysis , 2021, Journal of applied statistics.

[3]  S. Walter,et al.  Estimation of standard deviations and inverse‐variance weights from an observed range , 2021, Statistics in medicine.

[4]  Jie Zhou,et al.  Estimating the sample mean and standard deviation from order statistics and sample size in meta-analysis , 2021, Statistical methods in medical research.

[5]  L. Maier-Hein,et al.  Can we predict the severe course of COVID-19 - a systematic review and meta-analysis of indicators of clinical outcome? , 2021, PloS one.

[6]  J. Rychtář,et al.  Estimating the sample variance from the sample size and range , 2020, Statistics in medicine.

[7]  N. Balakrishnan,et al.  Meta‐analysis of quantile intervals from different studies with an application to a pulmonary tuberculosis data , 2020, Statistics in medicine.

[8]  Yuedong Wang,et al.  Estimating the mean and variance from the five-number summary of a log-normal distribution , 2020 .

[9]  Lu Lin,et al.  Optimally estimating the sample standard deviation from the five‐number summary , 2020, Research synthesis methods.

[10]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions , 2010, International Coaching Psychology Review.

[11]  R. Steele,et al.  Estimating the sample mean and standard deviation from commonly reported quantiles in meta-analysis , 2019, Statistical methods in medical research.

[12]  Jack Bowden,et al.  A comparison of heterogeneity variance estimators in simulated random‐effects meta‐analyses , 2018, Research synthesis methods.

[13]  R. Steele,et al.  One‐sample aggregate data meta‐analysis of medians , 2017, Statistics in medicine.

[14]  Russell Steele,et al.  Meta‐analysis of the difference of medians , 2018, Biometrical journal. Biometrische Zeitschrift.

[15]  Tiejun Tong,et al.  Optimally estimating the sample mean from the sample size, median, mid-range, and/or mid-quartile range , 2015, Statistical methods in medical research.

[16]  Ralf Bender,et al.  Methods to estimate the between‐study variance and its uncertainty in meta‐analysis† , 2015, Research synthesis methods.

[17]  Deukwoo Kwon,et al.  Simulation-based estimation of mean and standard deviation for meta-analysis via Approximate Bayesian Computation (ABC) , 2015, BMC Medical Research Methodology.

[18]  Martin Bland,et al.  Estimating Mean and Standard Deviation from the Sample Size, Three Quartiles, Minimum, and Maximum , 2015 .

[19]  Jiming Liu,et al.  Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range , 2014, BMC Medical Research Methodology.

[20]  Wolfgang Viechtbauer,et al.  Conducting Meta-Analyses in R with the metafor Package , 2010 .

[21]  Michele Tarsilla Cochrane Handbook for Systematic Reviews of Interventions , 2010, Journal of MultiDisciplinary Evaluation.

[22]  Julian P T Higgins,et al.  Meta-analysis of skewed data: Combining results reported on log-transformed or raw scales , 2008, Statistics in medicine.

[23]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[24]  Wolfgang Viechtbauer,et al.  Bias and Efficiency of Meta-Analytic Variance Estimators in the Random-Effects Model , 2005 .

[25]  I. Hozo,et al.  Estimating the mean and variance from the median, range, and the size of a sample , 2005, BMC medical research methodology.

[26]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[27]  S. Thompson,et al.  Quantifying heterogeneity in a meta‐analysis , 2002, Statistics in medicine.

[28]  D. Cox,et al.  An Analysis of Transformations , 1964 .