Meta-Analysis and Subgroups

Subgroup analysis is the process of comparing a treatment effect for two or more variants of an intervention—to ask, for example, if an intervention’s impact is affected by the setting (school versus community), by the delivery agent (outside facilitator versus regular classroom teacher), by the quality of delivery, or if the long-term effect differs from the short-term effect. While large-scale studies often employ subgroup analyses, these analyses cannot generally be performed for small-scale studies, since these typically include a homogeneous population and only one variant of the intervention. This limitation can be bypassed by using meta-analysis. Meta-analysis allows the researcher to compare the treatment effect in different subgroups, even if these subgroups appear in separate studies. We discuss several statistical issues related to this procedure, including the selection of a statistical model and statistical power for the comparison. To illustrate these points, we use the example of a meta-analysis of obesity prevention.

[1]  Hannah R Rothstein,et al.  A basic introduction to fixed‐effect and random‐effects models for meta‐analysis , 2010, Research synthesis methods.

[2]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[3]  D. Lau,et al.  Long-term pharmacotherapy for overweight and obesity: a systematic review and meta-analysis of randomized controlled trials , 2003, International Journal of Obesity.

[4]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[5]  D. Lau,et al.  Long‐term pharmacotherapy for obesity and overweight , 2003 .

[6]  Larry V Hedges,et al.  The power of statistical tests for moderators in meta-analysis. , 2004, Psychological methods.

[7]  F. Lindgärde The effect of orlistat on body weight and coronary heart disease risk profile in obese patients: The Swedish Multimorbidity Study , 2000, Journal of internal medicine.

[8]  Douglas G Bonett,et al.  Meta-analytic interval estimation for bivariate correlations. , 2008, Psychological methods.

[9]  L. Hedges,et al.  The power of statistical tests in meta-analysis. , 2001, Psychological methods.

[10]  Douglas G Bonett,et al.  Meta-analytic interval estimation for standardized and unstandardized mean differences. , 2009, Psychological methods.

[11]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[12]  L. Hedges,et al.  Statistical Methods for Meta-Analysis , 1987 .

[13]  L. Hedges,et al.  The Handbook of Research Synthesis and Meta-Analysis , 2009 .