Fixed effects and variance components estimation in three‐level meta‐analysis

Meta-analytic methods have been widely applied to education, medicine, and the social sciences. Much of meta-analytic data are hierarchically structured because effect size estimates are nested within studies, and in turn, studies can be nested within level-3 units such as laboratories or investigators, and so forth. Thus, multilevel models are a natural framework for analyzing meta-analytic data. This paper discusses the application of a Fisher scoring method in two-level and three-level meta-analysis that takes into account random variation at the second and third levels. The usefulness of the model is demonstrated using data that provide information about school calendar types. sas proc mixed and hlm can be used to compute the estimates of fixed effects and variance components. Copyright © 2011 John Wiley & Sons, Ltd.

[1]  L. Hedges,et al.  The Handbook of Research Synthesis and Meta-Analysis , 2009 .

[2]  Xiao-Hua Zhou,et al.  Statistical Methods for Meta‐Analysis , 2008 .

[3]  Mirjam Moerbeek,et al.  The Consequence of Ignoring a Level of Nesting in Multilevel Analysis , 2004, Multivariate behavioral research.

[4]  M. S. Patel,et al.  An introduction to meta-analysis. , 1989, Health Policy.

[5]  Ingram Olkin,et al.  Stochastically dependent effect sizes. , 1994 .

[6]  Anthony S. Bryk,et al.  Toward a More Appropriate Conceptualization of Research on School Effects: A Three-Level Hierarchical Linear Model , 1988, American Journal of Education.

[7]  Judith D. Singer,et al.  Using SAS PROC MIXED to Fit Multilevel Models, Hierarchical Models, and Individual Growth Models , 1998 .

[8]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[9]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[10]  H. Goldstein,et al.  Multilevel Models in Educational and Social Research. , 1989 .

[11]  L. Hedges.  Estimation of effect size from a series of independent experiments. , 1982 .

[12]  G. Glass.  Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[13]  H. Goldstein,et al.  Meta‐analysis using multilevel models with an application to the study of class size effects , 2000 .

[14]  John R. Stevens,et al.  Hierarchical Dependence in Meta-Analysis , 2009 .

[15]  L. Hedges,et al.  How Large Are Teacher Effects? , 2004 .

[16]  F. Schmidt.  Meta-Analysis , 2008 .

[17]  Anthony S. Bryk,et al.  Toward a More Appropriate Conceptualization of Research on School Effects: A Three-Level Linear Model. , 1988 .

[18]  L. Hedges,et al.  Fixed- and random-effects models in meta-analysis. , 1998 .

[19]  C S Berkey,et al.  Multiple-outcome meta-analysis of clinical trials. , 1996, Statistics in medicine.

[20]  F. Graybill,et al.  Confidence Intervals on Variance Components. , 1993 .

[21]  Nicholas T. Longford,et al.  Random Coefficient Models , 1994, International Encyclopedia of Statistical Science.

[22]  S. Raudenbush,et al.  Examining Correlates of Diversity , 1987 .

[23]  Randall W. Potter,et al.  Confidence intervals on variance components , 1992 .

[24]  N. Longford.  A fast scoring algorithm for maximum likelihood estimation in unbalanced mixed models with nested random effects , 1987 .

[25]  Jeffrey C. Valentine,et al.  The Effects of Modified School Calendars on Student Achievement and on School and Community Attitudes , 2003 .

[26]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[27]  Larry V. Hedges,et al.  A random effects model for effect sizes , 1983 .

[28]  D. Harville.  Matrix Algebra From a Statistician's Perspective , 1998 .

[29]  R. Turner,et al.  Multilevel models for meta-analysis , 2001 .

[30]  Belver C. Griffith,et al.  Scientific communication: Its role in the conduct of research and creation of knowledge. , 1971 .

[31]  S. Konstantopoulos.  An Introduction to Meta–Analysis , 2008 .

[32]  Tom A. B. Snijders,et al.  Multilevel Analysis , 2011, International Encyclopedia of Statistical Science.

[33]  Yuk Fai Cheong,et al.  HLM 6: Hierarchical Linear and Nonlinear Modeling , 2000 .

[34]  J. Gill.  Hierarchical Linear Models , 2005 .

[35]  Gregory Camilli,et al.  Application of a Method of Estimating DIF for Polytomous Test Items , 1999 .