Multilevel Mediation Modeling in Group-Based Intervention Studies

This article proposes and evaluates a method to test for mediation in multilevel data sets formed when an intervention administered to intact groups is designed to produce change in individual mediator and outcome variables. Simulated data of this form were used to compare ordinary least squares (OLS) and two multilevel estimators of the mediated effect. OLS and multilevel standard error approximations were also evaluated and recommendations given for optimal estimator choice. These methods were applied to data from an existing substance use intervention to show the impact multilevel mediation modeling can have on the conclusions drawn from real-world evaluation studies.

[1]  L. A. Goodman.  On the Exact Variance of Products , 1960 .

[2]  Brent R. Moulton.  Random group effects and the precision of regression estimates , 1986 .

[3]  Ita G. G. Kreft.  The interactive effect of alcohol prevention programs in high school classes: An illustration of item homogeneity scaling and multilevel analysis techniques. , 1997 .

[4]  G. Kok,et al.  A Dutch social influence smoking prevention approach for vocational school students , 1994 .

[5]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[6]  Jan de Leeuw,et al.  Introducing Multilevel Modeling , 1998 .

[7]  I G Kreft.  Multilevel models for hierarchically nested data: potential applications in substance abuse prevention research. , 1994, NIDA research monograph.

[8]  Franklin A. Graybill,et al.  Introduction to the Theory of Statistics, 3rd ed. , 1974 .

[9]  E. A. Haggard,et al.  Intraclass Correlation and the Analysis of Variance , 1958 .

[10]  C. Perry,et al.  Results from a statewide approach to adolescent tobacco use prevention. , 1992, Preventive medicine.

[11]  D. Mackinnon,et al.  Estimating Mediated Effects in Prevention Studies , 1993 .

[12]  E. Pedhazur.  Multiple Regression in Behavioral Research: Explanation and Prediction , 1982 .

[13]  D. Hedeker,et al.  Random-effects regression models for clustered data with an example from smoking prevention research. , 1994, Journal of consulting and clinical psychology.

[14]  M. Sobel.  Some New Results on Indirect Effects and Their Standard Errors in Covariance Structure Models , 1986 .

[15]  J. Wolfowitz,et al.  An Introduction to the Theory of Statistics , 1951, Nature.

[16]  Stephen M. Scariano,et al.  The effects of violations of independence assumptions in the one-way ANOVA , 1987 .

[17]  J. Walsh.  Concerning the Effect of Intraclass Correlation on Certain Significance Tests , 1947 .

[18]  A. Scott,et al.  The Effect of Two-Stage Sampling on Ordinary Least Squares Methods , 1982 .

[19]  E. A. Haggard.  Intraclass correlation and the analysis of variance. , 1960 .

[20]  D. Mackinnon,et al.  A Simulation Study of Mediated Effect Measures. , 1995, Multivariate behavioral research.

[21]  D. Mackinnon,et al.  Mediating mechanisms in a school-based drug prevention program: first-year effects of the Midwestern Prevention Project. , 1991, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[22]  Walter W. Hauck,et al.  A Survey regarding the Reporting of Simulation Studies , 1984 .

[23]  D. Mackinnon,et al.  Effects of a multidimensional anabolic steroid prevention intervention. The Adolescents Training and Learning to Avoid Steroids (ATLAS) Program. , 1996, JAMA.

[24]  Kreft Ig,et al.  Multilevel models for hierarchically nested data: potential applications in substance abuse prevention research. , 1994 .

[25]  Michael Windle,et al.  The science of prevention: methodological advances from alcohol and substance abuse research. , 1997 .

[26]  Robert S. Barcikowski,et al.  Statistical Power with Group Mean as the Unit of Analysis , 1981 .

[27]  A. Vinokur,et al.  Mastery and inoculation against setbacks as active ingredients in the JOBS intervention for the unemployed. , 1997, Journal of consulting and clinical psychology.

[28]  Lillian Cohen,et al.  Statistical Methods for Social Scientists. , 1954 .

[29]  M. Sobel.  Asymptotic Confidence Intervals for Indirect Effects in Structural Equation Models , 1982 .