A general multilevel SEM framework for assessing multilevel mediation.

Several methods for testing mediation hypotheses with 2-level nested data have been proposed by researchers using a multilevel modeling (MLM) paradigm. However, these MLM approaches do not accommodate mediation pathways with Level-2 outcomes and may produce conflated estimates of between- and within-level components of indirect effects. Moreover, these methods have each appeared in isolation, so a unified framework that integrates the existing methods, as well as new multilevel mediation models, is lacking. Here we show that a multilevel structural equation modeling (MSEM) paradigm can overcome these 2 limitations of mediation analysis with MLM. We present an integrative 2-level MSEM mathematical framework that subsumes new and existing multilevel mediation approaches as special cases. We use several applied examples and accompanying software code to illustrate the flexibility of this framework and to show that different substantive conclusions can be drawn using MSEM versus MLM.

[1]  C. Stein,et al.  Structural equation modeling. , 2012, Methods in molecular biology.

[2]  Jiajuan Liang,et al.  Two-level Mean and Covariance Structures: Maximum Likelihood via an EM Algorithm , 2011 .

[3]  Jan de Leeuw,et al.  The Effects of Different Forms of Centering in Hierarchical Linear Models , 2011 .

[4]  Bengt Muthén,et al.  Mean and Covariance Structure Analysis of Hierarchical Data , 2011 .

[5]  Craig K. Enders,et al.  Specification Searches in Multilevel Structural Equation Modeling: A Monte Carlo Investigation , 2010 .

[6]  Ehri Ryu,et al.  Level-Specific Evaluation of Model Fit in Multilevel Structural Equation Modeling , 2009 .

[7]  Daniel L. Murphy,et al.  Three-Level Models for Indirect Effects in School- and Class-Randomized Experiments in Education , 2009 .

[8]  R. Millsap,et al.  The SAGE Handbook of Quantitative Methods in Psychology , 2009 .

[9]  Jeroen K. Vermunt,et al.  Composing Group-Level Constructs From Individual-Level Survey Data , 2009 .

[10]  Jaak Billiet,et al.  A Monte Carlo sample size study: How many countries are needed for accurate multilevel SEM? , 2009 .

[11]  David P. Lepak,et al.  THROUGH THE LOOKING GLASS OF A SOCIAL SYSTEM: CROSS‐LEVEL EFFECTS OF HIGH‐PERFORMANCE WORK SYSTEMS ON EMPLOYEES’ ATTITUDES , 2009 .

[12]  Ann Yan Zhang,et al.  Explaining employment relationships with social exchange and job embeddedness. , 2009, The Journal of applied psychology.

[13]  Scott L. Thomas,et al.  An introduction to multilevel modeling techniques, 2nd ed. , 2009 .

[14]  Jee-Seon Kim,et al.  Multilevel latent variable modeling: Current research and recent developments. , 2009 .

[15]  J. Belsky,et al.  Parents, parenting, and children's sleep problems: Exploring reciprocal effects , 2008 .

[16]  B. Muthén,et al.  The multilevel latent covariate model: a new, more reliable approach to group-level effects in contextual studies. , 2008, Psychological methods.

[17]  Kristopher J Preacher,et al.  Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models , 2008, Behavior research methods.

[18]  Cheri A. Vogel,et al.  Family Resources and Parenting Quality: Links to Children's Cognitive Development across the First 3 Years Integrating Developmental and Economic Perspectives , 2022 .

[19]  Laura M. Stapleton,et al.  The Performance of Methods to Test Upper-Level Mediation in the Presence of Nonnormal Data , 2008, Multivariate behavioral research.

[20]  JoAnn Robinson,et al.  Reciprocal influences in children's and families' adaptation to early childhood wheezing. , 2008, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[21]  D. Mackinnon.  Introduction to Statistical Mediation Analysis , 2008 .

[22]  D. Hofmann.  Issues in Multilevel Research: Theory Development, Measurement, and Analysis , 2008 .

[23]  David P Mackinnon,et al.  Resampling and Distribution of the Product Methods for Testing Indirect Effects in Complex Models , 2008, Structural equation modeling : a multidisciplinary journal.

[24]  B. Muthén,et al.  Growth mixture modeling , 2008 .

[25]  Zhen Zhang,et al.  TESTING MULTILEVEL MEDIATION USING HIERARCHICAL LINEAR MODELS: PROBLEMS AND SOLUTIONS. , 2008 .

[26]  Andrew F. Hayes,et al.  The Sage sourcebook of advanced data analysis methods for communication research , 2008 .

[27]  Noel A. Card,et al.  Latent variable structural equation modeling in cross-cultural research: Multigroup and multilevel approaches , 2008 .

[28]  T Asparouhov,et al.  Muthén, B., & Growth mixture analysis: Analysis with non-Gaussian random effects. , 2008 .

[29]  D. Dunson.  Random effect and latent variable model selection , 2008 .

[30]  P. Bentler,et al.  A Unified Approach to Two-Level Structural Equation Models and Linear Mixed Effects Models , 2008 .

[31]  Ann A. O'Connell,et al.  Multilevel modeling of educational data , 2008 .

[32]  Peter A. Bamberger,et al.  Firefighters, critical incidents, and drinking to cope: the adequacy of unit-level performance resources as a source of vulnerability and protection. , 2008, The Journal of applied psychology.

[33]  Andrew F. Hayes,et al.  Contemporary approaches to assessing mediation in communication research. , 2008 .

[34]  Ehri Ryu,et al.  Evaluation of model fit in multilevel structural equation modeling: Level -specific model fit evaluation and the robustness to non -normality , 2008 .

[35]  T. Raykov,et al.  Lower Level Mediation Effect Analysis in Two-Level Studies: A Note on a Multilevel Structural Equation Modeling Approach , 2007 .

[36]  G. Dagne,et al.  Hierarchical modeling of sequential behavioral data: examining complex association patterns in mediation models. , 2007, Psychological methods.

[37]  Ke-Hai Yuan,et al.  3. Multilevel Covariance Structure Analysis by Fitting Multiple Single-Level Models , 2007 .

[38]  Matthew S. Fritz,et al.  Distribution of the product confidence limits for the indirect effect: Program PRODCLIN , 2007, Behavior research methods.

[39]  K. Pituch,et al.  Multivariate Hierarchical Linear Modeling in Randomized Field Experiments , 2007 .

[40]  Craig K. Enders,et al.  Centering predictor variables in cross-sectional multilevel models: a new look at an old issue. , 2007, Psychological methods.

[41]  John E. Mathieu,et al.  A Multilevel Investigation of the Influences of Employees' Resistance to Empowerment , 2007 .

[42]  James A. Bovaird.  Multilevel Structural Equation Models for Contextual Factors , 2007 .

[43]  James A. Bovaird,et al.  Modeling contextual effects in longitudinal studies , 2007 .

[44]  J. Edwards,et al.  Methods for integrating moderation and mediation: a general analytical framework using moderated path analysis. , 2007, Psychological methods.

[45]  M. Croon,et al.  Predicting group-level outcome variables from variables measured at the individual level: a latent variable multilevel model. , 2007, Psychological methods.

[46]  J. Mathieu,et al.  A framework for testing meso‐mediational relationships in Organizational Behavior , 2007 .

[47]  Bengt Muthén,et al.  Constructing Covariates in Multilevel Regression , 2007 .

[48]  B. Muthén,et al.  Computationally Efficient Estimation of Multilevel High-Dimensional Latent Variable Models , 2007 .

[49]  Charles E. McCulloch,et al.  Separating between‐ and within‐cluster covariate effects by using conditional and partitioning methods , 2006 .

[50]  Laura M. Stapleton,et al.  A Comparison of Single Sample and Bootstrap Methods to Assess Mediation in Cluster Randomized Trials , 2006, Multivariate behavioral research.

[51]  Daniel J. Bauer,et al.  Conceptualizing and testing random indirect effects and moderated mediation in multilevel models: new procedures and recommendations. , 2006, Psychological methods.

[52]  Donald Hedeker,et al.  Longitudinal Data Analysis , 2006 .

[53]  P. Atzberger.  The Monte-Carlo Method , 2006 .

[54]  Mike W.-L. Cheung,et al.  Applications of Multilevel Structural Equation Modeling to Cross-Cultural Research , 2005 .

[55]  Michael C Neale,et al.  People are variables too: multilevel structural equations modeling. , 2005, Psychological methods.

[56]  G. V. D. Vegt,et al.  Learning and performance in multidisciplinary teams: The importance of collective team identification , 2005 .

[57]  Stan Lipovetsky,et al.  Generalized Latent Variable Modeling: Multilevel,Longitudinal, and Structural Equation Models , 2005, Technometrics.

[58]  Ke-Hai Yuan,et al.  On muthén’s maximum likelihood for two-level covariance structure models , 2005 .

[59]  Risto Lehtonen,et al.  Multilevel Statistical Models , 2005 .

[60]  Laura M. Stapleton,et al.  A Comparison of Methods to Test for Mediation in Multisite Experiments , 2005, Multivariate behavioral research.

[61]  Kristopher J Preacher,et al.  SPSS and SAS procedures for estimating indirect effects in simple mediation models , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[62]  S. Rabe-Hesketh,et al.  Generalized multilevel structural equation modeling , 2004 .

[63]  Michael D. Ensley,et al.  A reciprocal and longitudinal investigation of the innovation process: the central role of shared vision in product and process innovation teams (PPITs) , 2004 .

[64]  Jiajuan Liang,et al.  An EM algorithm for fitting two-level structural equation models , 2004 .

[65]  David P Mackinnon,et al.  Confidence Limits for the Indirect Effect: Distribution of the Product and Resampling Methods , 2004, Multivariate behavioral research.

[66]  Steven G. Rogelberg,et al.  Handbook of research methods in industrial and organizational psychology , 2004 .

[67]  Ke-Hai Yuan,et al.  Eight test statistics for multilevel structural equation models , 2003, Comput. Stat. Data Anal..

[68]  Patrick J Curran,et al.  Have Multilevel Models Been Structural Equation Models All Along? , 2003, Multivariate behavioral research.

[69]  Daniel J. Bauer.  Estimating Multilevel Linear Models as Structural Equation Models , 2003 .

[70]  D. A. Kenny,et al.  Lower Level Mediation in Multilevel Models , 2022 .

[71]  David P Mackinnon,et al.  Investigation of Mediational Processes Using Parallel Process Latent Growth Curve Modeling , 2003, Structural equation modeling : a multidisciplinary journal.

[72]  Naihua Duan,et al.  Multilevel Modeling : Methodological Advances, Issues, and Applications , 2003 .

[73]  P. Shrout,et al.  Mediation in experimental and nonexperimental studies: new procedures and recommendations. , 2002, Psychological methods.

[74]  Y. Poortinga,et al.  Structural Equivalence in Multilevel Research , 2002 .

[75]  S. West,et al.  A comparison of methods to test mediation and other intervening variable effects. , 2002, Psychological methods.

[76]  Kamel Jedidi,et al.  Heterogeneous factor analysis models: A bayesian approach , 2002 .

[77]  D. A. Kenny,et al.  The statistical analysis of data from small groups. , 2002, Journal of personality and social psychology.

[78]  S Y Lee,et al.  Hypothesis Testing and Model Comparison in Two-level Structural Equation Models , 2001, Multivariate behavioral research.

[79]  M. Julian.  The Consequences of Ignoring Multilevel Data Structures in Nonhierarchical Covariance Modeling , 2001 .

[80]  D. Mackinnon,et al.  Multilevel Modeling of Individual and Group Level Mediated Effects , 2001, Multivariate behavioral research.

[81]  Cora J. M. Maas,et al.  The Accuracy of Multilevel Structural Equation Modeling With Pseudobalanced Groups and Small Samples , 2001 .

[82]  Ronald H. Heck,et al.  Multilevel Modeling With SEM , 2001 .

[83]  G. A. Marcoulides,et al.  New developments and techniques in structural equation modeling , 2001 .

[84]  Amy Buhl Conn,et al.  Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment. , 2001, The Journal of applied psychology.

[85]  Linda M. Collins,et al.  New methods for the analysis of change , 2001 .

[86]  Peter C. M. Molenaar,et al.  A structural equations modeling approach to the general linear mixed model , 2001 .

[87]  D. Hofmann.  An Overview of the Logic and Rationale of Hierarchical Linear Models , 1997 .

[88]  Kamel Jedidi,et al.  A Hierarchical Bayesian Methodology for Treating Heterogeneity in Structural Equation Models , 2000 .

[89]  B. Leroux,et al.  Between-subject and within-subject Statistical Information in Dental Research , 2000, Journal of dental research.

[90]  G. V. D. Vegt,et al.  Team Members’ Affective Responses to Patterns of Intragroup Interdependence and Job Complexity , 2000 .

[91]  S. Kozlowski,et al.  From Micro to Meso: Critical Steps in Conceptualizing and Conducting Multilevel Research , 2000 .

[92]  S. Kozlowski,et al.  Multilevel Theory, Research, and Methods in Organizations: Foundations, Extensions, and New Directions , 2000 .

[93]  A. Pruyn,et al.  THE IMPACT OF EMPLOYEE COMMUNICATION AND PERCEIVED EXTERNAL PRESTIGE ON ORGANIZATIONAL IDENTIFICATION , 2000 .

[94]  M J Rovine,et al.  A Structural Modeling Approach to a Multilevel Random Coefficients Model , 2000, Multivariate behavioral research.

[95]  Todd D. Little,et al.  A Two-Stage Approach to Multilevel Structural Equation Models: Application to Longitudinal Data , 2000 .

[96]  D. Mackinnon.  Contrasts in multiple mediator models. , 2000 .

[97]  P. Bliese.  Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. , 2000 .

[98]  Jürgen Baumert,et al.  Modeling longitudinal and multilevel data: Practical issues, applied approaches, and specific examples. , 2000 .

[99]  S. Kozlowski,et al.  Multilevel Theory, Research, a n d M e t h o d s i n Organizations Foundations, Extensions, and New Directions , 2022 .

[100]  Sik-Yum Lee,et al.  Constrained maximum likelihood estimation of two-level covariance structure model via EM type algorithms , 1999 .

[101]  S. Raudenbush,et al.  Assessing Direct and Indirect Effects in Multilevel Designs with Latent Variables , 1999 .

[102]  Ronald H. Heck,et al.  An Introduction to Multilevel Modeling Techniques , 1999 .

[103]  D P MacKinnon,et al.  Multilevel Mediation Modeling in Group-Based Intervention Studies , 1999, Evaluation review.

[104]  A. Bandura.  Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[105]  Roel Bosker,et al.  Multilevel analysis : an introduction to basic and advanced multilevel modeling , 1999 .

[106]  David A. Hofmann,et al.  Centering Decisions in Hierarchical Linear Models: Implications for Research in Organizations , 1998 .

[107]  Peter C. M. Molenaar,et al.  A Nonstandard Method for Estimating a Linear G rowth Model in LISREL , 1998 .

[108]  A. Raftery,et al.  Sociological Methodology 1997 , 1998 .

[109]  J. Kalbfleisch,et al.  Between- and within-cluster covariate effects in the analysis of clustered data. , 1998, Biometrics.

[110]  D. Chan.  Functional Relations among Constructs in the Same Content Domain at Different Levels of Analysis: A Typology of Composition Models , 1998 .

[111]  A. Diez-Roux,et al.  Bringing context back into epidemiology: variables and fallacies in multilevel analysis. , 1998, American journal of public health.

[112]  D. A. Kenny,et al.  Data analysis in social psychology. , 1998 .

[113]  Jan de Leeuw,et al.  Introducing Multilevel Modeling , 1998 .

[114]  Wai-Yin Poon,et al.  ANALYSIS OF TWO-LEVEL STRUCTURAL EQUATION MODELS VIA EM TYPE ALGORITHMS , 1998 .

[115]  Mark A. Griffin,et al.  Interaction Between Individuals and Situations: Using HLM Procedures to Estimate Reciprocal Relationships , 1997 .

[116]  David Kaplan,et al.  A Model-Based Approach to Validating Education Indicators Using Multilevel Structural Equation Modeling , 1997 .

[117]  David Kaplan,et al.  A didactic example of multilevel structural equation modeling applicable to the study of organizations , 1997 .

[118]  G. A. Marcoulides,et al.  Advanced structural equation modeling : issues and techniques , 1996 .

[119]  John J. McArdle,et al.  Multilevel Models From a Multiple Group Structural Equation Perspective , 1996 .

[120]  D. Mackinnon,et al.  A Simulation Study of Mediated Effect Measures. , 1995, Multivariate behavioral research.

[121]  I G Kreft,et al.  The Effect of Different Forms of Centering in Hierarchical Linear Models. , 1995, Multivariate behavioral research.

[122]  A. Satorra,et al.  Complex Sample Data in Structural Equation Modeling , 1995 .

[123]  K. Klein,et al.  Levels Issues in Theory Development, Data Collection, and Analysis , 1994 .

[124]  B. Muthén,et al.  Multilevel Covariance Structure Analysis , 1994 .

[125]  Roderick P. McDonald,et al.  The Bilevel Reticular Action Model for Path Analysis with Latent Variables , 1994 .

[126]  Roderick P. McDonald,et al.  A general model for two-level data with responses missing at random , 1993 .

[127]  Paul R. Yost,et al.  Potency in groups: articulating a construct. , 1993, The British journal of social psychology.

[128]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[129]  Stephen W. Raudenbush,et al.  A Multilevel, Multivariate Model for Studying School Climate With Estimation Via the EM Algorithm and Application to U.S. High-School Data , 1991 .

[130]  Bengt Muthén,et al.  Multilevel Factor Analysis of Class and Student Achievement Components , 1991 .

[131]  Harvey Goldstein,et al.  Balanced versus unbalanced designs for linear structural relations in two‐level data , 1989 .

[132]  B. Muthén.  Latent variable modeling in heterogeneous populations , 1989 .

[133]  H. Goldstein,et al.  Multilevel Models in Educational and Social Research. , 1989 .

[134]  Harvey Goldstein,et al.  A general model for the analysis of multilevel data , 1988 .

[135]  Glenn Firebaugh,et al.  Sociological Methodology 1986. , 1988 .

[136]  Harvey Goldstein,et al.  Multilevel Models in Education and Social Research , 1987 .

[137]  Kenneth A. Bollen,et al.  Total, Direct, and Indirect Effects in Structural Equation Models , 1987 .

[138]  Robert Tibshirani,et al.  Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy , 1986 .

[139]  M. Sobel.  Some New Results on Indirect Effects and Their Standard Errors in Covariance Structure Models , 1986 .

[140]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[141]  D. A. Kenny,et al.  Separating individual and group effects , 1985 .

[142]  D. Rousseau.  Issues of level in organizational research: Multi-level and cross-level perspectives. , 1985 .

[143]  Floyd J. Fowler,et al.  Survey Research Methods , 1984 .

[144]  K. Sirotnik.  PSYCHOMETRIC IMPLICATIONS OF THE UNIT‐OF‐ANALYSIS PROBLEM (WITH EXAMPLES FROM THE MEASUREMENT OF ORGANIZATIONAL CLIMATE) , 1980 .

[145]  H. Blalock.  The Presidential Address: Measurement and Conceptualization Problems: The Major Obstacle to Integrating Theory and Research , 1979 .

[146]  Kjell Harnqvist,et al.  Primary Mental Abilities at Collective and Individual Levels. , 1978 .

[147]  Glenn Firebaugh,et al.  A Rule for Inferring Individual-Level Relationships from Aggregate Data , 1978 .

[148]  Kjell H rnqvist.  Primary Mental Abilities at collective and individual levels. , 1978 .

[149]  Lee J. Cronbach,et al.  Research on Classrooms and Schools: Formulation of Questions, Design and Analysis. , 1976 .

[150]  Noreen M. Webb,et al.  Between-class and within-class effects in a reported aptitude * treatment interaction: Reanalysis of a study by G. L. Anderson. , 1975 .

[151]  H. Alker.  A typology of ecological fallacies , 1969 .

[152]  R. Q. Bell.  A reinterpretation of the direction of effects in studies of socialization. , 1968, Psychological review.

[153]  Grice Gr.  Dependence of empirical laws upon the source of experimental variation. , 1966 .

[154]  G R Grice,et al.  Dependence of empirical laws upon the source of experimental variation. , 1966, Psychological bulletin.

[155]  S. Fiske,et al.  The Handbook of Social Psychology , 1935 .