Testing Measurement Invariance Across Unobserved Groups: The Role of Covariates in Factor Mixture Modeling

Factor mixture modeling (FMM) has been increasingly used to investigate unobserved population heterogeneity. This study examined the issue of covariate effects with FMM in the context of measurement invariance testing. Specifically, the impact of excluding and misspecifying covariate effects on measurement invariance testing and class enumeration was investigated via Monte Carlo simulations. Data were generated based on FMM models with (1) a zero covariate effect, (2) a covariate effect on the latent class variable, and (3) covariate effects on both the latent class variable and the factor. For each population model, different analysis models that excluded or misspecified covariate effects were fitted. Results highlighted the importance of including proper covariates in measurement invariance testing and evidenced the utility of a model comparison approach in searching for the correct specification of covariate effects and the level of measurement invariance. This approach was demonstrated using an empirical data set. Implications for methodological and applied research are discussed.

[1]  Daniel W Capron,et al.  Identification of anxiety sensitivity classes and clinical cut-scores in a sample of adult smokers: results from a factor mixture model. , 2014, Journal of anxiety disorders.

[2]  Annette M. Maij-de Meij,et al.  Improvement in Detection of Differential Item Functioning Using a Mixture Item Response Theory Model , 2010, Multivariate behavioral research.

[3]  S. N. Beretvas,et al.  Evaluation of Two Types of Differential Item Functioning in Factor Mixture Models With Binary Outcomes , 2014 .

[4]  Bengt Muthén,et al.  Auxiliary Variables in Mixture Modeling: Three-Step Approaches Using Mplus , 2014 .

[5]  Seang-Hwane Joo,et al.  Measurement Invariance Testing Across Between-Level Latent Classes Using Multilevel Factor Mixture Modeling , 2016 .

[6]  Kevin J. Grimm,et al.  Model Selection in Finite Mixture Models: A k-Fold Cross-Validation Approach , 2017 .

[7]  Laura M. Stapleton,et al.  Differential Item Functioning: A Mixture Distribution Conceptualization , 2002 .

[8]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[9]  B. Muthén,et al.  Investigating population heterogeneity with factor mixture models. , 2005, Psychological methods.

[10]  Katherine E. Masyn,et al.  Covariates and Mixture Modeling: Results of a Simulation Study Exploring the Impact of Misspecified Effects on Class Enumeration , 2016 .

[11]  H. Akaike.  A new look at the statistical model identification , 1974 .

[12]  D. Dimitrov,et al.  Investigating Population Heterogeneity and Interaction Effects of Covariates , 2015 .

[13]  Walter L. Leite,et al.  An evaluation of the use of covariates to assist in class enumeration in linear growth mixture modeling , 2017, Behavior Research Methods.

[14]  M. Neale,et al.  Distinguishing Between Latent Classes and Continuous Factors: Resolution by Maximum Likelihood? , 2006, Multivariate behavioral research.

[15]  F. Túry,et al.  Differentiating the levels of risk for muscle dysmorphia among Hungarian male weightlifters: a factor mixture modeling approach. , 2015, Body image.

[16]  Daniel J. Bauer.  Observations on the Use of Growth Mixture Models in Psychological Research , 2007 .

[17]  Jeroen K. Vermunt,et al.  Latent Class Modeling with Covariates: Two Improved Three-Step Approaches , 2010, Political Analysis.

[18]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[19]  Stefany Coxe,et al.  Statistical Power to Detect the Correct Number of Classes in Latent Profile Analysis , 2013, Structural equation modeling : a multidisciplinary journal.

[20]  Yan Wang,et al.  Measurement Invariance Testing with Many Groups: A Comparison of Five Approaches , 2017 .

[21]  J. Vermunt,et al.  Modeling Predictors of Latent Classes in Regression Mixture Models , 2016, Structural equation modeling : a multidisciplinary journal.

[22]  E. S. Kim,et al.  Investigating Sources of Heterogeneity with Three-Step Multilevel Factor Mixture Modeling: Beyond Testing Measurement Invariance in Cross-National Studies , 2018, Structural Equation Modeling: A Multidisciplinary Journal.

[23]  B. Muthén,et al.  Models and Strategies for Factor Mixture Analysis: An Example Concerning the Structure Underlying Psychological Disorders , 2013, Structural equation modeling : a multidisciplinary journal.

[24]  Xitao Fan,et al.  Enumeration Index Performance in Generalized Growth Mixture Models: A Monte Carlo Test of Muthén’s (2003) Hypothesis , 2015 .

[25]  Allan S. Cohen,et al.  A Multilevel Mixture IRT Model With an Application to DIF , 2010 .

[26]  D. Rubin,et al.  Testing the number of components in a normal mixture , 2001 .

[27]  H. Bozdogan.  Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions , 1987 .

[28]  Chih-Chien Yang,et al.  Evaluating latent class analysis models in qualitative phenotype identification , 2006, Comput. Stat. Data Anal..

[29]  B. Muthén,et al.  Deciding on the Number of Classes in Latent Class Analysis and Growth Mixture Modeling: A Monte Carlo Simulation Study , 2007 .

[30]  Gitta Lubke,et al.  Distinguishing Between Latent Classes and Continuous Factors with Categorical Outcomes: Class Invariance of Parameters of Factor Mixture Models , 2008, Multivariate behavioral research.

[31]  J. Cassady,et al.  Using factor mixture modeling to identify dimensions of cognitive test anxiety , 2015 .

[32]  Ulman Lindenberger,et al.  Structural equation model trees. , 2013, Psychological methods.

[33]  Laurenz L. Meier,et al.  Testing Job Typologies and Identifying At-Risk Subpopulations Using Factor Mixture Models , 2017, Journal of occupational health psychology.

[34]  Bengt Muthén,et al.  Latent Variable Analysis: Growth Mixture Modeling and Related Techniques for Longitudinal Data , 2004 .

[35]  Justin W. Weeks,et al.  Should health anxiety be carved at the joint? A look at the health anxiety construct using factor mixture modeling in a non-clinical sample. , 2012, Journal of anxiety disorders.

[36]  P. Deb.  Finite Mixture Models , 2008 .

[37]  Daniel A. Newman,et al.  Using Mixed-Measurement Item Response Theory With Covariates (MM-IRT-C) to Ascertain Observed and Unobserved Measurement Equivalence , 2011 .

[38]  John J McArdle,et al.  A Comparison of Methods for Uncovering Sample Heterogeneity: Structural Equation Model Trees and Finite Mixture Models , 2017, Structural equation modeling : a multidisciplinary journal.

[39]  S. Chong,et al.  Latent structure of psychosis in the general population: results from the Singapore Mental Health Study , 2013, Psychological Medicine.

[40]  P. Hyland,et al.  The Complexity of Trauma Exposure and Response: Profiling PTSD and CPTSD Among a Refugee Sample , 2019, Psychological trauma : theory, research, practice and policy.

[41]  A New Perspective on the Effects of Covariates in Mixture Models , 2018 .

[42]  Daniel J Bauer,et al.  The integration of continuous and discrete latent variable models: potential problems and promising opportunities. , 2004, Psychological methods.

[43]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[44]  S. Sclove.  Application of model-selection criteria to some problems in multivariate analysis , 1987 .

[45]  J. Elhai,et al.  Heterogeneity in clinical presentations of posttraumatic stress disorder among medical patients: testing factor structure variation using factor mixture modeling. , 2011, Journal of traumatic stress.

[46]  S. Reise,et al.  Detecting Mixtures From Structural Model Differences Using Latent Variable Mixture Modeling: A Comparison of Relative Model Fit Statistics , 2007 .

[47]  T. Stickle,et al.  Factor mixture model of anxiety sensitivity and anxiety psychopathology vulnerability. , 2013, Journal of affective disorders.

[48]  E. S. Kim,et al.  Testing Measurement Invariance: A Comparison of Multiple-Group Categorical CFA and IRT , 2011 .

[49]  Eldad Davidov,et al.  Using a Multilevel Structural Equation Modeling Approach to Explain Cross-Cultural Measurement Noninvariance , 2012 .

[50]  C. Lejuez,et al.  Examining the latent structure of anxiety sensitivity in adolescents using factor mixture modeling. , 2014, Psychological assessment.

[51]  B. Muthén,et al.  Performance of Factor Mixture Models as a Function of Model Size, Covariate Effects, and Class-Specific Parameters. , 2007 .

[52]  Yan Wang,et al.  Reconsidering Multilevel Latent Class Models: Can Level-2 Latent Classes Affect Item Response Probabilities? , 2020, The Journal of Experimental Education.

[53]  Jeroen K. Vermunt,et al.  Determining the Number of Components in Mixture Models for Hierarchical Data , 2008, GfKl.

[54]  Suzanne Jak,et al.  A Test for Cluster Bias: Detecting Violations of Measurement Invariance Across Clusters in Multilevel Data , 2013 .

[55]  M. Wedel,et al.  Finite mixture models. Review, applications and computer-intensive methods , 2000 .