Effects of skewness and kurtosis on normal-theory based maximum likelihood test statistic in multilevel structural equation modeling

A simulation study investigated the effects of skewness and kurtosis on level-specific maximum likelihood (ML) test statistics based on normal theory in multilevel structural equation models. The levels of skewness and kurtosis at each level were manipulated in multilevel data, and the effects of skewness and kurtosis on level-specific ML test statistics were examined. When the assumption of multivariate normality was violated, the level-specific ML test statistics were inflated, resulting in Type I error rates that were higher than the nominal level for the correctly specified model. Q-Q plots of the test statistics against a theoretical chi-square distribution showed that skewness led to a thicker upper tail and kurtosis led to a longer upper tail of the observed distribution of the level-specific ML test statistic for the correctly specified model.

[1]  L. T. DeCarlo.  On the meaning and use of kurtosis. , 1997 .

[2]  Ke-Hai Yuan,et al.  Asymptotic robustness of standard errors in multilevel structural equation models , 2006 .

[3]  Wei Zhang,et al.  The Effect of Skewness and Kurtosis on Mean and Covariance Structure Analysis , 2005 .

[4]  Sik-Yum Lee,et al.  Multilevel analysis of structural equation models , 1990 .

[5]  Jiajuan Liang,et al.  An EM algorithm for fitting two-level structural equation models , 2004 .

[6]  B. Muthén,et al.  Multilevel Covariance Structure Analysis , 1994 .

[7]  Drake R. Bradley,et al.  Generating multivariate data from nonnormal distributions: Mihal and Barrett revisited , 1994 .

[8]  R. Hoyle.  Structural equation modeling: concepts, issues, and applications , 1997 .

[9]  Timothy J. Robinson,et al.  Multilevel Analysis: Techniques and Applications , 2002 .

[10]  Ehri Ryu,et al.  Level-Specific Evaluation of Model Fit in Multilevel Structural Equation Modeling , 2009 .

[11]  Ke-Hai Yuan,et al.  On normal theory based inference for multilevel models with distributional violations , 2002 .

[12]  Ke-Hai Yuan,et al.  3. Multilevel Covariance Structure Analysis by Fitting Multiple Single-Level Models , 2007 .

[13]  R. D'Agostino,et al.  A Suggestion for Using Powerful and Informative Tests of Normality , 1990 .

[14]  Ke-Hai Yuan,et al.  Eight test statistics for multilevel structural equation models , 2003, Comput. Stat. Data Anal..

[15]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .

[16]  S. West,et al.  The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. , 1996 .

[17]  A. Satorra,et al.  Complex Sample Data in Structural Equation Modeling , 1995 .

[18]  Jiajuan Liang,et al.  Two-level Mean and Covariance Structures: Maximum Likelihood via an EM Algorithm , 2011 .

[19]  Pandu R. Tadikamalla,et al.  A Probability Distribution and its Uses in Fitting Data , 1979 .

[20]  D. Wright,et al.  Problematic standard errors and confidence intervals for skewness and kurtosis , 2011, Behavior research methods.

[21]  Wynne W. Chin,et al.  Generating Non-normal Data for Simulation of Structural Equation Models Using Mattson's Method , 2002 .

[22]  R. Gnanadesikan,et al.  Probability plotting methods for the analysis of data. , 1968, Biometrika.

[23]  Naihua Duan,et al.  Multilevel Modeling : Methodological Advances, Issues, and Applications , 2003 .

[24]  K. Bollen.  Latent variables in psychology and the social sciences. , 2002, Annual review of psychology.

[25]  Nicholas T. Longford,et al.  Factor analysis for clustered observations , 1992 .

[26]  R. MacCallum,et al.  Applications of structural equation modeling in psychological research. , 2000, Annual review of psychology.

[27]  Harvey Goldstein,et al.  A general model for the analysis of multilevel data , 1988 .

[28]  P. Bentler.  MULTIVARIATE ANALYSIS WITH LATENT VARIABLES: CAUSAL MODELING , 1980 .

[29]  K. Jöreskog.  Structural analysis of covariance and correlation matrices , 1978 .

[30]  J. Hox.  Multilevel analysis: Techniques and applications, 2nd ed. , 2010 .

[31]  Bengt Muthén,et al.  Mean and Covariance Structure Analysis of Hierarchical Data , 2011 .