Performance of Modified Test Statistics in Covariance and Correlation Structure Analysis Under Conditions of Multivariate Nonnormality

Questions of whether hypothesized structure models are appropriate representations of the pattern of association among a group of variables can be addressed using a wide variety of statistical procedures. These procedures include covariance structure analysis techniques and correlation structure analysis techniques, in which covariance structure procedures are based on distribution theory for covariances, and correlation structure procedures are based on distribution theory for correlations. The present article provides an overview of standard and modified normal theory and asymptotically distribution-free covariance and correlation structure analysis techniques and also details Monte Carlo simulation results on the Type I and Type II error control as a function of structure model type, number of variables in the model, sample size, and distributional nonnormality. The present Monte Carlo simulation demonstrates clearly that the robustness and nonrobustness of structure analysis techniques vary as a function of the structure of the model and the data conditions. Implications of these results for users of structure analysis techniques are considered in the context of current software availability.

[1]  Francis Galton,et al.  Natural inheritance. By Francis Galton. , 1889 .

[2]  Robert Cudeck,et al.  Constructing a covariance matrix that yields a specified minimizer and a specified minimum discrepancy function value , 1992 .

[3]  R. McDonald,et al.  Testing pattern hypotheses for correlation matrices , 1975 .

[4]  M. Browne Asymptotically distribution-free methods for the analysis of covariance structures. , 1984, The British journal of mathematical and statistical psychology.

[5]  Ke-Hai Yuan,et al.  Mean and Covariance Structure Analysis: Theoretical and Practical Improvements , 1997 .

[6]  Ab Mooijaart A note on computational efficiency in asymptotically distribution-free correlational models , 1985 .

[7]  T. Micceri The unicorn, the normal curve, and other improbable creatures. , 1989 .

[8]  Y Kano,et al.  Can test statistics in covariance structure analysis be trusted? , 1992, Psychological bulletin.

[9]  M. Bartlett TESTS OF SIGNIFICANCE IN FACTOR ANALYSIS , 1950 .

[10]  J. S. Tanaka,et al.  A general coefficient of determination for covariance structure models under arbitrary GLS estimation , 1989 .

[11]  P. Bentler,et al.  A Note on Using and Unbiased Weight Matrix in the ADF Test Statistic. , 1995, Multivariate behavioral research.

[12]  M. Browne Robustness of statistical inference in factor analysis and related models , 1987 .

[13]  R. Fouladi Type I Error Control of Normal Theory and Asymptotically Distribution Free Correlation Structure Analysis Techniques under Conditions of Multivariate Nonnormality: Testing Correlation Pattern Hypotheses. , 1998 .

[14]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[15]  K. Pearson Contributions to the Mathematical Theory of Evolution. II. Skew Variation in Homogeneous Material , 1895 .

[16]  J. H. Steiger Tests for comparing elements of a correlation matrix. , 1980 .

[17]  J. S. Tanaka "How Big Is Big Enough?": Sample Size and Goodness of Fit in Structural Equation Models with Latent Variables. , 1987 .

[18]  A. Shapiro,et al.  On the multivariate asymptotic distribution of sequential Chi-square statistics , 1985 .

[19]  Roderick P. McDonald,et al.  Testing pattern hypotheses for covariance matrices , 1974 .

[20]  Robert S. Barcikowski,et al.  The Number of Iterations in Monte Carlo Studies of Robustness. , 1988 .

[21]  Michael W. Browne,et al.  Topics in Applied Multivariate Analysis: COVARIANCE STRUCTURES , 1982 .

[22]  James L. Arbuckle AMOS: Analysis of Moment Structures , 1989 .

[23]  A. Shapiro,et al.  Robustness of normal theory methods in the analysis of linear latent variate models. , 1988 .

[24]  C. D. Vale,et al.  Simulating multivariate nonnormal distributions , 1983 .

[25]  A. Satorra Alternative test criteria in covariance structure analysis: A unified approach , 1989 .

[26]  J. H. Steiger,et al.  A historical note on the asymptotic distribution of correlations , 1983 .

[27]  A. Shapiro Asymptotic Theory of Overparameterized Structural Models , 1986 .

[28]  T. W. Anderson,et al.  The asymptotic normal distribution of estimators in factor analysis under general conditions , 1988 .

[29]  A. Satorra,et al.  Scaled test statistics and robust standard errors for non-normal data in covariance structure analysis: a Monte Carlo study. , 1991, The British journal of mathematical and statistical psychology.

[30]  J. KARLG. STRUCTURAL ANALYSIS OF COVARIANCE AND CORRELATION MATRICES , 2000 .

[31]  Karl G. Jöreskog,et al.  Lisrel 8: User's Reference Guide , 1997 .

[32]  A. Satorra,et al.  Power of the likelihood ratio test in covariance structure analysis , 1985 .

[33]  James H. Steiger,et al.  The asymptotic distribution of elements of a correlation matrix: Theory and application , 1982 .

[34]  S. West,et al.  The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. , 1996 .

[35]  Allen I. Fleishman A method for simulating non-normal distributions , 1978 .

[36]  Alexander Shapiro,et al.  Asymptotic distribution theory in the analysis of covariance structures , 1983 .

[37]  P. Krishnaiah,et al.  On Covariance Structures. , 1975 .

[38]  S J Henly,et al.  Robustness of some estimators for the analysis of covariance structures. , 1993, The British journal of mathematical and statistical psychology.

[39]  Peter M. Bentler,et al.  Estimates and tests in structural equation modeling. , 1995 .

[40]  J. H. Steiger Multicorr: a Computer Program for Fast, Accurate, Small-Sample Testing of Correlational Pattern Hypotheses , 1979 .

[41]  J H Steiger,et al.  Testing Pattern Hypotheses On Correlation Matrices: Alternative Statistics And Some Empirical Results. , 1980, Multivariate behavioral research.

[42]  J. H. Steiger,et al.  The comparison of interdependent correlations between optimal linear composites , 1984 .

[43]  J. S. Tanaka,et al.  A fit index for covariance structure models under arbitrary GLS estimation , 1985 .

[44]  F. E.,et al.  Natural Inheritance , 1889, Nature.