Power analysis and determination of sample size for covariance structure modeling.

A framework for hypothesis testing and power analysis in the assessment of fit of covariance structure models is presented. We emphasize the value of confidence intervals for fit indices, and we stress the relationship of confidence intervals to a framework for hypothesis testing. The approach allows for testing null hypotheses of not-good fit, reversing the role of the null hypothesis in conventional tests of model fit, so that a significant result provides strong support for good fit. The approach also allows for direct estimation of power, where effect size is defined in terms of a null and alternative value of the root-mean-square error of approximation fit index proposed by J. H. Steiger and J. M. Lind (1980). It is also feasible to determine minimum sample size required to achieve a given level of power for any test of fit in this framework. Computer programs and examples are provided for power analyses and calculation of minimum sample sizes.

[1]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[2]  Dean J. Champion,et al.  Basic Statistics for Social Research , 1970 .

[3]  Karl G. Jöreskog,et al.  FACTORIAL INVARIANCE OF ABILITY MEASURES IN GROUPS DIFFERING IN INTELLIGENCE AND SOCIOECONOMIC STATUS , 1971 .

[4]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[5]  J. H. Steiger.  Statistically based tests for the number of common factors , 1980 .

[6]  Dennis L. Dossett,et al.  Attitude–behavior relations: A comparison of the Fishbein-Ajzen and the Bentler-Speckart models. , 1983 .

[7]  A. Satorra,et al.  Power of the likelihood ratio test in covariance structure analysis , 1985 .

[8]  A. Shapiro,et al.  On the multivariate asymptotic distribution of sequential Chi-square statistics , 1985 .

[9]  Robert C. MacCallum,et al.  SPECIFICATION SEARCHES IN COVARIANCE STRUCTURE MODELING , 1986 .

[10]  Jack A. Naglieri,et al.  Comparison of Black-White Differences on the WISC-R and the K-ABC" Spearman's Hypothesis , 1987 .

[11]  R. P. McDonald,et al.  Goodness-of-fit indexes in confirmatory factor analysis : The effect of sample size , 1988 .

[12]  Ian R. Gellatly,et al.  Perceived performance norm as a mediator in the effect of assigned goal on personal goal and task performance. , 1988 .

[13]  James L. Arbuckle.  AMOS: Analysis of Moment Structures , 1989 .

[14]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[15]  S. Mulaik,et al.  EVALUATION OF GOODNESS-OF-FIT INDICES FOR STRUCTURAL EQUATION MODELS , 1989 .

[16]  R. Vance,et al.  Effects of two types of feedback on goal acceptance and personal goals. , 1990 .

[17]  Bishwa Nath Mukherjee,et al.  A note on distributional properties of the Jöreskog-Sörbom fit indices , 1990 .

[18]  Willem E. Saris,et al.  A comparison of several approximations to the power function of the likelihood ratio test in covariance structure analysis , 1991 .

[19]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[20]  R. MacCallum,et al.  Model modifications in covariance structure analysis: the problem of capitalization on chance. , 1992, Psychological bulletin.

[21]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .

[22]  Karl G. Jöreskog,et al.  Lisrel 8: Structural Equation Modeling With the Simplis Command Language , 1993 .