Control of Type I Errors with Multiple Tests of Constraints in Structural Equation Modeling.

Two contrasting views toward the evaluation of multiple tests of constraints and control of Type 1 errors in structural equation modeling are presented. (a) Exploring; data helps researchers make decisions about inclusion of relevant model parameters and control of Type 1 errors hinders this process. (b) Exploring data is not likely to yield meaningful models unless we can limit the process on the basis of methods and theory, and controlling Type I errors is a useful device: to force us to limit our searches. Also, in evaluating multiple tests of constraints for applications other than exploratory analyses, we should control for Type I errors as we do in testing multiple comparisons in analysis of variance. We argue for the second perspective and present examples to illustrate methods for controlling Type 1 errors when making model comparisons.

[1]  Willem E. Saris,et al.  The Detection and Correction of Specification Errors in Structural Equation Models , 1987 .

[2]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[3]  J. Shaffer.  Modified Sequentially Rejective Multiple Test Procedures , 1986 .

[4]  R. MacCallum,et al.  Model modifications in covariance structure analysis: the problem of capitalization on chance. , 1992, Psychological bulletin.

[5]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[6]  S. Mulaik,et al.  EVALUATION OF GOODNESS-OF-FIT INDICES FOR STRUCTURAL EQUATION MODELS , 1989 .

[7]  H. Scheffé.  A METHOD FOR JUDGING ALL CONTRASTS IN THE ANALYSIS OF VARIANCE , 1953 .

[8]  M. Berger.  A note on the use of simultaneous test procedures. , 1978 .

[9]  James C. Anderson,et al.  STRUCTURAL EQUATION MODELING IN PRACTICE: A REVIEW AND RECOMMENDED TWO-STEP APPROACH , 1988 .

[10]  B. Holland,et al.  Improved Bonferroni-type multiple testing procedures. , 1988 .

[11]  H. Akaike.  Factor analysis and AIC , 1987 .

[12]  R. Collins,et al.  Relative/Proportional Scoring of the Ways of Coping Checklist: Is it Advantageous or Artificial. , 1993, Multivariate behavioral research.

[13]  A. Tomer,et al.  The Structure of Cognitive Speed Measures in Old and Young Adults. , 1993, Multivariate behavioral research.

[14]  Robert C. MacCallum,et al.  Alternative Strategies for Cross-Validation of Covariance Structure Models. , 1994, Multivariate behavioral research.

[15]  J. S. Long,et al.  Testing Structural Equation Models , 1993 .