The Effect of Using Item Parcels on Ad Hoc Goodness-of-Fit Indexes in Confirmatory Factor Analysis: An Example Using Sarason's Reactions to Tests

The impact of using item parcels on ad hoc goodness-of-fit indexes in confirmatory factor analysis was examined using the Arabic version of Sarason's Reactions to Tests scale. Different numbers of parcels per factor and different numbers of items per parcel were used. Data were collected from a sample of 421 Arabic-speaking students from 2 similar high schools. Model fit in terms of the goodness-of-fit index, the comparative fit index, the Tucker-Lewis index, and the single-sample expected cross-validation index systematically improved as the number of items per parcel increased. However, the c2:degrees of freedom ratio and the root-mean-square error of approximation did not change systematically. The results were replicated with another sample of 374 students drawn from the same 2 schools.

[1]  Craig K. Enders,et al.  The Effects of Heterogeneous Item Distributions on Reliability , 1999 .

[2]  I. Sarason,et al.  Stress, anxiety, and cognitive interference: reactions to tests. , 1984, Journal of personality and social psychology.

[3]  Paul R. Yarnold,et al.  Reading and understanding MORE multivariate statistics. , 2000 .

[4]  L. Tucker,et al.  A reliability coefficient for maximum likelihood factor analysis , 1973 .

[5]  H. Marsh,et al.  Assessing Goodness of Fit: Is Parsimony Always Desirable? , 1996 .

[6]  B. Thompson,et al.  EFFECTS OF SAMPLE SIZE, ESTIMATION METHODS, AND MODEL SPECIFICATION ON STRUCTURAL EQUATION MODELING FIT INDEXES , 1999 .

[7]  Keith F. Widaman,et al.  Unidimensional Versus Domain Representative Parceling of Questionnaire Items: An Empirical Example , 1994 .

[8]  J. Benson,et al.  The structure of test anxiety in israeli-arab high school students: An application of confirmatory factor analysis with miniscales , 1997 .

[9]  Stephen G. West,et al.  Structural equation models with non-normal variables: Problems and remedies , 1995 .

[10]  M. Browne,et al.  Single Sample Cross-Validation Indices for Covariance Structures. , 1989, Multivariate behavioral research.

[11]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[12]  H W Marsh,et al.  Is More Ever Too Much? The Number of Indicators per Factor in Confirmatory Factor Analysis. , 1998, Multivariate behavioral research.

[13]  S. Finney,et al.  Item parceling issues in structural equation modeling , 2001 .

[14]  Ke-Hai Yuan,et al.  On Averaging Variables in a Confirmatory Factor Analysis Model , 1997 .

[15]  James C. Anderson,et al.  The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis , 1984 .

[16]  B. Thompson.  Ten commandments of structural equation modeling. , 2000 .

[17]  John Hattie,et al.  Methodology Review: Assessing Unidimensionality of Tests and ltenls , 1985 .

[18]  Leslie A. Hayduk,et al.  LISREL Issues, Debates and Strategies , 1996 .

[19]  Ira H. Bernstein,et al.  Factoring items and factoring scales are different: Spurious evidence for multidimensionality due to item categorization. , 1989 .

[20]  Linda L. Cook,et al.  An Assessment of the Dimensionality of Three SAT-Verbal Test Editions , 1988 .

[21]  Howard Wainer,et al.  Item Clusters and Computerized Adaptive Testing: A Case for Testlets , 1987 .

[22]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[23]  A. Panter,et al.  Writing about structural equation models. , 1995 .

[24]  Bruce Thompson,et al.  Using Item "Testlets"/"Parcels" in Confirmatory Factor Analysis: An Example Using the PPSDQ-78. , 1996 .

[25]  P. Bentler,et al.  Comparative fit indexes in structural models. , 1990, Psychological bulletin.

[26]  Rosalie J. Hall,et al.  Item Parceling Strategies in SEM: Investigating the Subtle Effects of Unmodeled Secondary Constructs , 1999 .

[27]  Raymond B. Cattell,et al.  The Radial Parcel Double Factoring Design: A Solution to the Item-Vs-Parcel Controversy , 1975 .

[28]  Roderick P. McDonald,et al.  Factor Analysis and Related Methods , 1985 .

[29]  P. Bentler.  Comparative Fit Indices in Structural Models , 1990 .

[30]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[31]  Joseph J. Stevens,et al.  The Development and Validation of the Survey of Antitudes toward Statistics , 1995 .