论文信息 - A Comparison of Two Methods of Decomposing Item Difficulties

A Comparison of Two Methods of Decomposing Item Difficulties

This paper compares two methods of estimating component difficulties for dichotomous test data. Simulated data are used to study the effects of sample size, collinearity, a measurement disturbance, and multidimensionality on the estimation of component difficulties. The two methods of estimation used in this study were conditional maximum likelihood estimation of parameters specified by the linear logistic test model (LLTM) and estimated Rasch item difficulties regressed on component frequencies. The results of the analysis indicate that both methods produce similar results in all comparisons. Neither of the methods worked well in the presence of an incorrectly specified structure or collinearity in the component frequencies. However, both methods appear to be fairly robust in the presence of measurement disturbances as long as there is a large number of cases (n = 1,000). For the case of fitting data with uncorrelated component frequencies, 30 cases were sufficient to recover the generating parameters accurately.

Kathy E. Green | K. Green | Richard M. Smith

[1] John Seely Brown,et al. Diagnostic Models for Procedural Bugs in Basic Mathematical Skills , 1978, Cogn. Sci..

[2] Kikumi K. Tatsuoka,et al. Spotting Erroneous Rules of Operation by the Individual Consistency Index. , 1983 .

[3] Susan E. Whitely,et al. Information Structure for Geometric Analogies: A Test Theory Approach , 1981 .

[4] B. Wright,et al. Best test design , 1979 .

[5] R. Hambleton,et al. Item Response Theory , 1984, The History of Educational Measurement.

[6] Allen Newell,et al. Human Problem Solving. , 1973 .

[7] Georg Rasch,et al. Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[8] Richard M. Smith. Person Fit in the Rasch Model , 1986 .

[9] H. Spada. Understanding Proportionality: A Comparison of Different Models of Cognitive Development , 1978 .

[10] A. Jackson Stenner,et al. Testing Construct Theories , 1982 .

[11] G. H. Fischer,et al. The linear logistic test model as an instrument in educational research , 1973 .

[12] G. H. Fischer,et al. Logistic latent trait models with linear constraints , 1983 .

[13] L. Crocker,et al. Introduction to Classical and Modern Test Theory , 1986 .

[14] Susan E. Whitely,et al. Multicomponent latent trait models for ability tests , 1980 .

[15] G. Arthur. A point scale of performance tests , 1936 .