Comparing the Effectiveness of Several Irt Based Appropriateness Measures in Detecting Unusual Response Patterns

The study compared nine indices of response pattern appropriateness based on IRT with respect to their relation to the total test score and their, effectiveness in detecting unusual response patterns. Three groups of response patterns were analyzed; a group of cooperative examinees, a group of uncooperative examinees and a group of randomly generated response patterns. The comparison among the indices was based on their capability to differentiate among the three groups and on the percentages of correct and incorrect classification of examinees to their actual groups based on their score on the index.

[1]  Lawrence M. Rudner.  INDIVIDUAL ASSESSMENT ACCURACY , 1983 .

[2]  Kikumi K. Tatsuoka,et al.  Indices for Detecting Unusual Patterns: Links Between Two General Approaches and Potential Applications , 1983 .

[3]  Donald B. Rubin,et al.  Measuring the Appropriateness of Multiple-Choice Test Scores , 1979 .

[4]  K. Tatsuoka,et al.  ON THE DIMENSIONALITY OF ACHIEVEMENT TEST DATA , 1982 .

[5]  Frederic E. Fischer,et al.  An Index of an Individual's Agreement with Group-Determined Item Difficulties , 1968 .

[6]  Kikumi K. Tatsuoka,et al.  Detection of Aberrant Response Patterns and their Effect on Dimensionality , 1982 .

[7]  K. Tatsuoka,et al.  Standardized Extended Caution Indices and Comparisons of their Rule Detection Rates. , 1982 .

[8]  Ronald K. Hambleton,et al.  Applications of Item Response Theory , 1983 .

[9]  F. Allport,et al.  The Measurement and Motivation of Atypical Opinion in a Certain Group , 1925, American Political Science Review.

[10]  Benjamin D. Wright,et al.  A Procedure for Sample-Free Item Analysis , 1969 .

[11]  Leslie J. Fyans,et al.  Achievement Motivation: Recent Trends in Theory and Research , 1980 .

[12]  Benjamin D. Wright,et al.  Solving measurement problems with the Rasch model. , 1977 .

[13]  Kikumi K. Tatsuoka,et al.  Caution indices based on item response theory , 1984 .

[14]  C. I. Mosier.  Psychophysics and mental test theory: Fundamental postulates and elementary theorems. , 1940 .

[15]  B. Wright,et al.  Best Test Design. Rasch Measurement. , 1979 .

[16]  H. V. D. Flier,et al.  Deviant Response Patterns and Comparability of Test Scores , 1982 .

[17]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[18]  Fritz Drasgow,et al.  Choice of Test Model for Appropriateness Measurement , 1982 .

[19]  Kikumi K. Tatsuoka,et al.  Spotting Erroneous Rules of Operation by the Individual Consistency Index. , 1983 .

[20]  M. Cole.  Review of Basic problems in cross-cultural psychology. , 1978 .

[21]  B. Rosen,et al.  Achievement Motivation: Recent Trends in Theory and Research. , 1983 .