IRT Models for Ability-Based Guessing

An ability-based guessing model is formulated and applied to several data sets regarding educational tests in language and in mathematics. The formulation of the model is such that the probability of a correct guess does not only depend on the item but also on the ability of the individual, weighted with a general discrimination parameter. By so doing, the possibility that the individual uses his or her ability to some extent for differentiating among responses while guessing is also considered. Some important properties of the model are described and compared with analogous properties of related models. After simulation studies, the model is applied to different data sets of the Chilean Sistema de Medición de la Calidad ń (SIMCE) tests of mathematics and language. The conclusion of this analysis seems relevant—namely, that the examinees use their ability to guess in the language test but not in the mathematics test.

[1]  P. Fayers.  Item Response Theory for Psychologists , 2004, Quality of Life Research.

[2]  R. Hambleton,et al.  Handbook of Modern Item Response Theory , 1997 .

[3]  R. A. Weitzman.  The Rasch Model Plus Guessing , 1996 .

[4]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[5]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[6]  Theoretical Issues in Contrastive Phonology: Studies in Descriptive Linguistics 13 . Stig Eliasson (Ed.) Heidelberg: Julius Graos Verlag, 1984. Pp. 110. , 1986, Applied Psycholinguistics.

[7]  Christine E. DeMars.  Group Differences Based on Irt Scores: does the Model Matter? , 2001 .

[8]  Robert C. Sykes,et al.  Nonunique solutions to the likelihood equation for the three-parameter logistic model , 1991 .

[9]  R. Darrell Bock,et al.  Estimating item parameters and latent ability when responses are scored in two or more nominal categories , 1972 .

[10]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[11]  E. Maris.  Psychometric latent response models , 1995 .

[12]  Klaas Sijtsma,et al.  New Developments in Categorical Data Analysis for the Social and Behavioral Sciences , 2005 .

[13]  Fumiko Samejima,et al.  A comment on Birnbaum's three-parameter logistic model in the latent trait theory , 1973 .

[14]  C. Parsons,et al.  Application of Unidimensional Item Response Theory Models to Multidimensional Data , 1983 .

[15]  Noel A Cressie,et al.  Characterizing the manifest probabilities of latent trait models , 1983 .

[16]  Howard Wainer,et al.  Robust estimation of ability in the Rasch model , 1980 .

[17]  R. P. McDonald,et al.  Test Theory: A Unified Treatment , 1999 .

[18]  R. P. McDonald,et al.  Future directions for item response theory , 1989 .

[19]  Gunter Maris,et al.  The Nedelsky model for multiple-choice items. , 2005 .

[20]  T. P. Hutchinson.  Ability, partial information, guessing : statistical modelling applied to multiple, choice tests , 1991 .

[21]  David Thissen,et al.  A response model for multiple choice items , 1984 .

[22]  L. Nedelsky.  Absolute Grading Standards for Objective Tests , 1954 .

[23]  Frederic M. Lord,et al.  Maximum likelihood estimation of item response parameters when some responses are omitted , 1983 .

[24]  G. Masters.  A rasch model for partial credit scoring , 1982 .