Efficient Standard Error Formulas of Ability Estimators with Dichotomous Item Response Models

This paper focuses on the computation of asymptotic standard errors (ASE) of ability estimators with dichotomous item response models. A general framework is considered, and ability estimators are defined from a very restricted set of assumptions and formulas. This approach encompasses most standard methods such as maximum likelihood, weighted likelihood, maximum a posteriori, and robust estimators. A general formula for the ASE is derived from the theory of M-estimation. Well-known results are found back as particular cases for the maximum and robust estimators, while new ASE proposals for the weighted likelihood and maximum a posteriori estimators are presented. These new formulas are compared to traditional ones by means of a simulation study under Rasch modeling.

[1]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[2]  R. Hambleton,et al.  Item Response Theory , 1984, The History of Educational Measurement.

[3]  Ke-Hai Yuan,et al.  Asymptotics of Estimating Equations under Natural Conditions , 1998 .

[4]  R. Hambleton,et al.  Item Response Theory: Principles and Applications , 1984 .

[5]  Frederic M. Lord.  MAXIMUM LIKELIHOOD AND BAYESIAN PARAMETER ESTIMATION IN ITEM RESPONSE THEORY , 1986 .

[6]  R. D. Bock,et al.  Adaptive EAP Estimation of Ability in a Microcomputer Environment , 1982 .

[7]  David Magis,et al.  Random Generation of Response Patterns under Computerized Adaptive Testing with the R Package catR , 2012 .

[8]  Frank B. Baker,et al.  Item Response Theory : Parameter Estimation Techniques, Second Edition , 2004 .

[9]  Ke-Hai Yuan,et al.  Robust Estimation of Latent Ability in Item Response Models , 2011 .

[10]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[11]  Robert J. Mislevy,et al.  Bayes modal estimation in item response models , 1986 .

[12]  Robert J. Mislevy,et al.  Biweight Estimates of Latent Ability , 1982 .

[13]  H. Wainer.  Computerized adaptive testing: A primer, 2nd ed. , 2000 .

[14]  L. Stefanski,et al.  The Calculus of M-Estimation , 2002 .

[15]  S. Embretson,et al.  Item response theory for psychologists , 2000 .

[16]  Howard Wainer,et al.  Computerized Adaptive Testing: A Primer , 2000 .

[17]  D. Magis.  Accuracy of Asymptotic Standard Errors of the Maximum and Weighted Likelihood Estimators of Proficiency Levels With Short Tests , 2014 .

[18]  Y. Sinai,et al.  Theory of probability and random processes , 2007 .

[19]  Anna Doebler.  The Problem of Bias in Person Parameter Estimation in Adaptive Testing , 2012 .

[20]  M. Rao.  Probability theory with applications , 1984 .

[21]  Howard Wainer,et al.  Robust estimation of ability in the Rasch model , 1980 .

[22]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[23]  Frederic M. Lord,et al.  Unbiased estimators of ability parameters, of their variance, and of their parallel-forms reliability , 1983 .

[24]  Klaas Sijtsma,et al.  Introduction to Nonparametric Item Response Theory , 2002 .

[25]  D. Magis.  On the asymptotic standard error of a class of robust estimators of ability in dichotomous item response models. , 2014, The British journal of mathematical and statistical psychology.

[26]  Allan Birnbaum,et al.  STATISTICAL THEORY FOR LOGISTIC MENTAL TEST MODELS WITH A PRIOR DISTRIBUTION OF ABILITY , 1967 .

[27]  F. Baker,et al.  Item response theory : parameter estimation techniques , 1993 .

[28]  R. Carroll,et al.  On Robustness in the Logistic Regression Model , 1993 .

[29]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[30]  Haruhiko Ogasawara,et al.  Asymptotic properties of the Bayes and pseudo Bayes estimators of ability in item response theory , 2013, J. Multivar. Anal..

[31]  P. J. Huber.  Robust Estimation of a Location Parameter , 1964 .

[32]  Haruhiko Ogasawara,et al.  Asymptotic cumulants of ability estimators using fallible item parameters , 2013, J. Multivar. Anal..

[33]  P. J. Huber.  The behavior of maximum likelihood estimates under nonstandard conditions , 1967 .

[34]  T. A. Warm.  Weighted likelihood estimation of ability in item response theory , 1989 .

[35]  Achim Zeileis.  Object-oriented Computation of Sandwich Estimators , 2006 .

[36]  Ying Cheng,et al.  The Influence of Item Calibration Error on Variable-Length Computerized Adaptive Testing , 2013 .