Weighted likelihood estimation of ability in item response theory

Applications of item response theory, which depend upon its parameter invariance property, require that parameter estimates be unbiased. A new method, weighted likelihood estimation (WLE), is derived, and proved to be less biased than maximum likelihood estimation (MLE) with the same asymptotic variance and normal distribution. WLE removes the first order bias term from MLE. Two Monte Carlo studies compare WLE with MLE and Bayesian modal estimation (BME) of ability in conventional tests and tailored tests, assuming the item parameters are known constants. The Monte Carlo studies favor WLE over MLE and BME on several criteria over a wide range of the ability scale.

[1]  H. Jeffreys,et al.  Theory of probability , 1896 .

[2]  M. H. Quenouille.  NOTES ON BIAS IN ESTIMATION , 1956 .

[3]  Maurice G. Kendall.  The advanced theory of statistics , 1958 .

[4]  Ralph A. Bradley,et al.  The asymptotic properties of ML estimators when sampling from associated populations , 1962 .

[5]  M. Kendall,et al.  The advanced theory of statistics , 1945 .

[6]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[7]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[8]  B. Hoadley.  Asymptotic Properties of Maximum Likelihood Estimators for the Independent Not Identically Distributed Case , 1971 .

[9]  D. F. Andrews,et al.  Robust Estimates of Location , 1972 .

[10]  R. Owen,et al.  A Bayesian Sequential Procedure for Quantal Response in the Context of Adaptive Mental Testing , 1975 .

[11]  James R. McBride.  Some Properties of a Bayesian Adaptive Ability Testing Strategy , 1977 .

[12]  H. Akaike.  A new look at the Bayes procedure , 1978 .

[13]  B. Efron,et al.  Assessing the accuracy of the maximum likelihood estimator: Observed versus expected Fisher information , 1978 .

[14]  A Primer of Item Response Theory. Technical Report 940279. , 1978 .

[15]  J. A. Anderson,et al.  Logistic Discrimination and Bias Correction in Maximum Likelihood Estimation , 1979 .

[16]  Fumiko Samejima.  Is Bayesian Estimation Proper for Estimating the Individual's Ability? , 1980 .

[17]  Howard Wainer,et al.  Robust estimation of ability in the Rasch model , 1980 .

[18]  J. Ghosh,et al.  Asymptotic Properties of a Solution to the Likelihood Equation with Life-Testing Applications , 1980 .

[19]  Harvey Goldstein,et al.  Dimensionality, bias, independence and measurement scale problems in latent trait test score models , 1980 .

[20]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[21]  A Comparison of a Bayesian and a Maximum Likelihood Tailored Testing Procedure. , 1981 .

[22]  R. D. Bock,et al.  Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm , 1981 .

[23]  Bert F. Green.  Evaluation Plan for the Computerized Adaptive Vocational Aptitude Battery , 1982 .

[24]  R. D. Bock,et al.  Marginal maximum likelihood estimation of item parameters , 1982 .

[25]  Robert J. Mislevy,et al.  Biweight Estimates of Latent Ability , 1982 .

[26]  Douglas H. Jones.  REDESCENDING M‐TYPE ESTIMATORS OF LATENT ABILITY , 1982 .

[27]  Redescending M-Type Estimators of Latent Ability. Program Statistics Research, Technical Report No. 82-30. , 1982 .

[28]  Frederic M. Lord,et al.  Unbiased estimators of ability parameters, of their variance, and of their parallel-forms reliability , 1983 .

[29]  O. Barndorff-Nielsen.  On a formula for the distribution of the maximum likelihood estimator , 1983 .

[30]  Frederic M. Lord,et al.  MAXIMUM LIKELIHOOD AND BAYESIAN PARAMETER ESTIMATION IN ITEM RESPONSE THEORY , 1984 .

[31]  David Thissen,et al.  A response model for multiple choice items , 1984 .

[32]  David J. Weiss,et al.  Bias and Information of Bayesian Adaptive Testing , 1984 .

[33]  F. Baker.  Ability Metric Transformations Involved in Vertical Equating Under Item Response Theory , 1984 .

[34]  R. Schaefer.  Bias correction in maximum likelihood logistic regression. , 1985, Statistics in medicine.