Cross-Validating Item Parameter Estimation in Adaptive Testing

From a statistical point of view, adaptive testing belongs to the class of problems of selecting a best subset of random variables. As in any other instance of this problem, adaptive testing is likely to capitalize on estimation error. An empirical example of the phenomenon is discussed, and a strategy for cross-validating results from adaptive testing is proposed. Results from a simulation study on the strategy are presented.

[1]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[2]  Cornelis A.W. Glas,et al.  Computerized adaptive testing : theory and practice , 2000 .

[3]  C. I. Mosier.  I. Problems and Designs of Cross-Validation 1 , 1951 .

[4]  Howard Wainer,et al.  Computerized Adaptive Testing: A Primer , 2000 .

[5]  Ronald K. Hambleton,et al.  Influence of Item Parameter Estimation Errors in Test Development. , 1993 .

[6]  Wim J. van der Linden,et al.  Capitalization on Item Calibration Error in Adaptive Testing , 1998 .

[7]  T. A. Warm.  Weighted likelihood estimation of ability in item response theory , 1989 .

[8]  J. Neter,et al.  Applied linear statistical models : regression, analysis of variance, and experimental designs , 1974 .

[9]  Ronald K. Hambleton,et al.  Item Parameter Estimation Errors and Their Influence on Test Information Functions , 1994 .

[10]  Peter J. Pashley,et al.  Chapter 1 Item Selection and Ability Estimation in Adaptive Testing , 2000 .

[11]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[12]  Martha L. Stocking,et al.  Methods of Controlling the Exposure of Items in CAT , 2000 .

[13]  Rebecca D. Hetter,et al.  Item exposure control in CAT-ASVAB. , 1997 .

[14]  R. Tsutakawa,et al.  The effect of uncertainty of item parameter estimation on ability estimates , 1990 .

[15]  Nambury S. Raju,et al.  Methodology Review: Estimation of Population Validity and Cross-Validity, and the Use of Equal Weights in Prediction , 1997 .