Practical Issues in Large-Scale Computerized Adaptive Testing

Computerized adaptive testing, although well-grounded in psychometric theory, has had few large-scale applications in the past. This is now changing because the cost of computing has declined rapidly. As is always true at such junctures where theory is translated into practice, many practical issues arise that must now be addressed. In this article, we discuss a number of such issues and sketch out potential problems and potential solutions. Our purpose is to encourage further development of solutions to the issues presented as well as other practical issues facing measurement professionals involved with the implementation of adaptive testing.

[1]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[2]  Martha L. Stocking,et al.  A Method for Severely Constrained Item Selection in Adaptive Testing , 1992 .

[3]  Lunz Me,et al.  Comparability of decisions for computer adaptive and written examinations. , 1991 .

[4]  M. Stocking,et al.  A Model and Heuristic For Solving Very Large Item Selection Problems , 1993 .

[5]  Martha L. Stocking,et al.  Developing a Common Metric in Item Response Theory , 1983 .

[6]  Maria T Potenza.  The exploration of an alternative method for scoring computer-adaptive tests , 1994 .

[7]  Martha L. Stocking,et al.  A New Method of Controlling Item Exposure in Computerized Adaptive Testing. , 1995 .

[8]  Betty A. Bergstrom,et al.  The Effect of Review on Student Ability and Test Efficiency for Computerized Adaptive Tests , 1992 .

[9]  William C. Ward.  The College Board computerized placement tests: an application of computerized adaptive testing , 1987 .

[10]  John Mazzeo.  Comparability of Computer and Paper-and-Pencil Scores for Two CLEP General Examinations. College Board Report No. 91-5. , 1991 .

[11]  Martha L. Stocking,et al.  Two Simulated Feasibility Studies in Computerised Adaptive Testing , 1987 .

[12]  J. Mcbride,et al.  Reliability and Validity of Adaptive Ability Tests in a Military Setting , 1983 .

[13]  Betty A. Bergstrom,et al.  An Empirical Study of Computerized Adaptive Test Administration Conditions. , 1994 .

[14]  Howard Wainer.  SOME PRACTICAL CONSIDERATIONS WHEN CONVERTING A LINEARLY ADMINISTERED TEST TO AN ADAPTIVE FORMAT , 1992 .

[15]  F. Baker,et al.  A Comparison of Two Procedures for Computing IRT Equating Coefficients , 1991 .