The maximum priority index method for severely constrained item selection in computerized adaptive testing.

This paper introduces a new heuristic approach, the maximum priority index (MPI) method, for severely constrained item selection in computerized adaptive testing. Our simulation study shows that it is able to accommodate various non-statistical constraints simultaneously, such as content balancing, exposure control, answer key balancing, and so on. Compared with the weighted deviation modelling method, it leads to fewer constraint violations and better exposure control while maintaining the same level of measurement precision.

[1]  R. Hambleton,et al.  Item Response Theory , 1984, The History of Educational Measurement.

[2]  Martha L. Stocking,et al.  A New Method of Controlling Item Exposure in Computerized Adaptive Testing. , 1995 .

[3]  Cynthia G. Parshall,et al.  New Algorithms for Item Selection and Exposure Control with Computerized Adaptive Testing. , 1995 .

[4]  Ronald D. Armstrong,et al.  IRT Test Assembly Using Network-Flow Programming , 1998 .

[5]  Martha L. Stocking,et al.  A Method for Severely Constrained Item Selection in Adaptive Testing , 1992 .

[6]  Z. Ying,et al.  a-Stratified Multistage Computerized Adaptive Testing , 1999 .

[7]  van der Linden,et al.  Constrained adaptive testing with shadow tests , 2000 .

[8]  Hua-Hua Chang.  Linear models for optimal test design , 2007 .

[9]  Martha L. Stocking,et al.  Controlling Item Exposure Conditional on Ability in Computerized Adaptive Testing , 1998 .

[10]  Z. Ying,et al.  a-Stratified Multistage Computerized Adaptive Testing with b Blocking , 2001 .

[11]  Ellen Timminga,et al.  Solving Infeasibility Problems in Computerized Test Assembly , 1998 .

[12]  Judith A. Spray,et al.  The Relationship Between Item Exposure and Test Overlap in Computerized Adaptive Testing , 2003 .

[13]  M. Stocking,et al.  A Model and Heuristic For Solving Very Large Item Selection Problems , 1993 .

[14]  Wim J. van der Linden,et al.  A Model for Optimal Constrained Adaptive Testing , 1998 .

[15]  Hua-Hua Chang,et al.  A Global Information Approach to Computerized Adaptive Testing , 1996 .

[16]  Hua-Hua Chang,et al.  Computerized adaptive testing: a mixture item selection approach for constrained situations. , 2005, The British journal of mathematical and statistical psychology.

[17]  Hua-Hua Chang,et al.  Two-Phase Item Selection Procedure for Flexible Content Balancing in CAT , 2007 .