The Study of Item Selection Method in CAT

Item selection method is one of the most important parts of computerized adaptive testing. Traditional method is based on the item information function to select the item which has maximum information, with the maximum information test to achieve the purpose of accurate estimates the examinee’s ability level. However, this method has high item exposure rate and the test content imbalance problem, etc. To solve these problems, this article introduces a new heuristic item selection method. The results of the study show that compared with the maximum information method, with the assurance of the condition of the same measurement accuracy, the new method can better control item exposure rate and achieve content balancing.

[1]  Mária Bieliková,et al.  On the impact of adaptive test question selection for learning efficiency , 2010, Comput. Educ..

[2]  Hua-Hua Chang,et al.  Computerized adaptive testing: a mixture item selection approach for constrained situations. , 2005, The British journal of mathematical and statistical psychology.

[3]  F. Lord Applications of Item Response Theory To Practical Testing Problems , 1980 .

[4]  Kuo Tzai-hsing,et al.  Web-based adaptive testing system , 2008, Wuhan University Journal of Natural Sciences.

[5]  Julián Gutiérrez Serrano,et al.  Calibration of an item bank for the assessment of Basque language knowledge , 2010, Comput. Educ..

[6]  D. Weiss Adaptive testing by computer. , 1985, Journal of consulting and clinical psychology.

[7]  Yang Jinzhong Design and Implementation of Grails-based Online Adaptive Testing System , 2009 .

[8]  Hua-Hua Chang,et al.  The maximum priority index method for severely constrained item selection in computerized adaptive testing. , 2009, The British journal of mathematical and statistical psychology.

[9]  Martha L. Stocking,et al.  Practical Issues in Large-Scale Computerized Adaptive Testing , 1996 .

[10]  Ye Yan The Design of IRT-Based Online Adaptive Testing System for College English Vocabulary , 2008 .

[11]  Hua-Hua Chang,et al.  a-Stratified CAT design with content blocking. , 2003, The British journal of mathematical and statistical psychology.

[12]  Lakhmi C. Jain,et al.  Knowledge-Based Intelligent Information and Engineering Systems , 2004, Lecture Notes in Computer Science.

[13]  Yen-Ting Lin,et al.  An adaptive testing system for supporting versatile educational assessment , 2009, Comput. Educ..

[14]  F. Lord A Broad-Range Tailored Test of Verbal Ability , 1975 .

[15]  Philip E. Cheng,et al.  Computerized Adaptive Testing Using the Nearest-Neighbors Criterion , 2003 .

[16]  Fotis Lazarinis,et al.  Creating personalized assessments based on learner knowledge and objectives in a hypermedia Web testing application , 2010, Comput. Educ..

[17]  Ngoc Thanh Nguyen,et al.  A Computer Adaptive Testing Method for Intelligent Tutoring Systems , 2010, KES.