A fast convergence Computerized Adaptive Testing system based on multi-agent system

A multi-agent median computerized adaptive testing (CAT) system is put forward, which is based on the three-parameter logistic model (3PLM) of item response theory (IRT) and a multi-agent item pool. The multi-agent item pool is proposed to help the non-professionals system choose valuable items interactively and conveniently . Aiming at the problems in the ability estimate of multi-agent adaptive testing, rapid convergence can be realized greatly if logistic median algorithm is applied to calculate maximum likelihood estimation (MLE) instead of the most commonly used Newton_Raphson iterative algorithm. Simulated experiments are conducted with the research object of multi-agent three parameter logistic median model. The result shows that this CAT system has more superior function and lower calculation quantity, with fast convergence and the accuracy of ability estimate, which will be adapted further in modern test system.

[1]  Frederic M. Lord,et al.  SOME TEST THEORY FOR TAILORED TESTING , 1968 .

[2]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[3]  Charles B. Kreitzberg,et al.  AN EMPIRICAL STUDY OF THE BROAD RANGE TAILORED TEST OF VERBAL ABILITY , 1980 .

[4]  Alfred Bork,et al.  The implementation of an adaptive test on the computer , 2005, Fifth IEEE International Conference on Advanced Learning Technologies (ICALT'05).

[5]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[6]  R. Owen,et al.  A Bayesian Sequential Procedure for Quantal Response in the Context of Adaptive Mental Testing , 1975 .

[7]  Yung-Chin Yen,et al.  Design and evaluation of an XML-based platform-independent computerized adaptive testing system , 2005, IEEE Trans. Educ..

[8]  Howard Wainer,et al.  Computerized Adaptive Testing: A Primer , 2000 .

[9]  Marcel Dix,et al.  Automated software robustness testing - static and adaptive test case design methods , 2002, Proceedings. 28th Euromicro Conference.

[10]  Eduardo Guzmán,et al.  Improving Student Performance Using Self-Assessment Tests , 2007, IEEE Intelligent Systems.

[11]  H. Lemmer.  Adaptive tests for the median , 1993 .

[12]  Eduardo Guzmán,et al.  Self-assessment in a feasible, adaptive web-based testing system , 2005, IEEE Transactions on Education.

[13]  Bernard P. Veldkamp,et al.  An Integer Programming Approach to Item Bank Design , 2000 .

[14]  Tse-chi Hsu,et al.  Computer-Assisted Test Construction: The State of the Art. , 1985 .

[15]  Wayne H. Holtzman,et al.  Computer-assisted instruction, testing, and guidance , 1970 .

[16]  David J. Weiss,et al.  Improving Measurement Quality and Efficiency with Adaptive Testing , 1982 .

[17]  S. V. Astanin,et al.  Usage of Fibonacci numbers while organizing the procedure of adaptive testing , 2002, Proceedings 2002 IEEE International Conference on Artificial Intelligence Systems (ICAIS 2002).

[18]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .