Student ability estimation based on IRT

Most of the assessment systems are now using the Classical Test Theory (CTT), the real ability of students is not exactly revealed because they rely only on counting the number of true responses without awaring other characteristics like the difficulty of each item. Several testing software are applied weighted questions but they depend on the sentiment of teachers. The modern testing theories nowadays are built on a mathematical model which can calculate the latent trait of students. The Rasch model is the probability model which promotes interaction between an item and a student. We have constructed a system to estimate students' ability basing on Item Response Theory (IRT) and applying K-Means to classify student ranking. In this paper we present a model to categorize students' levels and compare them to traditional assessment methods. The results indicate that the methods we proposed have shown some significant improvement and they could be effectively applied for other tutoring systems. The result is also meaningful in customizing content and testing ways. Beside, the research is a guide line for teachers or test makers to give other testing approaches for various examinations.

[1]  Chih-Ming Chen,et al.  Personalized web-based tutoring system based on fuzzy item response theory , 2008, Expert Syst. Appl..

[2]  Robert J. Mislevy,et al.  Bayes modal estimation in item response models , 1986 .

[3]  T. L. Kelley.  The selection of upper and lower groups for the validation of test items. , 1939 .

[4]  Pao-Hua Chou,et al.  Accessing e-Learners' Knowledge for Personalization in e-Learning Environment , 2009, J. Res. Pract. Inf. Technol..

[5]  R. Hambleton,et al.  An NCME Instructional Module on Comparison of Classical Test Theory and Item Response Theory and Their Applications to Test Development. , 2005 .

[6]  Wen-Chih Chang,et al.  Applying IRT to Estimate Learning Ability and K-means Clustering in Web based Learning , 2009, J. Softw..

[7]  Chih-Ming Chen,et al.  Personalized mobile English vocabulary learning system based on item response theory and learning memory cycle , 2008, Comput. Educ..

[8]  T. A. Warm.  Weighted likelihood estimation of ability in item response theory , 1989 .

[9]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[10]  Youngseok Lee,et al.  Personalized item generation method for adaptive testing systems , 2013, Multimedia Tools and Applications.

[11]  Amir Zaman,et al.  Students Ranking, Based on their Abilities on Objective Type Test: Comparison of CTT and IRT , 2008 .

[12]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[13]  J. Aldrich.  R.A. Fisher and the making of maximum likelihood 1912-1922 , 1997 .

[14]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[15]  Young-Jin Lee,et al.  Developing an efficient computational method that estimates the ability of students in a Web-based learning environment , 2012, Comput. Educ..

[16]  R. Hambleton,et al.  Fundamentals of Item Response Theory , 1991 .

[17]  L. Crocker,et al.  Introduction to Classical and Modern Test Theory , 1986 .