An architecture for an adaptive assessment tool

The educational society faces the challenge of improving the quality of education, while increasing the percentage of students that pass a class, given limited teaching resources. In response to this demand, this work reports on the architecture and the implementation of a system for adaptive multi-user assessment of students. The software is a client/server platform developed in Java programming language, which is termed platform for adaptive and reliable evaluation of students (PARES). Hypertext markup language is used for the development of pages including text and figures. PARES includes three modules, which can be remotely connected to the system database on server through network. The Bayesian decision model is applied to adaptive testing, instead of the traditional item response theory. PARES can be used interactively by administrators, course instructors and students. When PARES is used for self-assessment, feedback is provided to the student's answer. As a result, personalized learning assistance is provided to improve a student's level of proficiency. Experimental results show that when students take self-assessment tests a week before scheduled formative tests, their scores are increased.

[1]  Hahn-Ming Lee,et al.  Personalized e-learning system using Item Response Theory , 2005, Comput. Educ..

[2]  F. Lord Applications of Item Response Theory To Practical Testing Problems , 1980 .

[3]  George D. Magoulas,et al.  INSPIRE: An INtelligent System for Personalized Instruction in a Remote Environment , 2001, OHS-7/SC-3/AH-3.

[4]  Catherine Marinagi,et al.  PARES: a software tool for computer-based testing and evaluation used in the Greek higher education system , 2004, IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings..

[5]  C.C. Marinagi,et al.  Work in Progress: Practical Computerized Adaptive Assessment based on Bayesian decision theory , 2006, Proceedings. Frontiers in Education. 36th Annual Conference.

[6]  Demetrios G. Sampson,et al.  An Architecture for Web-based e-Learning Promoting Re-usable Adaptive Educational e-Content , 2002, J. Educ. Technol. Soc..

[7]  Mariana Lilley,et al.  The development and evaluation of a software prototype for computer-adaptive testing , 2004, Comput. Educ..

[8]  Anthony R. Zara,et al.  Procedures for Selecting Items for Computerized Adaptive Tests. , 1989 .

[9]  Elena Trichina,et al.  Learning benefits of structural example-based adaptive tutoring systems , 2003, IEEE Trans. Educ..

[10]  José-Luis Pérez-de-la-Cruz,et al.  Adaptation and Generation in a Web-Based Tutor for Linear Programming , 2003, ICWE.

[11]  Peter Brusilovsky,et al.  ELM-ART: An Adaptive Versatile System for Web-based Instruction , 2001 .

[12]  Eduardo Guzmán,et al.  Self-assessment in a feasible, adaptive web-based testing system , 2005, IEEE Transactions on Education.

[13]  Lawrence M. Rudner An Examination of Decision-Theory Adaptive Testing Procedures , 2009 .

[14]  Jon H Sims Williams,et al.  Computer-Assisted Assessment in Higher Education , 1999 .