An Online System for Testing and Evaluation

This paper describes an online application for test design and evaluation of trainees. We address two main topics: activity flow modeling and adaptive test design. With activity flow modeling, we achieve high usability and structural coherence, while the adaptive test design method that we propose facilitates dynamic generation of tests based on topic relevance. Our method ensures the creation of adaptive tests, targeted to specific topics of interest for users, and employs specific policies to adjust the difficulty level of tests. We also describe a taxonomy-based test design method, that enhances the testing environment with new usability and efficiency attributes.

[1]  Anastasios A. Economides,et al.  Applying adaptive variables in computerised adaptive testing , 2007 .

[2]  Shunkai Fu,et al.  Multidimensional Computerized Adaptive Testing based on Bayesian Theory , 2006 .

[3]  Anastasios A. Economides,et al.  Personalized Feedback in CAT , 2005 .

[4]  Anastasios A. Economides,et al.  The Role of User Models in CAT: Exploring adaptivity variables , 2007 .

[5]  Max Mühlhäuser.  Multimedia software for elearning: an old topic seen in a new light , 2003, Fifth International Symposium on Multimedia Software Engineering, 2003. Proceedings..

[6]  Richard Vigilante.  Online Computer Scoring of Constructed-Response Questions , 1999 .

[7]  Steffen Staab,et al.  eLearning based on the semantic web , 2001 .

[8]  M.S. Cohen,et al.  Validating a criteria set for an online learning environment , 2004, 34th Annual Frontiers in Education, 2004. FIE 2004..

[9]  Anastasios A. Economides,et al.  A Review of Item Exposure Control Strategies for Computerized Adaptive Testing Developed from 1983 to 2005 , 2007 .

[10]  Fabio Paternò,et al.  CTTE: Support for Developing and Analyzing Task Models for Interactive System Design , 2002, IEEE Trans. Software Eng..

[11]  Michael T. Goodrich,et al.  PILOT: an interactive tool for learning and grading , 2000, SIGCSE '00.

[12]  Peter Dolog,et al.  Towards the Adaptive Semantic Web , 2003, PPSWR.

[13]  Steffen Staab,et al.  Accessing Distributed Learning Repositories through a Courseware Watchdog , 2002 .

[14]  David Jackson,et al.  Grading student programs using ASSYST , 1997, SIGCSE '97.

[15]  Patricia Wallace.  The Internet in the Workplace: How New Technology Is Transforming Work , 2004 .

[16]  Daniel D. Suthers,et al.  Developing Educational Software Components , 1999, Computer.

[17]  Edward A. Fox,et al.  Online evaluation in WWW-based courseware , 1997, SIGCSE '97.

[18]  Anastasios A. Economides,et al.  Evaluation parameters for computer-adaptive testing , 2006, Br. J. Educ. Technol..

[19]  Denise M. Woit,et al.  Student communication challenges in distributed software engineering environments , 2005, ITiCSE '05.

[21]  Marie De Beer,et al.  Use of CAT in Dynamic Testing , 2007 .

[22]  Denise M. Woit,et al.  Effectiveness of online assessment , 2003, SIGCSE.

[23]  Denise M. Woit,et al.  Enhancing student learning through on-line quizzes , 2000, SIGCSE '00.

[24]  Denise M. Woit,et al.  Integrating technology into computer science examinations , 1998, SIGCSE '98.

[25]  David Magis,et al.  Adaptive Estimators of Trait Level in Adaptive Testing: Some Proposals , 2007 .

[26]  Andreas Schmidt,et al.  User Context Aware Delivery of E-Learning Material: Approach and Architecture , 2004, J. Univers. Comput. Sci..