A library of templates for exercise construction in an adaptive assessment system

Conventional computer testing systems usually offer items (questions) where examinees can only select one or more answers. In these systems, there is a fixed number of items to be administered to students. This implies that all students must answer the same number of questions, independently of their knowledge level. By contrast, adaptive testing systems are able to make more accurate predictions of student knowledge level with shorter tests, by choosing the most adequate item to ask next, depending on the current estimation of student knowledge level. In order to be reliable, adaptive testing requires a well-founded underlying theory. The theory mainly used is the Item Response Theory. On the other hand, items that usually appear in adaptive tests have a simple and maybe boring format: a stem and a set of answers. In this paper, a library of templates for the automatic construction of more sophisticated items is presented. These types of items are used in SIETTE, an adaptive web-based system for knowledge assessment by means of tests. This system also provides the capability of generating isomorphic items. With the same mechanism used in the construction of this library, SIETTE has been provided with the capability of restricting the time consumed by students while taking tests.

[1]  Edward E. Roskam,et al.  Models for Speed and Time-Limit Tests , 1997 .

[2]  S. Sireci,et al.  Validity Issues in Computer-Based Testing , 2005 .

[3]  I. Arroyo,et al.  2 An Adaptive Web-based Component for Cognitive Abilit y Estimation , 2000 .

[4]  Howard Wainer,et al.  Computerized Adaptive Testing: A Primer , 2000 .

[5]  Ricardo Conejo,et al.  SIETTE: A Web-Based Tool for Adaptive Testing , 2004, Int. J. Artif. Intell. Educ..

[6]  Cynthia G. Parshall,et al.  Innovative Item Types for Computerized Testing , 2000 .

[7]  Eduardo Guzmán,et al.  An Educational Component Based Framework for Web ITS Development , 2003, ICWE.

[8]  N. D. Verhelst,et al.  A Logistic Model for Time-Limit Tests , 1992 .

[9]  Eduardo Guzmán,et al.  Simultaneous Evaluation of Multiple Topics in SIETTE , 2002, Intelligent Tutoring Systems.

[10]  Peter Brusilovsky,et al.  ELM-ART: An Adaptive Versatile System for Web-based Instruction , 2001 .

[11]  Athayde Ribeiro da Silva.  A model for intelligence , 1984 .

[12]  R. Hambleton,et al.  Item Response Theory: Principles and Applications , 1984 .

[13]  David Thissen,et al.  Repealing rules that no longer apply to psychological measurement. , 1993 .

[14]  Melvin R. Novick,et al.  Some latent train models and their use in inferring an examinee's ability , 1966 .

[15]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[16]  Lawrence Mandow,et al.  Automatic Generation of Problems in Web-Based Tutors , 2002 .

[17]  R. Owen,et al.  A Bayesian Sequential Procedure for Quantal Response in the Context of Adaptive Mental Testing , 1975 .

[18]  David O'Hare,et al.  Item selection and application in Higher Education , 2002 .

[19]  Vicente Ponsoda Gil,et al.  Tests adaptativos informatizados , 1996 .

[20]  Steven J. Osterlind,et al.  Constructing Test Items: Multiple-Choice, Constructed-Response, Performance and Other Formats , 2006 .