A Web-Based E-Testing System Supporting Test Quality Improvement

In e-testing it is important to administer tests composed of good quality question items. By the term "quality" we intend the potential of an item in effectively discriminating between strong and weak students and in obtaining tutor's desired difficulty level. Since preparing items is a difficult and time-consuming task, good items can be re-used for future tests. Among items with lower performances, instead, some should be discarded, while some can be modified and then re-used. This paper presents a Web-based e-testing system which detects defective question items and, when possible, provides the tutors with advice to improve their quality. The system detects defective items by firing rules. Rules are evaluated by a fuzzy logic inference engine. The proposed system has been used in a course at the University of Salerno.

[1]  Peter Bancroft,et al.  Multiple Choice Questions Not Considered Harmful , 2005, ACE.

[2]  Timothy K. Shih,et al.  A cognition assessment authoring system for e-learning , 2004, 24th International Conference on Distributed Computing Systems Workshops, 2004. Proceedings..

[3]  H. Trussell,et al.  Constructing membership functions using statistical data , 1986 .

[4]  S. C. Johnson.  Hierarchical clustering schemes , 1967, Psychometrika.

[5]  George A. Miller,et al.  Human memory and the storage of information , 1956, IRE Trans. Inf. Theory.

[6]  Lucien Duckstein,et al.  Fuzzy Rule-Based Modeling with Applications to Geophysical, Biological and Engineering Systems , 1995 .

[7]  Yung-Chin Yen,et al.  Design and evaluation of an XML-based platform-independent computerized adaptive testing system , 2005, IEEE Trans. Educ..

[8]  Chih-Ming Chen,et al.  A personalized courseware recommendation system based on fuzzy item response theory , 2004, IEEE International Conference on e-Technology, e-Commerce and e-Service, 2004. EEE '04. 2004.

[9]  Koun-Tem Sun.  An effective item selection method for educational measurement , 2000, Proceedings International Workshop on Advanced Learning Technologies. IWALT 2000. Advanced Learning Technology: Design and Development Issues.

[10]  Marilyn Schwartz,et al.  Guidelines for bias-free writing , 1995 .

[11]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[12]  R. Hambleton,et al.  Item Response Theory , 1984, The History of Educational Measurement.

[13]  F. Ferrucci,et al.  A Web based tool for assessment and self-assessment , 2004, ITRE 2004. 2nd International Conference Information Technology: Research and Education.

[14]  Ching-Tang Hsieh,et al.  Feedback and analysis from assessment metadata in e-learning , 2003, 17th International Conference on Advanced Information Networking and Applications, 2003. AINA 2003..