论文信息 - System for Online Detection of Aberrant Responses in E-Testing

System for Online Detection of Aberrant Responses in E-Testing

We have developed a method for online detection of examinees' aberrant responses. This method uses response time data in e-testing. Unique features of this method are: 1. It includes an outlier detection method using Bayesian predictive distribution. 2. It can be used with small-sample sets. 3. It provides a unified statistical test method of various statistical tests by changing hyper-parameters and provides more accurate test results than commonly used methods. 4. Outlier statistics are estimated by considering both examinee abilities and the difficulty level of items. We evaluated this system, and results of our evaluation show that it is effective.

Maomi Ueno | Toshio Okamoto | M. Ueno | Toshio Okamoto

[1] Dino Pedreschi,et al. A classification-based methodology for planning audit strategies in fraud detection , 1999, KDD '99.

[2] Edward E. Roskam,et al. Models for Speed and Time-Limit Tests , 1997 .

[3] Salvatore J. Stolfo,et al. Mining in a data-flow environment: experience in network intrusion detection , 1999, KDD '99.

[4] Kikumi K. Tatsuoka,et al. Indices for Detecting Unusual Patterns: Links Between Two General Approaches and Potential Applications , 1983 .

[5] Willem J. van der Linden,et al. A lognormal model for response times on test items , 2006 .

[6] N. D. Verhelst,et al. A Logistic Model for Time-Limit Tests , 1992 .

[7] David Thissen,et al. Timed Testing: An Approach Using Item Response Theory , 1983 .

[8] Kikumi K. Tatsuoka,et al. Detection of Aberrant Response Patterns and their Effect on Dimensionality , 1982 .

[9] Maomi Ueno. Web based Computerized Testing System for Distance Education , 2005 .

[10] Cynthia G. Parshall,et al. Practical Considerations in Computer-Based Testing , 2002 .

[11] Maomi Ueno,et al. On-line Data-analysis of e-Learning Response Time using Gamma Distribution , 2006 .

[12] Vic Barnett,et al. Outliers in Statistical Data , 1980 .

[13] Tom Fawcett,et al. Combining Data Mining and Machine Learning for Effective Fraud Detection , 1997 .

[14] John Shawe-Taylor,et al. Detecting Cellular Fraud Using Adaptive Prototypes. , 1997, AAAI 1997.