Automatic recognition of handwritten corrections for multiple-choice exam answer sheets

Automated grading of multiple-choice exams is of great interest in university courses with a large number of students. We consider an existing system in which exams are automatically graded using simple answer sheets that are annotated by the student. A sheet consists of a series of circles representing possible answers. As annotation errors are possible, a student is permitted to alter the annotated answer by annotating the“error” circle and handwriting the letter of the correct answer next to the appropriate row. During the scanning process, if an annotated“error” circle is detected, the system raises an alarm and requires intervention from a human operator to determine which answer to consider valid. We propose rather simple and effecive computer vision algorithm which enables automated reading of a limited set of handwritten answers and minimizes the need for a human intervention in the scanning process. We test our algorithm on a large dataset of real scanned answer sheets, and report encouraging performance rates.

[1]  Marko Cupic A case study: using multiple-choice tests at university level courses - preparation and supporting infrastructure , 2010, Int. J. Intell. Def. Support Syst..

[2]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[3]  Zoran Kalafatic,et al.  Supporting automated grading of formative multiple choice exams by introducing student identifier matrices , 2011, 2011 Proceedings of the 34th International Convention MIPRO.

[4]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[5]  Željka Mihajlović,et al.  Software Environment for Learning and Knowledge Assessment Based on Graphical Gadget , 2012 .

[6]  Nikola Bogunovic,et al.  Decision Tree Ensembles in Biomedical Time-Series Classification , 2012, DAGM/OAGM Symposium.

[7]  Paul D. Gader,et al.  Handwritten Word Recognition Using Segmentation-Free Hidden Markov Modeling and Segmentation-Based Dynamic Programming Techniques , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Ching Y. Suen,et al.  HYBRID SCHEMES OF HOMOGENEOUS AND HETEROGENEOUS CLASSIFIERS FOR CURSIVE WORD RECOGNITION , 2004 .

[9]  Lambert Schomaker,et al.  Handwritten Character Classification using the Hotspot Feature Extraction Technique , 2012, ICPRAM.

[10]  Anil K. Jain,et al.  Feature extraction methods for character recognition-A survey , 1996, Pattern Recognit..

[11]  Željka Mihajlović,et al.  Computer-Based Knowledge, Self-Assessment and Training* , 2010 .

[12]  Nafiz Arica,et al.  An overview of character recognition focused on off-line handwriting , 2001, IEEE Trans. Syst. Man Cybern. Syst..

[13]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[14]  Stavros J. Perantonis,et al.  Handwritten character recognition through two-stage foreground sub-sampling , 2010, Pattern Recognit..