Manual Grading Task Support System with Interactive Correction Mechanism

Gesture-based recognition is one of the most intuitive methods for inputting information and is not subject to cumbersome operations. Recognition is performed on human’s consecutive motion without reference to retrial or alternation by user. We propose a gesture recognition model with a mechanism for correcting recognition errors that operates interactively and is practical. We applied the model to a setting involving a manual grading task in order to verify its effectiveness. Our system, named GERMIC, consists of two major modules, namely, handwritten recognition and interactive correction. Recognition is materialized with image feature extraction and convolutional neural network. A mechanism for interactive correction is called on-demand by a user-based trigger. GERMIC monitors, track, and stores information on the user’s grading task and generates output based on the recognition information collected. In contrast to conventional grading done manually, GERMIC significantly shortens the total time for completing the task by 24.7% and demonstrates the effectiveness of the model with interactive correction in two real world user environments.

[1]  Jose Luis Perez-Benedito,et al.  Optical Mark Recognition in Student Continuous Assessment , 2014, IEEE Revista Iberoamericana de Tecnologias del Aprendizaje.

[2]  Noriaki Kuwahara,et al.  Wearable sensors for auto-event-recording on medical nursing - user study of ergonomic design , 2004, Eighth International Symposium on Wearable Computers.

[3]  Stephen H. Edwards,et al.  Work-in-progress: program grading and feedback generation with Web-CAT , 2014, L@S.

[4]  K. Koile,et al.  Supporting Pen-Based Classroom Interaction: New Findings and Functionality for Classroom Learning Partner , 2007, First International Workshop on Pen-Based Learning Technologies (PLT 2007).

[5]  Abdul Rahim Ahmad,et al.  Online handwriting recognition using support vector machine , 2004, 2004 IEEE Region 10 Conference TENCON 2004..

[6]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[7]  Antonija Mitrovic,et al.  Intelligent Augmented Reality Training for Motherboard Assembly , 2015, International Journal of Artificial Intelligence in Education.

[8]  Ramana Rao,et al.  Bridging the paper and electronic worlds: the paper user interface , 1993, INTERCHI.

[9]  Junsong Yuan,et al.  Robust hand gesture recognition based on finger-earth mover's distance with a commodity depth camera , 2011, ACM Multimedia.

[10]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[11]  Davide Anguita,et al.  Transition-Aware Human Activity Recognition Using Smartphones , 2016, Neurocomputing.

[12]  Hermann Ney,et al.  Fast and Robust Training of Recurrent Neural Networks for Offline Handwriting Recognition , 2014, 2014 14th International Conference on Frontiers in Handwriting Recognition.

[13]  Kimberle Koile,et al.  Supporting Feedback and Assessment of Digital Ink Answers to In-Class Exercises , 2007, AAAI.

[14]  Tanja Schultz,et al.  Airwriting: a wearable handwriting recognition system , 2013, Personal and Ubiquitous Computing.

[15]  James H. Oliver,et al.  Augmented Reality-Based Manual Assembly Support With Visual Features for Different Degrees of Difficulty , 2015, Int. J. Hum. Comput. Interact..

[16]  Junsong Yuan,et al.  Robust hand gesture recognition with kinect sensor , 2011, ACM Multimedia.

[17]  Kadir Tohma,et al.  Webcam Based Real-Time Robust Optical Mark Recognition , 2015, ICONIP.

[18]  Gokhan Bayar The Use of Hough Transform to Develop an Intelligent Grading System for the Multiple Choice Exam Papers , 2016 .

[19]  Kimberle Koile,et al.  Improving digital ink interpretation through expected type prediction and dynamic dispatch , 2008, 2008 19th International Conference on Pattern Recognition.

[20]  Megumi Yamamoto,et al.  Automated Essay Scoring System Based on Rubric , 2017 .

[21]  Ming Liu,et al.  Automated Essay Feedback Generation and Its Impact on Revision , 2017, IEEE Transactions on Learning Technologies.

[22]  Julio C. Caiza,et al.  PROGRAMMING ASSIGNMENTS AUTOMATIC GRADING: REVIEW OF TOOLS AND IMPLEMENTATIONS , 2013 .

[23]  Yi-Chuan Hsieh,et al.  The Impact of Web-Based Assessment and Practice on Students' Mathematics Learning Attitudes , 2006 .

[24]  Ching Y. Suen,et al.  Analysis of errors of handwritten digits made by a multitude of classifiers , 2005, Pattern Recognit. Lett..