Strategy and Tools for Collecting and Annotating Handwritten Descriptive Answers for Developing Automatic and Semi-Automatic Marking - An Initial Effort to Math

This paper presents our strategy to collect handwritten answer patterns for descriptive questions, which will be new benchmarks for the research on automatic and semi-automatic marking of descriptive answers as well as the most natural patterns for handwriting recognition research. Then, we describe two tools for collecting and annotating handwritten descriptive answers as well as our initiation of collecting math answers for developing their recognition and clustering. One tool, e-testing tool, works as the pattern collection tool and the other, e-marking tool, works as the annotation tool. We invite collaboration and sharing of the sample patterns, and then we conclude the paper with the current state of the effort and future directions.

[1]  Andrea Bunt,et al.  MathBrush: a case study for pen-based interactive mathematics , 2008, SBM'08.

[2]  Richard Zanibbi,et al.  Recognition and retrieval of mathematical expressions , 2011, International Journal on Document Analysis and Recognition (IJDAR).

[3]  中川 正樹,et al.  A Database of On-line Handwritten Mixed Objects named "Kondate" (パターン認識・メディア理解) , 2014 .

[4]  Dit-Yan Yeung,et al.  PenCalc: a novel application of on-line mathematical expression recognition technology , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[5]  Joseph J. LaViola,et al.  MathPad2: a system for the creation and exploration of mathematical sketches , 2004, ACM Trans. Graph..

[6]  Harold Mouchère,et al.  Towards Handwritten Mathematical Expression Recognition , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[7]  Joseph J. LaViola,et al.  A usability evaluation of AlgoSketch: a pen-based application for mathematics , 2009, SBIM '09.

[8]  Harold Mouchère,et al.  HAMEX - A Handwritten and Audio Dataset of Mathematical Expressions , 2011, 2011 International Conference on Document Analysis and Recognition.

[9]  Masaki Nakagawa,et al.  Collection of on-line handwritten Japanese character pattern databases and their analyses , 2004, Document Analysis and Recognition.

[10]  Harold Mouchère,et al.  Advancing the state of the art for handwritten math recognition: the CROHME competitions, 2011–2014 , 2016, International Journal on Document Analysis and Recognition (IJDAR).

[11]  Hung Tuan Nguyen,et al.  A database of unconstrained Vietnamese online handwriting and recognition experiments by recurrent neural networks , 2018, Pattern Recognit..

[12]  Václav Hlavác,et al.  MfrDB: Database of Annotated On-Line Mathematical Formulae , 2012, 2012 International Conference on Frontiers in Handwriting Recognition.

[13]  Joseph J. LaViola,et al.  MathPad2: a system for the creation and exploration of mathematical sketches , 2004, SIGGRAPH 2004.