Semi-incremental Recognition of Online Handwritten Mathematical Expressions

This paper presents a semi-incremental recognition method for online handwritten mathematical expressions (MEs). The method reduces the waiting time after an ME is written until the result of recognition is output. Our method has two main processes, one is to process the latest stroke, the other is to find and correct wrong recognitions in the strokes up to the latest stroke. In the first process, the segmentation, recognition and Cocke-Younger-Kasami (CYK) algorithm are only executed for the latest stroke. In the second process, all the previous segmentations are updated if they are significantly changed after the latest stroke is input, and then, all the symbols related to the updated segmentations will be updated with their recognition scores. These changes are reflected into the CYK table. In addition, the waiting time is further reduced by employing multi-thread processes. Experiments on our data set show the effectiveness of this semi-incremental method which not only has higher recognition rate than our previous pure-incremental method but also keeps the waiting time unnoticeable.

[1]  Donald Ervin Knuth,et al.  The Art of Computer Programming, Volume II: Seminumerical Algorithms , 1970 .

[2]  Joan-Andreu Sánchez,et al.  Recognition of on-line handwritten mathematical expressions using 2D stochastic context-free grammars and hidden Markov models , 2014, Pattern Recognit. Lett..

[3]  Masaki Nakagawa,et al.  A System for Recognizing Online Handwritten Mathematical Expressions and Improvement of Structure Analysis , 2014, 2014 11th IAPR International Workshop on Document Analysis Systems.

[4]  Tomoichi Takahashi,et al.  A study of symbol segmentation method for handwritten mathematical formula recognition using mathematical structure information , 2004, ICPR 2004.

[5]  George Labahn,et al.  A new approach for recognizing handwritten mathematics using relational grammars and fuzzy sets , 2013, International Journal on Document Analysis and Recognition (IJDAR).

[6]  Cuong Tuan Nguyen,et al.  An incremental recognition method for online handwritten mathematical expressions , 2015, 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR).

[7]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[8]  R. Yamamoto,et al.  On-Line Recognition of Handwritten Mathematical Expression Based on Stroke-Based Stochastic Context-Free Grammar , 2006 .

[9]  Masaki Nakagawa,et al.  Objective Function Design for MCE-Based Combination of On-line and Off-line Character Recognizers for On-line Handwritten Japanese Text Recognition , 2011, 2011 International Conference on Document Analysis and Recognition.