Structural analysis of handwritten mathematical expressions through fuzzy parsing

Including mathematical expressions in documents can be a tiresome and difficult process. A recognition system for handwritten mathematical expressions would greatly simplify the task, enabling users to enter expressions in an intuitive manner. In this paper a powerful yet efficient approach to handwritten mathematical expression recognition is presented. Our approach is built upon traditional shift-reduce parsing methods which have linear complexity, thus providing the necessary syntax checking and also the basis for an efficient system. Fuzzy logic is introduced to the basic parsing framework, which is appropriate given the ambiguous nature of symbol identities and spatial relationships in handwritten expressions. Multiple parses are explored whenever strong ambiguities arise, and the most likely expression tree is selected as the result.

[1]  Alfred V. Aho,et al.  Principles of Compiler Design , 1977 .

[2]  Manfred K. Lang,et al.  A soft-decision approach for structural analysis of handwritten mathematical expressions , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[3]  Dit-Yan Yeung,et al.  An efficient syntactic approach to structural analysis of on-line handwritten mathematical expressions , 2000, Pattern Recognit..

[4]  Donald E. Knuth,et al.  Semantics of context-free languages , 1968, Mathematical systems theory.

[5]  Horst Bunke,et al.  Handbook of Character Recognition and Document Image Analysis , 1997 .

[6]  Dorothea Blostein,et al.  Mathematics recognition using graph rewriting , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[7]  Dorothea Blostein,et al.  RECOGNITION OF MATHEMATICAL NOTATION , 1997 .

[8]  Alfred V. Aho,et al.  Principles of Compiler Design (Addison-Wesley series in computer science and information processing) , 1977 .

[9]  Dit-Yan Yeung,et al.  Mathematical expression recognition: a survey , 2000, International Journal on Document Analysis and Recognition.

[10]  Lotfi A. Zadeh,et al.  Outline of a New Approach to the Analysis of Complex Systems and Decision Processes , 1973, IEEE Trans. Syst. Man Cybern..

[11]  John A. Fitzgerald,et al.  Application of fuzzy logic to online recognition of handwritten symbols , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[12]  Peter R.J. Asveld,et al.  A Fuzzy Approach to Erroneous Inputs in Context-Free Language Recognition , 1995, IWPT.

[13]  Robert H. Anderson Syntax-directed recognition of hand-printed two-dimensional mathematics , 1967, Symposium on Interactive Systems for Experimental Applied Mathematics.

[14]  Bidyut Baran Chaudhuri,et al.  Recognition of online handwritten mathematical expressions , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Richard Zanibbi,et al.  Recognizing Mathematical Expressions Using Tree Transformation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..