Recognizing handwritten mathematics via fuzzy parsing

We present a new approach to multi-dimensional parsing using relational grammars and fuzzy sets. A fast, incremental parsing algorithm is developed, motivated by the two-dimensional structure of written mathematics. Our approach makes no hard decisions; recognized math expressions are reported to the user in ranked order. A exible correction mechanism enables users to quickly choose the correct math expression in case of recognition errors or ambiguity.

[1]  Ian Rutherford.  Structural Analysis for Pen-Based Math Input Systems , 2005 .

[2]  Joseph J. LaViola,et al.  AlgoSketch: algorithm sketching and interactive computation , 2008, SBM'08.

[3]  Bidyut Baran Chaudhuri,et al.  A corpus for OCR research on mathematical expressions , 2004, International Journal of Document Analysis and Recognition (IJDAR).

[4]  George Labahn,et al.  Grammar-based techniques for creating ground-truthed sketch corpora , 2010, International Journal on Document Analysis and Recognition (IJDAR).

[5]  John A. Fitzgerald,et al.  Mathpad: A Fuzzy Logic-Based Recognition System for Handwritten Mathematics , 2007, Ninth International Conference on Document Analysis and Recognition (ICDAR 2007).

[6]  George Labahn,et al.  Elastic matching in linear time and constant space , 2009 .

[7]  Harold Mouchère,et al.  Towards Handwritten Mathematical Expression Recognition , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[8]  R. Yamamoto,et al.  On-Line Recognition of Handwritten Mathematical Expression Based on Stroke-Based Stochastic Context-Free Grammar , 2006 .

[9]  Joseph J. LaViola,et al.  Mathematical Sketching: A New Approach to Creating and Exploring Dynamic Illustrations , 2005 .

[10]  Tahar Kechadi,et al.  Mathpad: A Fuzzy Logic-Based Recognition System for Handwritten Mathematics , 2007 .

[11]  Richard Zanibbi,et al.  Recognizing Mathematical Expressions Using Tree Transformation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Volker Sorge,et al.  Faithful mathematical formula recognition from PDF documents , 2010, DAS '10.

[13]  Masakazu Suzuki,et al.  Structural Analysis of Mathematical Formulae with Verification Based on Formula Description Grammar , 2006, Document Analysis Systems.

[14]  Ling Zhang,et al.  Using fuzzy logic to analyze superscript and subscript relations in handwritten mathematical expressions , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[15]  Fred P. Brooks,et al.  The Mythical Man-Month , 1975, Reliable Software.

[16]  ZanibbiRichard,et al.  Recognizing Mathematical Expressions Using Tree Transformation , 2002 .

[17]  George Labahn,et al.  Tools for the efficient generation of hand-drawn corpora based on context-free grammars , 2009, SBIM '09.

[18]  V. Hlavac,et al.  Mathematical Formulae Recognition Using 2D Grammars , 2007 .

[19]  Robert H. Anderson,et al.  An on-line symbolic mathematics system using hand-printed two-dimensional notation , 1969, ACM '69.

[20]  Paul A. Viola,et al.  Efficient geometric algorithms for parsing in two dimensions , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[21]  Marko Panic.  Math Handwriting Recognition in Windows 7 and Its Benefits , 2009, Calculemus/MKM.

[22]  George Labahn,et al.  MathBrush: A System for Doing Math on Pen-Based Devices , 2008, 2008 The Eighth IAPR International Workshop on Document Analysis Systems.

[23]  Dit-Yan Yeung,et al.  Error detection, error correction and performance evaluation in on-line mathematical expression recognition , 2001, Pattern Recognit..

[24]  Václav Hlavác,et al.  Mathematical Formulae Recognition Using 2D Grammars , 2007, Ninth International Conference on Document Analysis and Recognition (ICDAR 2007).