Baseline structure analysis of handwritten mathematics notation

The structure of mathematics notation is particularly difficult to recognize in handwritten notation because irregular symbol placements are common. We present an efficient and robust method of parsing handwritten and typeset mathematics notation without backtracking. The system is designed to be easily adaptable to various dialects of mathematics notation. The following strategies are used: (1) separate the analysis of layout, syntax, and semantics, (2) recursively apply search functions and image partitioning to recognize dominant and nested baselines, and (3) use tree transformations to express computations in a compact, efficiently executable form.

[1]  Masayuki Okamoto,et al.  Structure analysis and recognition of mathematical expressions , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[2]  Genny Tortora,et al.  A framework of syntactic models for the implementation of visual languages , 1997, Proceedings. 1997 IEEE Symposium on Visual Languages (Cat. No.97TB100180).

[3]  Loïc Pottier,et al.  On-line handwritten formula recognition using hidden Markov models and context dependent graph grammars , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[4]  P. A. Chou,et al.  Recognition of Equations Using a Two-Dimensional Stochastic Context-Free Grammar , 1989, Other Conferences.

[5]  C. Faure,et al.  Structural analysis of handwritten mathematical expressions , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[6]  Stéphane Lavirotte,et al.  Mathematical formula recognition using graph grammar , 1998, Electronic Imaging.

[7]  James R. Cordy,et al.  The TXL Programming Language-Version 10 , 2000 .

[8]  James R. Cordy,et al.  TXL: A Rapid Prototyping System for Programming Language Dialects , 1991, Comput. Lang..

[9]  Dorothea Blostein,et al.  Mathematics recognition using graph rewriting , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[10]  R. H. Anderson,et al.  Two-Dimensional Mathematical Notation , 1977 .

[11]  Dorothea Blostein,et al.  RECOGNITION OF MATHEMATICAL NOTATION , 1997 .

[12]  Jean Paul Haton,et al.  A Syntactic Approach for Handwritten Mathematical Formula Recognition , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Shi-Kuo Chang,et al.  A method for the structural analysis of two-dimensional mathematical expressions , 1970, Inf. Sci..

[14]  Dit-Yan Yeung,et al.  Mathematical expression recognition: a survey , 2000, International Journal on Document Analysis and Recognition.

[15]  Andy Schürr,et al.  Computing with graphs and graph transformations , 1999 .

[16]  Manfred K. Lang,et al.  A soft-decision approach for structural analysis of handwritten mathematical expressions , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[17]  Masayuki Okamoto,et al.  An Experimental Implementation of a Document Recognition System for Papers Containing Mathematical Expressions , 1992 .

[18]  Robert M. Haralick,et al.  Understanding mathematical expressions from document images , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[19]  Paul A. Viola,et al.  Ambiguity and Constraint in Mathematical Expression Recognition , 1998, AAAI/IAAI.

[20]  Nicholas J. Higham,et al.  Handbook of writing for the mathematical sciences , 1993 .

[21]  Richard J. Fateman,et al.  Optical Character Recognition and Parsing of Typeset Mathematics1 , 1996, J. Vis. Commun. Image Represent..

[22]  Masakazu Suzuki,et al.  A technique of mathematical expression structure analysis for the handwriting input system , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[23]  James R. Cordy,et al.  The TXL Programming Language , 1995 .

[24]  James Arvo,et al.  A Handwritting-Based Equation Editor , 1999, Graphics Interface.

[25]  W. Cassie,et al.  Printing Mathematics , 2022, Nature.

[26]  Tetsuya Sakurai,et al.  Formalization and Parsing of Mathematical Expressions for Mathematical Computation , 1998 .

[27]  Horst Bunke,et al.  Handbook of Character Recognition and Document Image Analysis , 1997 .

[28]  Hsi-Jian Lee,et al.  Design of a mathematical expression understanding system , 1997, Pattern Recognit. Lett..

[29]  William A. Martin,et al.  Computer input/output of mathematical expressions , 1971, SYMSAC '71.

[30]  Ch. Faure,et al.  AUTOMATIC PERCEPTION OF THE STRUCTURE OF HANDWRITTEN MATHEMATICAL EXPRESSIONS , 1990 .

[31]  T. S. El-Sheikh.  Recognition of handwritten Arabic mathematical formulas , 1990 .

[32]  Andy Schürr,et al.  Computing with Graphs and Graph Transformations , 1999, Softw. Pract. Exp..

[33]  James Arvo,et al.  Aiding Manipulation of Handwritten Mathematical Expressions through Style-Preserving Morphs , 2001, Graphics Interface.

[34]  Richard Zanibbi,et al.  Recognition of mathematics notation via computer using baseline structure , 2000 .