Using fuzzy logic to analyze superscript and subscript relations in handwritten mathematical expressions

Handwritten mathematical notation contains ambiguities of various kinds. Here we focus on ambiguity in spatial relationships; in particular, we use fuzzy logic to treat ambiguity in subscript-or-inline and inline-or-superscript spatial relationships. We extend an existing system for recognizing handwritten mathematical notation, adding the capability of producing a ranked list of interpretations rather than a single top-choice interpretation. Fuzzy membership values are assigned to each spatial relationship; a given pair of symbols can have non-zero membership in fuzzy sets subscript and inline, or in fuzzy sets inline and superscript. These fuzzy membership values are combined to produce an overall confidence value for the entire interpretation. We have modified the user interface of our system so that a user can quickly view and select from the ranked interpretations when the highest confidence interpretation is incorrect.

[1]  Manfred K. Lang,et al.  A soft-decision approach for structural analysis of handwritten mathematical expressions , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[2]  Dit-Yan Yeung,et al.  Mathematical expression recognition: a survey , 2000, International Journal on Document Analysis and Recognition.

[3]  T. Ross.  Fuzzy Logic with Engineering Applications , 1994 .

[4]  P. A. Chou,et al.  Recognition of Equations Using a Two-Dimensional Stochastic Context-Free Grammar , 1989, Other Conferences.

[5]  C. Faure,et al.  Structural analysis of handwritten mathematical expressions , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[6]  Raúl Rojas,et al.  Recognition of on-line handwritten mathematical formulas in the E-chalk system , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[7]  N. Singpurwalla,et al.  Membership Functions and Probability Measures of Fuzzy Sets , 2004 .

[8]  James Arvo,et al.  Equation entry and editing via handwriting and gesture recognition , 2001, Behav. Inf. Technol..

[9]  Dorothea Blostein,et al.  RECOGNITION OF MATHEMATICAL NOTATION , 1997 .

[10]  Paul A. Viola,et al.  Ambiguity and Constraint in Mathematical Expression Recognition , 1998, AAAI/IAAI.

[11]  Richard Zanibbi,et al.  Recognizing Mathematical Expressions Using Tree Transformation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Masakazu Suzuki,et al.  Mathematical formula recognition using virtual link network , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[13]  Dorothea Blostein,et al.  Mathematics recognition using graph rewriting , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[14]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[15]  Jane M. Booker,et al.  Fuzzy Logic and Probability Applications , 2002, Fuzzy Logic and Probability Applications.

[16]  Siegfried Gottwald,et al.  Fuzzy Sets and Fuzzy Logic , 1993 .

[17]  Horst Bunke,et al.  Handbook of Character Recognition and Document Image Analysis , 1997 .