Towards a web-based progressive handwriting recognition environment for mathematical problem solving

The emergence of pen-based mobile devices such as PDAs and tablet PCs provides a new way to input mathematical expressions to computer by using handwriting which is much more natural and efficient for entering mathematics. This paper proposes a web-based handwriting mathematics system, called WebMath, for supporting mathematical problem solving. The proposed WebMath system is based on client-server architecture. It comprises four major components: a standard web server, handwriting mathematical expression editor, computation engine and web browser with Ajax-based communicator. The handwriting mathematical expression editor adopts a progressive recognition approach for dynamic recognition of handwritten mathematical expressions. The computation engine supports mathematical functions such as algebraic simplification and factorization, and integration and differentiation. The web browser provides a user-friendly interface for accessing the system using advanced Ajax-based communication. In this paper, we describe the different components of the WebMath system and its performance analysis.

[1]  Toshihiro Kanahori,et al.  Infty Editor -AMathematics Typesetting Tool with aHandwriting Interface and aGraphical Front-End to OpenXM Servers , 2003 .

[2]  P. A. Chou,et al.  Recognition of Equations Using a Two-Dimensional Stochastic Context-Free Grammar , 1989, Other Conferences.

[3]  Masakazu Suzuki,et al.  Structural Analysis of Mathematical Formulae with Verification Based on Formula Description Grammar , 2006, Document Analysis Systems.

[4]  Toshihiro Kanahori,et al.  Authoring Tool for Mathematical Documents-Infty - , 2004 .

[5]  Siu Cheung Hui,et al.  Progressive structural analysis for dynamic recognition of on-line handwritten mathematical expressions , 2008, Pattern Recognit. Lett..

[6]  Masakazu Suzuki,et al.  INFTY: an integrated OCR system for mathematical documents , 2003, DocEng '03.

[7]  James Arvo,et al.  A Handwritting-Based Equation Editor , 1999, Graphics Interface.

[8]  Raúl Rojas,et al.  Recognition of On-line Handwritten Mathematical Expressions Using a Minimum Spanning Tree Construction and Symbol Dominance , 2003, GREC.

[9]  Richard Zanibbi,et al.  Recognizing Mathematical Expressions Using Tree Transformation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Dorothea Blostein,et al.  RECOGNITION OF MATHEMATICAL NOTATION , 1997 .

[11]  Nicholas E. Matsakis.  Recognition of Handwritten Mathematical Expressions , 1999 .

[12]  Dit-Yan Yeung,et al.  An efficient syntactic approach to structural analysis of on-line handwritten mathematical expressions , 2000, Pattern Recognit..

[13]  Kurt Kleiner,et al.  A Natural Log , 2008 .

[14]  A. Kosmala,et al.  ON-LINE HANDWRITTEN FORMULA RECOGNITION , 1999 .

[15]  C. Peng,et al.  SCALABLE VECTOR GRAPHICS (SVG) , 2000 .

[16]  Richard J. Fateman,et al.  Optical Character Recognition and Parsing of Typeset Mathematics1 , 1996, J. Vis. Commun. Image Represent..

[17]  Raúl Rojas,et al.  Recognition of on-line handwritten mathematical expressions in the E-Chalk system - an extension , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[18]  Andreas Neumann.  Scalable Vector Graphics (SVG) , 2008, Encyclopedia of GIS.

[19]  Jesse James Garrett.  Ajax: A New Approach to Web Applications , 2007 .

[20]  Dit-Yan Yeung,et al.  Elastic structural matching for online handwritten alphanumeric character recognition , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[21]  James Arvo,et al.  Equation entry and editing via handwriting and gesture recognition , 2001, Behav. Inf. Technol..

[22]  Gerhard Rigoll,et al.  On-line handwritten formula recognition using statistical methods , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[23]  Eric W. Brown.  Applying Neural Networks to Character Recognition , 1992 .

[24]  Dit-Yan Yeung,et al.  Mathematical expression recognition: a survey , 2000, International Journal on Document Analysis and Recognition.

[25]  Stephane Lavirotte.  Optical formula recognition , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.