Communicating Mathematics via Pen-Based Interfaces

We address the question of how to organize pen-based interfaces for mathematical software systems, both for computational mathematics packages and document processing software. Our architecture includes components for ink collection, mathematically-oriented recognizers, portability support and interfaces to applications. We summarize aspects of mathematical handwriting recognition and discuss the methods we have used for individual character recognition and overall expression analysis. We present our pen-based computing environment, Mathink, and give an overview of facilities for training, ink annotation, and testing.

[1]  Rob Gordon,et al.  Essential Jni: Java Native Interface , 1998 .

[2]  Charles C. Tappert,et al.  Cursive Script Recognition by Elastic Matching , 1982, IBM J. Res. Dev..

[3]  Stephen M. Watt,et al.  Aspects of Mathematical Expression Analysis in Arabic Handwriting , 2007 .

[4]  Richard Zanibbi,et al.  Recognizing Mathematical Expressions Using Tree Transformation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Stephen M. Watt,et al.  Online stroke modeling for handwriting recognition , 2008, CASCON '08.

[6]  Stephen M. Watt,et al.  Online computation of similarity between handwritten characters , 2009, Electronic Imaging.

[7]  Birendra Keshari.  Mathematical Symbol Recognition using SVMs with Features from Functional Approximation , 2008 .

[8]  Bruce W. Char,et al.  Representing and Characterizing Handwritten Mathematical Symbols through Succinct Functional Approximation , 2007 .

[9]  Stephen M. Watt.  An Empirical Measure on the Set of Symbols Occurring in Engineering Mathematics Texts , 2008, 2008 The Eighth IAPR International Workshop on Document Analysis Systems.

[10]  Mark Davis,et al.  The Unicode Standard, Version 3.0 , 2000 .

[11]  Stephen M. Watt Xiaofang Xie.  Prototype Pruning by Feature Extraction for Handwritten Mathematical Symbol Recognition , 2005 .

[12]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[13]  Lucy Zhang.  Survey of User Input Models for Mathematical Recognition: Keyboards, Mice, Tablets, Voice , 2003 .

[14]  Paul A. Viola,et al.  Learning from one example through shared densities on transforms , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[15]  Pat Villani.  Programming Win32 Under the API , 2001 .

[16]  Ron Avitzur.  Your own handprinting recognition engine , 1992 .

[17]  Philip Ti-Fei Su,et al.  Building Tablet PC Applications , 2002 .

[18]  Stephen M. Watt,et al.  An Interactive Mathematical Handwriting Recognizer for the Pocket PC , 2002 .

[19]  Ian Rutherford.  Structural Analysis for Pen-Based Math Input Systems , 2005 .

[20]  Masakazu Suzuki,et al.  Infty Editor : A Mathematics Typesetting Tool with a Handwriting Interface and a Graphical Front-End to OpenXM Servers (Computer Algebra : Algorithms, Implementations and Applications) , 2003 .

[21]  D. Cheriton,et al.  A preliminary report on the MathBrush pen-math system , 2006 .

[22]  Han Shu.  On-line handwriting recognition using hidden Markov models , 1997 .

[23]  Stephen M. Watt,et al.  Recognition for large sets of handwritten mathematical symbols , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[24]  V. Hlavac,et al.  Mathematical Formulae Recognition Using 2D Grammars , 2007 .

[25]  James Arvo,et al.  Aiding Manipulation of Handwritten Mathematical Expressions through Style-Preserving Morphs , 2001, Graphics Interface.

[26]  Reiner Marzinkewitsch.  Operating computer algebra systems by handprinted input , 1991, ISSAC '91.

[27]  Stephen M. Watt,et al.  Context Sensitive Mathematical Character Recognition , 2008 .

[28]  Toshihiro Kanahori,et al.  Infty Editor -AMathematics Typesetting Tool with aHandwriting Interface and aGraphical Front-End to OpenXM Servers , 2003 .

[29]  Stephen M. Watt,et al.  Hybrid Mathematical Symbol Recognition Using Support Vector Machines , 2007 .

[30]  David A Chappell.  Understanding ActiveX and OLE , 1996 .

[31]  James Arvo,et al.  A Handwritting-Based Equation Editor , 1999, Graphics Interface.

[32]  Stephen M. Watt,et al.  A pen-based mathematical environment Mathink , 2006 .