Mode detection in on-line pen drawing and handwriting recognition

On-line pen input benefits greatly from mode detection when the user is in a free writing situation, where he is allowed to write, to draw, and to generate gestures. Mode detection is performed before recognition to restrict the classes that a classifier has to consider, thereby increasing the performance of the overall recognition. In this paper we present a hybrid system which is able to achieve a mode detection performance of 95.6% on seven classes; handwriting, lines, arrows, ellipses, rectangles, triangles, and diamonds. The system consists of three kNN classifiers which use global and structural features of the pen trajectory and a fitting algorithm for verifying the different geometrical objects. Results are presented on a significant amount of data, acquired in different contexts like scribble matching and design applications.

[1]  Don WILLEMS,et al.  Features for mode detection in natural online pen input , 2005 .

[2]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[3]  Herbert Freeman,et al.  Computer Processing of Line-Drawing Images , 1974, CSUR.

[4]  Guojun Lu,et al.  Review of shape representation and description techniques , 2004, Pattern Recognit..

[5]  Balaji Krishnapuram,et al.  Generative models and Bayesian model comparison for shape recognition , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[6]  Noël Bonnet,et al.  An unsupervised generalized Hough transform for natural shapes , 2002, Pattern Recognit..

[7]  Olivier Ecabert,et al.  Adaptive Hough transform for the detection of natural shapes under weak affine transformations , 2004, Pattern Recognit. Lett..

[8]  Anil K. Jain,et al.  Structure in on-line documents , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[9]  Alfred Kobsa,et al.  User Interfaces for All , 1999 .

[10]  Louis Vuurpijl,et al.  Multimodal Interaction in Architectural Design Applications , 2004, User Interfaces for All.

[11]  Christopher M. Bishop,et al.  Distinguishing text from graphics in on-line handwritten ink , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[12]  Ronald L. Graham,et al.  An Efficient Algorithm for Determining the Convex Hull of a Finite Planar Set , 1972, Inf. Process. Lett..

[13]  J. IIVARINENHelsinki.  Efficiency of Simple Shape Descriptors , 1997 .

[14]  Isabelle Guyon,et al.  UNIPEN project of on-line data exchange and recognizer benchmarks , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[15]  Herbert Freeman,et al.  On the Encoding of Arbitrary Geometric Configurations , 1961, IRE Trans. Electron. Comput..

[16]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[17]  Louis Vuurpijl,et al.  Mode detection and incremental recognition , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[18]  Joaquim A. Jorge,et al.  Experimental evaluation of an on-line scribble recognizer , 2001, Pattern Recognit. Lett..

[19]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..