Adaptive Online Multi-stroke Sketch Recognition Based on Hidden Markov Model

This paper presents a novel approach for adaptive online multi-stroke sketch recognition based on Hidden Markov Model (HMM). The method views the drawing sketch as the result of a stochastic process that is governed by a hidden stochastic model and identified according to its probability of generating the output. To capture a user’s drawing habits, a composite feature combining both geometric and dynamic characteristics of sketching is defined for sketch representation. To implement the stochastic process of online multi-stroke sketch recognition, multi-stroke sketching is modeled as an HMM chain while the strokes are mapped as different HMM states. To fit the requirement of adaptive online sketch recognition, a variable state-number determining method for HMM is also proposed. The experiments prove both the effectiveness and efficiency of the proposed method.

[1]  Joaquim A. Jorge,et al.  CALI: An Online Scribble Recognizer for Calligraphic Interfaces , 2002 .

[2]  Jianying Hu,et al.  HMM Based On-Line Handwriting Recognition , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Jay J. Lee,et al.  Data-Driven Design of HMM Topology for Online Handwriting Recognition , 2001, Int. J. Pattern Recognit. Artif. Intell..

[4]  Jing Liu,et al.  Informal User Interface for Graphical Computing , 2005, ACII.

[5]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[6]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[7]  Jin Xiangyu,et al.  An online composite graphics recognition approach based on matching of spatial relation graphs , 2004 .

[8]  Shigeki Sagayama,et al.  Substroke approach to HMM-based on-line Kanji handwriting recognition , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[9]  JinHyung Kim,et al.  Data-driven Design of HMM Topology for On-line Handwriting Recognition , 2000 .

[10]  Mark W. Newman,et al.  DENIM: An Informal Web Site Design Tool Inspired by Observations of Practice , 2003, Hum. Comput. Interact..

[11]  Jen-Tzung Chien,et al.  Online unsupervised learning of hidden Markov models for adaptive speech recognition , 2001 .

[12]  Bin Zhang,et al.  User Adaptation for Online Sketchy Shape Recognition , 2003, GREC.

[13]  L. Prasanth,et al.  HMM-Based Online Handwriting Recognition System for Telugu Symbols , 2007 .

[14]  James A. Landay,et al.  Sketching Interfaces: Toward More Human Interface Design , 2001, Computer.

[15]  L. Kara,et al.  Recognizing Multi-Stroke Symbols , 2002 .

[16]  Zhengxing Sun,et al.  An Incremental Learning Method Based on SVM for Online Sketchy Shape Recognition , 2005, ICNC.