Computer Vision Techniques for Hidden Conditional Random Field-Based Mandarin Phonetic Symbols I Recognition

This paper presents a handwritten recognition method using camera as human-computer interaction device (HCI) for Mandarin Phonetic Symbols I (MPS1). The method is based on a hidden conditional random field (HCRF) model, which is an extension of the conditional random field (CRF) framework that incorporates hidden variables. The main advantage of the proposed method is that it avoids limitations of the traditional hidden Markov model (HMM)-based methods. This work built an HCRF for each symbol of MPS1 and used twelve-dimensional features. The features in the proposed system include the stroke length ratio feature, the horizontal stroke feature, the vertical stroke feature, the stroke-based loci features, and the stroke curvature feature. The recognition rate achieved 94.05% on 1532 handwritten word samples covering 37 symbols.

[1]  Fernando Pereira,et al.  Shallow Parsing with Conditional Random Fields , 2003, NAACL.

[2]  Yang Liu,et al.  Hand-Gesture Based Text Input for Wearable Computers , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[3]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[4]  Bernhard Pfahringer,et al.  A discriminative approach to structured biological data , 2007 .

[5]  Tracy Anne Hammond,et al.  LAMPS: A sketch recognition-based teaching tool for Mandarin Phonetic Symbols I , 2010, J. Vis. Lang. Comput..

[6]  Trevor Darrell,et al.  Hidden Conditional Random Fields for Gesture Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[7]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[8]  Jianying Hu,et al.  HMM Based On-Line Handwriting Recognition , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Daniel Jurafsky,et al.  Hidden Conditional Random Fields for phone recognition , 2009, 2009 IEEE Workshop on Automatic Speech Recognition & Understanding.

[10]  Martial Hebert,et al.  Discriminative random fields: a discriminative framework for contextual interaction in classification , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  Trevor Darrell,et al.  Conditional Random Fields for Object Recognition , 2004, NIPS.

[12]  Guangshun Shi,et al.  HMM-Based Online Recognition of Handwritten Chemical Symbols , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[13]  Alex Acero,et al.  Hidden conditional random fields for phone classification , 2005, INTERSPEECH.

[14]  Jiancheng,et al.  Real-Time Fingertip Detection from Cluttered Background for Vision-based HCI * , 2005 .