Neural net vector quantizers for discrete HMM-based on-line handwritten whiteboard-note recognition

In this work we evaluate a recently published vector quantization scheme, which has been developed to handle binary features like the pressure feature occurring in on-line handwriting recognition using discrete Hidden-Markov-Models (HMMs) with two neural net based vector quantizers (VQs). One of these uses a ldquoWinner-Take-Allrdquo (WTA) update rule and the other implements the ldquoNeural Gasrdquo (NG) approach. Both approaches are believed to be more efficient VQs than the standard k-means VQ used in our earlier publication. In an experimental section we prove that both the WTA and NG neural net VQ significantly (significance is measured by the one-sided t-test) outperform our previously used k-means VQ by rW = 0:9% and rN = 0:8%, respectively, referring to word-level accuracy. In addition, no significant difference in recognition accuracy between the WTA-VQ and the NG-VQ could be observed.

[1]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[2]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[3]  Marcus Liwicki,et al.  Feature selection for on-line handwriting recognition of whiteboard notes , 2007 .

[4]  Alexander H. Waibel,et al.  Online handwriting recognition: the NPen++ recognizer , 2001, International Journal on Document Analysis and Recognition.

[5]  Joachim M. Buhmann,et al.  Competitive learning algorithms for robust vector quantization , 1998, IEEE Trans. Signal Process..

[6]  R. Gray,et al.  Vector quantization , 1984, IEEE ASSP Magazine.

[7]  Marcus Liwicki,et al.  IAM-OnDB - an on-line English sentence database acquired from handwritten text on a whiteboard , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[8]  Gerhard Rigoll,et al.  Novel VQ Designs for Discrete HMM On-Line Handwritten Whiteboard Note Recognition , 2008, DAGM-Symposium.

[9]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Nikos Fakotakis,et al.  New algorithms for skewing correction and slant removal on word-level [OCR] , 1999, ICECS'99. Proceedings of ICECS '99. 6th IEEE International Conference on Electronics, Circuits and Systems (Cat. No.99EX357).

[11]  Marcus Liwicki,et al.  HMM-Based On-Line Recognition of Handwritten Whiteboard Notes , 2006 .

[12]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[13]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.