Multi-modal segmental models for online handwriting recognition

Hidden Markov models (HMMs) have become within a few years the main technology for online handwritten word recognition (HWR). We consider segment models which generalize HMMs, these models aim at modeling the signal at a global level rather than at the frame level and have been shown to overcome standard HMMs in their modeling ability. We propose a segment model which allows us to automatically handle different writing styles. We compare our system on the isolated character set of the UNIPEN database with a reference system and a baseline segment model.

[1]  Bernadette Dorizzi,et al.  Adaptive discrimination in an HMM-based neural predictive system for on-line word recognition , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[2]  Patrick Gallinari,et al.  Predictive Models for Sequence Modelling, Application to Speech and Character Recognition , 1997, Summer School on Neural Networks.

[3]  Xiaodong Sun,et al.  Speech recognition using hidden Markov models with polynomial regression functions as nonstationary states , 1994, IEEE Trans. Speech Audio Process..

[4]  Mari Ostendorf,et al.  From HMM's to segment models: a unified view of stochastic modeling for speech recognition , 1996, IEEE Trans. Speech Audio Process..

[5]  Isabelle Guyon,et al.  UNIPEN project of on-line data exchange and recognizer benchmarks , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[6]  Herbert Gish,et al.  A segmental speech model with applications to word spotting , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Martin J. Russell,et al.  Linear dynamic segmental HMMs: variability representation and training procedure , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.