HMM-Based Continuous Sign Language Recognition Using Stochastic Grammars

This paper describes the development of a video-based continuous sign language recognition system using Hidden Markov Models (HMM). The system aims for automatic signer dependent recognition of sign language sentences, based on a lexicon of 52 signs of German Sign Language. A single colour video camera is used for image recording. The recognition is based on Hidden Markov Models concentrating on manual sign parameters. As an additional component, a stochastic language model is utilised, which considers uni- and bigram probabilities of single and successive signs. The system achieves an accuracy of 95% using a bigram language model.

[1]  Penny Boyes Breaem.  Einführung in die Gebärdensprache und ihre Ertorschung , 1995 .

[2]  Ming Ouhyoung,et al.  A real-time continuous gesture recognition system for sign language , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[3]  Kirsti Grobel,et al.  Automatic Estimation of Body Regions from Video Images , 1997, Gesture Workshop.

[4]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Dimitris N. Metaxas,et al.  Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[6]  Sherman Wilcox,et al.  Gesture and the Nature of Language , 1995 .

[7]  Annelies Braffort.  ARGo: An Architecture for Sign Language Recognition and Interpretation , 1996, Gesture Workshop.

[8]  Frederick Jelinek,et al.  Self-organizing language modeling for speech recognition , 1990 .

[9]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.