Using HMMs and Depth Information for Signer-Independent Sign Language Recognition

In this paper, we add the depth information to effectively locate the 3D position of the hands in the sign language recognition system. But, the information will be changed by the different testers and we can't do the recognition well. So, we use the incremental changes of the three-dimensional coordinates on a unit time as the feature parameter to fix the above problem. We record the changes of the three-dimensional coordinates in time, then using the hidden Markov models to recognize the variety of sign language movement changing on the time domain. Experiment verifies the proposed method is superior to traditional ones.

[1]  Daniel Kelly,et al.  Recognizing Spatiotemporal Gestures and Movement Epenthesis in Sign Language , 2009, 2009 13th International Machine Vision and Image Processing Conference.

[2]  Yuan Sheng Wang,et al.  Physical Rehabilitation Assistant System Based on Kinect , 2013 .

[3]  M. Deriche,et al.  A signer-independent Arabic Sign Language recognition system using face detection, geometric features, and a Hidden Markov Model , 2012, Comput. Electr. Eng..

[4]  Raúl Rojas,et al.  Sign Language Recognition Using Kinect , 2012, ICAISC.

[5]  Wen Gao,et al.  An approach based on phonemes to large vocabulary Chinese sign language recognition , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[6]  Jacek M. Zurada,et al.  Artificial Intelligence and Soft Computing, 10th International Conference, ICAISC 2010, Zakopane, Poland, June 13-17, 2010, Part I , 2010, International Conference on Artificial Intelligence and Soft Computing.

[7]  W. Stokoe.  Sign language structure: an outline of the visual communication systems of the American deaf. 1960. , 1961, Journal of deaf studies and deaf education.

[8]  Wen Gao,et al.  Signer-independent sign language recognition based on SOFM/HMM , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[9]  Tadashi Kitamura,et al.  HMM-based sign recognition in consideration of motion diversity , 2010, 2010 4th International Universal Communication Symposium.

[10]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[11]  Wen Gao,et al.  A SRN/HMM system for signer-independent continuous sign language recognition , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.