Multilayer method based on multi-resolution feature extracting and MVC dimension reducing method for sign language recognition

Hidden Markov model (HMM) has been successfully used in the sign language recognition (SLR). However, due to large vocabulary of the sign language, traditional one-layer HMM method is becoming limited with the increasing number of training samples. It is tardy when recognizing which cannot meet the real time requirement. In this paper, we present a multi-resolution feature extracting method and a reducing dimension method of maximum variance criterion (MVC), which has better performance in sign language recognition system than traditional reducing dimension methods of PCA or ICA. Our multilayer sign language recognition system increases the recognition accuracy by 3.42%, as well as reduces the recognition time by 0.992 second in average, compared with traditional HMM based system.

[1]  Geoffrey E. Hinton,et al.  Glove-Talk: a neural network interface between a data-glove and a speech synthesizer , 1993, IEEE Trans. Neural Networks.

[2]  Ming Ouhyoung,et al.  A real-time continuous gesture recognition system for sign language , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[3]  Dimitris N. Metaxas,et al.  Toward Scalability in ASL Recognition: Breaking Down Signs into Phonemes , 1999, Gesture Workshop.

[4]  Wen Gao,et al.  Signer-independent sign language recognition based on SOFM/HMM , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[5]  Wen Gao,et al.  A SOFM/HMM System for Person-Independent Isolated Sign Language Recognition , 2001, INTERACT.

[6]  Wen Gao,et al.  Sign language recognition , 2014 .

[7]  Mohammed Waleed Kadous,et al.  Machine Recognition of Auslan Signs Using PowerGloves: Towards Large-Lexicon Recognition of Sign Lan , 1996 .

[8]  A. Hyvarinen.  A family of fixed-point algorithms for independent component analysis , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.