A glove-based gesture recognition system for Vietnamese sign language

In this paper, we address a development of a glove-based gesture recognition system for Vietnamese sign language. A sensor glove is attached ten flex sensors and one accelerometer. Here, flex sensors are used for sensing the curvature of fingers and the accelerometer is used in detecting a movement of a hand. Depending on the hand's postures, i.e., vertical, horizontal, and movement, sign language of letters of the Vietnamese alphabets can be divided to category 1, 2, and 3, respectively. Firstly, the hand's posture is recognized. Next, if the hand's posture belongs to either category 1 or category 2, a matching algorithm is used to detect a letter. If the posture belongs to category 3, a dynamic time warping algorithm is applied. The use of our system in recognizing Vietnamese sign language is illustrated. In addition, experimental results are provided.

[1]  Keum Shik Hong,et al.  Evaluating a color-based active basis model for object recognition , 2012, Comput. Vis. Image Underst..

[2]  Keum-Shik Hong,et al.  Sonar-based obstacle avoidance using region partition scheme , 2010 .

[3]  Meinard Müller,et al.  Information retrieval for music and motion , 2007 .

[4]  Wen Gao,et al.  An approach based on phonemes to large vocabulary Chinese sign language recognition , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[5]  B. Parton.  Sign language recognition and translation: a multidisciplined approach from the field of artificial intelligence. , 2005, Journal of deaf studies and deaf education.

[6]  Apeksha Agarwal,et al.  An Approach to Global Gesture Recognition Translator , 2014 .

[7]  The Duy Bui,et al.  Recognition of Vietnamese sign language using MEMS accelerometers , 2005 .

[8]  Tomoichi Takahashi,et al.  Hand gesture coding based on experiments using a hand gesture interface device , 1991, SGCH.

[9]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Z. Zenn Bien,et al.  A dynamic gesture recognition system for the Korean sign language (KSL) , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[11]  T.D. Bui,et al.  Recognizing Postures in Vietnamese Sign Language With MEMS Accelerometers , 2007, IEEE Sensors Journal.

[12]  Syed Atif Mehdi,et al.  Sign language recognition using sensor gloves , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[13]  Juan M. Bogado,et al.  GLOVE-BASED GESTURE RECOGNITION SYSTEM , 2012 .

[14]  Kouichi Murakami,et al.  Gesture recognition using recurrent neural networks , 1991, CHI.

[15]  Yongliang Zhang,et al.  Hand Gesture Interaction for Virtual Training of SPG , 2006, 16th International Conference on Artificial Reality and Telexistence--Workshops (ICAT'06).

[16]  Wen Gao,et al.  Sign Language Recognition Based on HMM/ANN/DP , 2000, Int. J. Pattern Recognit. Artif. Intell..

[17]  Ashis Kumar Mishra,et al.  Hand Gesture Recognition using Computer Vision , 2013 .