Data-Glove for Japanese Sign Language Training System with Gyro-Sensor

IT research to support communication between people with normal hearing and the hearing impaired is an emergent and important issue. We propose a data glove for a Japanese sign language training system. Currently, data gloves are used with some video games; however, they are expensive and overly complex for Japanese sign language training. We propose a simple data glove with a gyro sensor that can capture the palm-turning gestures of some Japanese sign language words. In the proposed system, an algorithm determines whether a palm-turning gesture has occurred based on experimentally defined thresholds. We conducted experiments with eight participants without individual enrolling to evaluate the proposed data glove. The results demonstrate that the proposed data glove can capture specific words at greater than 50% accuracy on average. We believe that accuracy can be increased by tuning the thresholds to individuals.

[1]  Ming Ouhyoung,et al.  A real-time continuous gesture recognition system for sign language , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[2]  KwangYun Wohn,et al.  Recognition of space-time hand-gestures using hidden Markov model , 1996, VRST.

[3]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Awais M. Kamboh,et al.  American Sign Language Translation through Sensory Glove; SignSpeak , 2015 .

[5]  Z. Zenn Bien,et al.  A dynamic gesture recognition system for the Korean sign language (KSL) , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[6]  Zaid Omar,et al.  A review of hand gesture and sign language recognition techniques , 2017, International Journal of Machine Learning and Cybernetics.

[7]  Pietro Zanuttigh,et al.  Hand gesture recognition with leap motion and kinect devices , 2014, 2014 IEEE International Conference on Image Processing (ICIP).