Sign language translator and gesture recognition

The mute/deaf individuals have a communication problem dealing with other people. It is hard for such individuals to express what they want to say since sign language is not understandable by everyone. This paper is to develop a Data Acquisition and Control (DAC) system that translates the sign language into text that can be read by anyone. This system is called Sign Language Translator and Gesture Recognition. We developed a smart glove that captures the gesture of the hand and interprets these gestures into readable text. This text can be sent wirelessly to a smart phone or shown in an embedded LCD display. It is evident from the experimental results that gestures can be captured by set of inexpensive sensors, which measure the positions and the orientation of the fingers. The current version of the system is able to interpret 20 out of 26 letters with a recognition accuracy of 96%.

[1]  Jan Carlo Barca,et al.  Exploring Sensor Gloves for Teaching Children Sign Language , 2012, Adv. Hum. Comput. Interact..

[2]  Aboul Ella Hassanien,et al.  ArSLAT: Arabic Sign Language Alphabets Translator , 2010, 2010 International Conference on Computer Information Systems and Industrial Management Applications (CISIM).

[3]  Mikhaylyna Melnyk,et al.  Towards Computer Assisted International Sign Language Recognition System: A Systematic Survey , 2014 .