Development of a Wearable Device for Sign Language Translation

A wearable device for sign language translation, called Talking Hands, is presented. It is composed by a custom data glove, which is designed to optimize the data acquisition, and a smartphone application, which offers user personalizations. Although Talking Hands can not translate a whole sign language, it offers an effective communication to deaf and mute people with everyone through a scenario-based translation. The different challenges of a gesture recognition system have been overcame with simple solutions, since the main goal of this work is an user-based product.

[1]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[2]  Dennis McLeod,et al.  An Approach to Glove-Based Gesture Recognition , 2009, HCI.

[3]  Surendra Ranganath,et al.  Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Daniel Kelly,et al.  A person independent system for recognition of hand postures used in sign language , 2010, Pattern Recognit. Lett..

[5]  Awais M. Kamboh,et al.  American Sign Language Translation through Sensory Glove; SignSpeak , 2015 .

[6]  Kouichi Murakami,et al.  Gesture recognition using recurrent neural networks , 1991, CHI.

[7]  Yannick Aoustin,et al.  A testing system for a real-time gesture classification using surface EMG , 2017 .

[8]  Nicolas Pugeault,et al.  Reading the signs: A video based sign dictionary , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[9]  Dimitris N. Metaxas,et al.  American sign language recognition: reducing the complexity of the task with phoneme-based modeling and parallel hidden markov models , 2003 .

[10]  Du Q. Huynh,et al.  Metrics for 3D Rotations: Comparison and Analysis , 2009, Journal of Mathematical Imaging and Vision.

[11]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Rafiqul Zaman Khan,et al.  Hand Gesture Recognition: A Literature Review , 2012 .