Glove-based hand gesture recognition sign language translator using capacitive touch sensor

The sign language translator is a bridge between those who comprehend sign languages and those who do not which is the majority of humanity. However, conventional signa language translators are bulky and expensive, limiting their wide adoption. In this paper, we present a gesture recognition glove based on charge-transfer touch sensors for the translation of the American Sign Language. The device is portable and can be implemented with low-cost hardware. The prototype recognize gestures for the numbers 0 to 9 and the 26 English alphabets, A to Z. The glove experimentally achieved, based on 1080 trials, an overall detection accuracies of over 92 %, which is comparable with current high-end counterparts. The proposed device i expected to bridge the communication gap between the hearing and speech impaired and members of the general public.

[1]  Michela Borghetti,et al.  Sensorized Glove for Measuring Hand Finger Flexion for Rehabilitation Purposes , 2013, IEEE Transactions on Instrumentation and Measurement.

[2]  Junsong Yuan,et al.  Robust Part-Based Hand Gesture Recognition Using Kinect Sensor , 2013, IEEE Transactions on Multimedia.

[3]  Kehkashan Kanwal,et al.  Assistive glove for Pakistani Sign Language translation , 2014, 17th IEEE International Multi Topic Conference 2014.

[4]  DaeEun Kim,et al.  Finger-gesture Recognition Glove using Velostat (ICCAS 2011) , 2011, 2011 11th International Conference on Control, Automation and Systems.

[5]  Nabil Drawil,et al.  Sign language translator and gesture recognition , 2015, 2015 Global Summit on Computer & Information Technology (GSCIT).

[6]  Khaled Assaleh,et al.  Glove-Based Continuous Arabic Sign Language Recognition in User-Dependent Mode , 2015, IEEE Transactions on Human-Machine Systems.

[7]  Vasiliki Kosmidou,et al.  Sign Language Recognition Using Intrinsic-Mode Sample Entropy on sEMG and Accelerometer Data , 2009, IEEE Transactions on Biomedical Engineering.

[8]  Nikhita Praveen,et al.  Sign language interpreter using a smart glove , 2014, 2014 International Conference on Advances in Electronics Computers and Communications.

[9]  Mustapha Hamad,et al.  Sign to letter translator system using a hand glove , 2014, The Third International Conference on e-Technologies and Networks for Development (ICeND2014).