Implementation of gesture based voice and language translator for dumb people

Dumb persons communicate through gestures which are not understood by the majority of people. Gesture is a movement of part of the body, especially a hand or the head, to express an idea or meaning. This paper proposes a system that converts gestures given by the user in the form of English alphabets into corresponding voice and translates this English voice output into any other Microsoft supported languages. The system consists of MPU6050 for sensing gesture movement, Raspberry pi for processing, three button Keypad and speaker. It is implemented by using trajectory recognition algorithm for recognizing alphabets. Raspberry pi generates voice output for the text in multiple languages using voice RSS and Microsoft translator. When tested, the system recognized A-Z alphabets and generated voice output based on the gestures in multiple languages.

[1]  Hongying Meng,et al.  A Human Action Recognition System for Embedded Computer Vision Application , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Lei Jing,et al.  A remote conversation support system for deaf-mute persons based on bimanual gestures recognition using finger-worn devices , 2015, 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[3]  Wang Jingqiu,et al.  An ARM-based embedded gesture recognition system using a data glove , 2014, The 26th Chinese Control and Decision Conference (2014 CCDC).

[4]  N. Sriram,et al.  A hand gesture recognition based communication system for silent speakers , 2013, 2013 International Conference on Human Computer Interactions (ICHCI).

[5]  K. ShaikhJ.,et al.  Inertial Pen Based Alphabet Recognition using KNN Classifier , 2015 .

[6]  Othman Sidek,et al.  Wireless gesture recognition system using MEMS accelerometer , 2014, 2014 International Symposium on Technology Management and Emerging Technologies.

[7]  Yu Shi,et al.  Developing a smart camera for gesture recognition in HCI applications , 2009, 2009 IEEE 13th International Symposium on Consumer Electronics.

[8]  Syed Faiz Ahmed,et al.  Electronic Speaking Glove for speechless patients, a tongue to a dumb , 2013, 2010 IEEE Conference on Sustainable Utilization and Development in Engineering and Technology.

[9]  B. Mathew,et al.  A characterization of visual feature recognition , 2003, 2003 IEEE International Conference on Communications (Cat. No.03CH37441).