SignBot, Sign-Language Performing Robot, Based on Sequential Motion of Servo Motor Arrays

This paper presents the development of SignBot, a 3D printed robot which can perform Malaysian Sign Language (MSL). This work is the first attempt to eliminate the barriers of communication between hearing impaired individuals and the mainstream society as it is the first robot to perform MSL. The signing, in this work, can be done with two hands. The robot hands were developed with detailed finger joints. Micro servo motors were installed to allow for the signing motions for the relevant joints of selected letters, numbers as well as phrases for emergency cases. The sequential movements of the servo motor arrays are stored in the database to represent particular signs, and retrieved by the microcontroller based on the speech input detected, and finally executed accordingly by the servo motors to perform the sign.

[1]  Kiyoshi Hoshino,et al.  A humanoid robotic hand performing the sign language motions , 2003, MHS2003. Proceedings of 2003 International Symposium on Micromechatronics and Human Science (IEEE Cat. No.03TH8717).

[2]  Jaffe Dl.  Evolution of mechanical fingerspelling hands for people who are deaf-blind. , 1994 .

[3]  Livio Tenze,et al.  Voice-Controlled Artificial Handspeak System , 2014 .

[4]  Sumam Mary Idicula,et al.  Design and development of a frame based MT system for English-to-ISL , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[5]  Hatice Kose-Bagci,et al.  Tale of a robot: Humanoid robot assisted sign language tutoring , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.