Development of robotic hands of signbot, advanced Malaysian sign-language performing robot

This paper presents the development of a 3D printed humanoid robotic hands of SignBot, which can perform Malaysian Sign Language (MSL). The study is considered as the first attempt to ease the means of communication between the general community and the hearing-impaired individuals in Malaysia. The signed motions performed by the developed robot in this work can be done by two hands. The designed system, unlike previously conducted work, includes a speech recognition system that can feasibly integrate with the controlling platform of the robot. Furthermore, the design of the system takes into account the grammar of the MSL which differs from that of Malay spoken language. This reduces the redundancy and makes the design more efficient and effective. The robot hands are built with detailed finger joints. Micro servo motors, controlled by Arduino Mega, are also loaded to actuate the relevant joints of selected alphabetical and numerical signs as well as phrases for emergency contexts from MSL. A database for the selected signs is developed wherein the sequential movements of the servo motor arrays are stored. The results showed that the system performed well as the selected signs can be understood by hearing-impaired individuals.

[1]  Hatice Kose-Bagci,et al.  Tale of a robot: Humanoid robot assisted sign language tutoring , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[2]  Kerstin Dautenhahn,et al.  Robot-mediated joint attention in , 2004 .

[3]  Matt Huenerfauth,et al.  Collecting and evaluating the CUNY ASL corpus for research on American Sign Language animation , 2014, Comput. Speech Lang..

[4]  B. Robins,et al.  Robot-mediated joint attention in children with autism : A case study in robot-human interaction , 2004 .

[5]  Etienne Wenger,et al.  Situated Learning: Legitimate Peripheral Participation , 1991 .

[6]  Richard Furuta,et al.  VRML-based representations of ASL fingerspelling on the World Wide Web , 1998, Assets '98.

[7]  Rini Akmeliawati,et al.  Speech to Text Translation for Malay Language , 2017 .

[8]  Paulo Urbano,et al.  Avatars on Portuguese sign language , 2014, 2014 9th Iberian Conference on Information Systems and Technologies (CISTI).

[9]  Yateen P. Shembade Design and Simulation of a Mechanical Hand , 2012 .

[10]  Livio Tenze,et al.  Voice-Controlled Artificial Handspeak System , 2014 .

[11]  Gérard Lachiver,et al.  Designing Toy Robots To Help Autistic Children An Open Design Project For Electrical And Computer Engineering Education , 2000 .

[12]  Aude Billard,et al.  Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills? , 2005, Universal Access in the Information Society.

[13]  Juan Carlos López,et al.  Increasing adaptability of a speech into sign language translation system , 2013, Expert Syst. Appl..

[14]  Sumam Mary Idicula,et al.  Design and development of a frame based MT system for English-to-ISL , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).