Translation from Arabic speech to Arabic Sign Language based on cloud computing

Abstract People with special-needs face a variety of different challenges and barriers that isolate them from their surroundings. Nowadays, several assistive technologies have been developed to reduce many of these barriers and simplify the communication between special-needs persons and the surrounding environment. However, few frameworks are presented to support them in the Arabic region either due to the lack of resources or the complexity of the Arabic language. The main goal of this work is to present a mobile-based framework that will help Arabic deaf people to communicate ‘on the go’ easily with virtually any one without the need of any specific devices or support from other people. The framework utilizes the power of cloud computing for the complex processing of the Arabic text. The speech processing produced a cartoon avatar showing the corresponding Egyptian Arabic Sign Language on the mobile handset of the deaf person.

[1]  Taku Komura,et al.  From Motion Capture to Real-Time Character Animation , 2008, MIG.

[2]  Hend Suliman Al-Khalifa Introducing Arabic Sign Language for Mobile Phones , 2010, ICCHP.

[3]  Margriet Verlinden,et al.  Multimedia with Animated Sign Language for Deaf Learners , 2005 .

[4]  Rainer Brück,et al.  An assistive technology for hearing-impaired persons: Analysis, requirements and architecture , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  David K. Sarji HandTalk: Assistive Technology for the Deaf , 2008, Computer.

[6]  M. Abdel-Fattah Arabic sign language: a perspective. , 2005, Journal of deaf studies and deaf education.

[7]  A. E. E. El Alfi,et al.  Intelligent Arabic text to Arabic Sign Language Translation for Easy Deaf Communication , 2014 .

[8]  Jeff Sauro,et al.  The Factor Structure of the System Usability Scale , 2009, HCI.

[9]  Mohamed Jemni,et al.  Sign Language MMS to Make Cell Phones Accessible to the Deaf and Hard-of-hearing Community , 2007, CVHI.

[10]  Vladimir O. Safonov,et al.  Example of a Trustworthy Cloud Computing Platform in Detail: Microsoft Azure , 2016 .

[11]  Aboul Ella Hassanien,et al.  Social network framework for deaf and blind people based on cloud computing , 2013, 2013 Federated Conference on Computer Science and Information Systems.

[12]  J. B. Brooke,et al.  SUS: a retrospective , 2013 .

[13]  Nadia Aouiti Towards an automatic translation from Arabic text to sign language , 2013, Fourth International Conference on Information and Communication Technology and Accessibility (ICTA).