An Interactive Sign Language Based Mobile Application for Deaf People

Disability is a complex problem affecting many lives in Indonesia, especially people with hearing impairments. Disability is also a complex phenomenon, starting from the type of disability, degree of disability, and age of persons with disabilities to interactions and environmental impacts on disability. Moreover, there are many testimonies from around the world that people with disabilities are more likely to be weak and less likely to get an education. This paper aims to present a mobile application that offers sign language images and videos of any text in a learning environment that is shaped like a dictionary module to increase their vocabulary, learn a new sign language, and pronounce a word. This mobile application is specially designed for deaf people who have limitations in learning and educational training. This mobile application is equipped with several features such as user registration for the deaf and normal people who like to learn sign language, discussing through forums, using a sign language dictionary containing sign language text and pictures, using interactive learning videos, registering for an event activity, including giving input, and also make a donation.

[1]  Mohsin Ali Memon,et al.  Sign Language e-Learning system for hearing-impaired community of Pakistan , 2018 .

[2]  Manisha U. Kakde,et al.  A Review Paper on Sign Language Recognition System For Deaf And Dumb People using Image Processing , 2016 .

[3]  P. Clamp,et al.  Smartphone speech-to-text applications for communication with profoundly deaf patients , 2015, The Journal of Laryngology & Otology.

[4]  Rizky Yuniar Hakkun,et al.  Sign language learning based on Android for deaf and speech impaired people , 2015, 2015 International Electronics Symposium (IES).

[5]  Amy T. Wilson,et al.  Mixed Methods Research Strategies With Deaf People , 2014 .

[6]  Abdul Majid Mazlina,et al.  An Investigation on Learning Performance among Disabled People Using Educational Multimedia Software: A Case Study for Deaf People , 2013, BSBT 2013.

[7]  M. De Marsico,et al.  Stories and signs in an e-learning environment for deaf people , 2013, Universal Access in the Information Society.

[8]  J. Fellinger,et al.  Mental health of deaf people , 2012, The Lancet.

[9]  Daniele Capuano,et al.  A Deaf-centred E-Learning Environment (DELE): challenges and considerations , 2011 .

[10]  Zhang Jijia,et al.  Deaf Adolescents’ Representations of Taxonomic Relations , 2009 .

[11]  Laura J. Muir,et al.  Perception of sign language and its application to visual communications for deaf people. , 2005, Journal of deaf studies and deaf education.

[12]  S. Kouremenos,et al.  An e-learning system for the deaf people , 2005, 2005 6th International Conference on Information Technology Based Higher Education and Training.

[13]  M. Vachon,et al.  Disordered communication and grieving in deaf member families. , 1993, Family process.

[14]  Ahmed E. Hassan,et al.  A Proposed Web Based Framework E-Learning and Dictionary System for Deaf Arab Students , 2010 .

[15]  Mohamed Jemni,et al.  Multimedia courses generator for deaf children , 2009, Int. Arab J. Inf. Technol..

[16]  Hiroshi Murakami,et al.  Arabic Sign Language Translation System On Mobile Devices , 2008 .

[17]  Rubén San-Segundo-Hernández,et al.  A Spanish speech to sign language translation system for assisting deaf-mute people , 2006, INTERSPEECH.

[18]  Vivian Raithel,et al.  An e-Learning Environment for Deaf Adults , 2004 .

[19]  C. Akamatsu,et al.  Bilingual-bicultural models of literacy education for deaf students: considering the claims. , 1999, Journal of deaf studies and deaf education.