Speak Up: A Multi-Year Deployment of Games to Motivate Speech Therapy in India

The ability to communicate is crucial to leading an independent life. Unfortunately, individuals from developing communities who are deaf and hard of hearing tend to encounter difficulty communicating, due to a lack of educational resources. We present findings from a two-year deployment of Speak Up, a suite of voice-powered games to motivate speech therapy, at a school for the deaf in India. Using ethnographic methods, we investigated the interplay between Speak Up and local educational practices. We found that teachers' speech therapy goals had evolved to differ from those encoded in the games, that the games influenced classroom dynamics, and that teachers had improved their computer literacy and developed creative uses for the games. We used these insights to further enhance Speak Up by creating an explicit teacher role in the games, making changes that encouraged teachers to build their computer literacy, and adding an embodied agent.

[1]  David Calder SpeechKit: a multimedia speech tool , 2008, iiWAS.

[2]  Stefan Gheorghe Pentiuc,et al.  Improving Computer Based Speech Therapy Using a Fuzzy Expert System , 2010, Comput. Informatics.

[3]  Shaimaa Y. Lazem,et al.  We Play We Learn: Exploring the Value of Digital Educational Games in Rural Egypt , 2017, CHI.

[4]  Chek Tien Tan,et al.  Retrogaming as visual feedback for speech therapy , 2014, SIGGRAPH ASIA Mobile Graphics and Interactive Applications.

[5]  Simon Kouttis Improving security knowledge, skills and safety , 2016 .

[6]  Andrew M. Dearden,et al.  See no evil?: ethics in an interventionist ICTD , 2012, ICTD.

[7]  B McPherson,et al.  Hearing screening for school children: comparison of low-cost, computer-based and conventional audiometry. , 2010, Child: care, health and development.

[8]  Edwin Blake,et al.  Using Activity Theory to Understand Technology Use and Perception among Rural Users in Uganda , 2016, ICTD.

[9]  Madan M. Vasishta Social Situations and the Education of Deaf Children in India , 2010 .

[10]  John A. Albertini,et al.  Deafness and Hearing Loss , 2010 .

[11]  L E Bernstein,et al.  Speech training aids for hearing-impaired individuals: III. Preliminary observations in the clinic and childrens' homes. , 1988, Journal of rehabilitation research and development.

[12]  Chek Tien Tan,et al.  sPeAK-MAN: towards popular gameplay for speech therapy , 2013, IE.

[13]  Mohamed F. Tolba,et al.  An Enhanced Arabic Phonemes Classification Approach , 2016, INFOS '16.

[14]  Becky Sue Parton,et al.  Interactive Media to Support Language Acquisition for Deaf Students. , 2009 .

[15]  Hafeni Mthoko,et al.  Assessing outcome and impact: towards a comprehensive evaluation approach in ICT4D , 2015, ICTD '15.

[16]  Nidhi Kalra,et al.  Iterative design of a Braille writing tutor to combat illiteracy , 2007, 2007 International Conference on Information and Communication Technologies and Development.

[17]  Dhaval Vyas,et al.  Gamification for development: a case of collaborative learning in Sri Lankan primary schools , 2018, Personal and Ubiquitous Computing.

[18]  De Wet Swanepoel,et al.  Clinical Validity of hearScreen™ Smartphone Hearing Screening for School Children , 2016, Ear and hearing.

[19]  Matthew Kam,et al.  Designing digital games for rural children: a study of traditional village games in India , 2009, CHI.

[20]  J. Cepeda,et al.  Education on Risk Management with Gender Equity: Experiences in United Nations Development Programme (UNDP) courses using on-site education and synchronous technologies for distance education , 2009 .

[21]  Daniel Ling,et al.  Speech and the Hearing-Impaired Child: Theory and Practice , 1976 .

[22]  João Magalhães,et al.  An interactive toolset for speech therapy , 2014, Advances in Computer Entertainment.

[23]  Jürgen Schmidhuber,et al.  Phoneme recognition in TIMIT with BLSTM-CTC , 2008, ArXiv.

[24]  Saurabh Varshney,et al.  Deafness in India , 2016 .

[25]  Sir Alexander,et al.  Teaching Deaf Children to Talk , 1964 .

[26]  R. S. Nickerson,et al.  Teaching speech to the deaf: can a computer help , 1972, ACM Annual Conference.

[27]  Richard J. Anderson,et al.  Projecting health: community-led video education for maternal health , 2015, ICTD.

[28]  Voula C. Georgopoulos An investigation of audio-visual speech recognition as applied to multimedia speech therapy applications , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[29]  Akira Watanabe,et al.  Color display system for connected speech to be used for the hearing impaired , 1985, IEEE Trans. Acoust. Speech Signal Process..

[30]  L. Bernstein,et al.  Speech training devices for profoundly deaf children , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[31]  Rashid Al-Abri,et al.  The Accuracy of IOS Device-based uHear as a Screening Tool for Hearing Loss: A Preliminary Study From the Middle East. , 2016, Oman medical journal.

[32]  Donna Jo Napoli,et al.  Deaf Around The World: The Impact Of Language , 2010 .

[33]  Rachel E. Stark,et al.  Teaching /ba/ and /pa/ to Deaf Children Using Real-Time Spectral Displays , 1972, Language and speech.

[34]  M. Bernardine Dias,et al.  A Braille Writing Tutor to Combat Illiteracy in Developing Communities , 2007 .

[35]  Joel E. Oestreich UNITED NATIONS DEVELOPMENT PROGRAMME , 2000 .

[36]  Janet C. Read,et al.  Facilitator, Functionary, Friend or Foe?: Studying the Role of iPads within Learning Activities Across a School Year , 2016, CHI.