Using Educational Games for Sign Language Learning - A SignWriting Learning Game: Case Study

Introduction As for any other group, education is critical to expanding the life prospects of people with hearing disabilities since it helps them to gain knowledge they need to succeed in today's communities and the world of information and communication. Unfortunately, despite serious efforts to date, many deaf students continue to experience difficulties in achieving normative standards of literacy. The most recent available data provided by the World Federation of Deaf indicate that the enrollment rate and literacy achievement of deaf children is far below the average for the population at large and that there is at least 80 % of the world's 70 million deaf people are illiterate or semi-literate. How literacy is taught, utilized, and potentially mastered is, in fact, one of the most discussed, researched, and highly contentious topics in the field of deaf education and deaf studies (Harris & Marschark, 2011). Among the most notable results which have been drawn by different researchers in this field is that high levels of illiteracy and low academic achievements among these hearing impaired students are associated to the discrepancy between their incomplete spoken language system, and the demands of writing and reading through a speech-based system (Geers & Hayes, 2011; Nussbaum et al., 2012; Zamfirov & Saeva, 2013). It is important to know that reading and writing require two related capabilities; firstly you must be familiar with a language and secondly, you must understand the mapping between that language and the printed word (Chamberlain & Mayberry, 2000). Deaf and Hard of Hearing learners (DHH) are disadvantaged on both counts. For example, learning to read requires DHH learners to learn the mapping between the spoken language and the printed words, and this is not easy for them because they do not have access to phonological code and many do not know the language well since it is often considered as a second language for them (Goldin-Meadow & Mayberry, 2001). Actually, providing these learners with a suitable writing form in their first language could be a help to them. It has been demonstrated that an appropriate sign language written form can offer deaf learners the possibility to process written linguistic information provided in a syntactic structure that reflects the structure of the corresponding sign language. Moreover, such written form can be very useful to improve the ability of these signers to comprehend and acquire the written versions of oral languages (Vendrame et al., 2013; Guimaraes et al., 2014). At present, SignWriting (SW) is already one of the best known writing systems which are currently being used as an educational tool in several pilot projects around the world. This system deemed adequate to transcribe the visual nature of signing through highly iconic symbols and its practical usage in literacy education has had a great impact on the education of deaf children (Kato, 2008). Nonetheless, it's fair to say that a training to learn to interpret such static transcriptions is needed for novice readers, who are accustomed to the use of their preferred language in a visual-gestural modality. Fortunately, the emergence of Information and Communication Technology (ICT) has brought new hopes and opportunities for these learners. The rapid evolution of a vast range of newer digital technologies has made the role of such assistive technologies, in educating deaf children, even more crucial than ever before. For instance, the adoption of visual forms of ICTs (e.g., immersive multimedia, 3D animation, virtual reality and video conferencing) within educational settings can facilitate the acquisition and absorption of knowledge, increase learner motivation and engagement, and enhance teacher training (Hameed, 2007; Haddad & Jurich, 2002; Passey et al., 2004). Another promising and interesting alternative to reinforce learning experience, today, is the use of educational games. …

[1]  Cayley Guimaraes,et al.  Sign Language Writing Acquisition -- Technology for a Writing System , 2014, 2014 47th Hawaii International Conference on System Sciences.

[2]  Don Passey,et al.  The Motivational Effect of ICT on Pupils , 2004 .

[3]  M. Marschark,et al.  Literacy in the classroom and beyond. , 2011, Journal of deaf studies and deaf education.

[4]  Monica Bucciarelli,et al.  A Written Version of Sign Language can Enhance Signing Deaf Individuals' Comprehension and Learning from Texts , 2013, CogSci.

[5]  Cecilia Mary Flood HOW DO DEAF AND HARD OF HEARING STUDENTS EXPERIENCE LEARNING TO WRITE USING SIGNWRITING, A WAY TO READ AND WRITE SIGNS? , 2002 .

[6]  C. Anderson,et al.  Video games: good, bad, or other? , 2012, Pediatric clinics of North America.

[7]  Maria De Marsico,et al.  Resource production of written forms of Sign Languages by a user-centered editor, SWift (SignWriting improved fast transcriber) , 2012, LREC.

[8]  Svetoslava Saeva,et al.  Computer Enhanced English Language Tool for Students with Hearing Loss - A Bulgarian study , 2013, J. Educ. Technol. Soc..

[9]  Mohamed Jemni,et al.  A Learning Version of Memory Match Game , 2014, 2014 IEEE 14th International Conference on Advanced Learning Technologies.

[10]  R. Ashby Signing in Science. , 2013 .

[11]  Rob Koper,et al.  A Study of Contextualised Mobile Information Delivery for Language Learning , 2010, J. Educ. Technol. Soc..

[12]  Susan Goldin-Meadow,et al.  How Do Profoundly Deaf Children Learn to Read? , 2001 .

[13]  Don Passey,et al.  The Motivational Effect of ICT on Pupils: A Department for Education and Skills Research Project 4RP/2002/050-3. , 2004 .

[14]  A. Geers,et al.  Reading, Writing, and Phonological Processing Skills of Adolescents With 10 or More Years of Cochlear Implant Experience , 2011, Ear and hearing.

[15]  Ismar Frango Silveira,et al.  Building Computer Games as Effective Learning Tools for Digital Natives - and Similars , 2011 .

[16]  Uri Zwick,et al.  The Memory Game , 1993, Theor. Comput. Sci..

[17]  Mohamed Jemni,et al.  tuniSigner: A Virtual Interpreter to Learn Sign Writing , 2014, 2014 IEEE 14th International Conference on Advanced Learning Technologies.

[18]  Mihoko Kato,et al.  A Study of Notation and Sign Writing Systems for the Deaf , 2008 .

[19]  Leigh Ellen Potter,et al.  Designing a mobile video game to help young deaf children learn Auslan , 2012, BCS HCI.

[20]  A. Mahmood,et al.  The use of animated agents in e-learning environments : an exploratory , interpretive case study , 2006 .

[21]  Mohamed Jemni,et al.  A Virtual Signer to Interpret SignWriting , 2014, ICCHP.

[22]  Gee,et al.  Are Video Games Good for Learning , 2007 .

[23]  Christopher P. Barlett,et al.  Video Game Effects—Confirmed, Suspected, and Speculative , 2009 .

[24]  Alexis Héloir,et al.  Sign Language Avatars: Animation and Comprehensibility , 2011, IVA.

[25]  Mark Peterson,et al.  LEARNING INTERACTION IN AN AVATAR-BASED VIRTUAL ENVIRONMENT: A PRELIMINARY STUDY , 2005 .

[26]  Mohamed Jemni,et al.  A Review on 3D Signing Avatars: Benefits, Uses and Challenges , 2013, Int. J. Multim. Data Eng. Manag..

[27]  Simon Egenfeldt-Nielsen,et al.  Third generation educational use of computer games , 2007 .

[28]  Griffiths The educational benefits of videogames , 2002 .

[29]  Tammy Schellens,et al.  Parental acceptance of digital game-based learning , 2011, Comput. Educ..

[30]  Mohamed Jemni,et al.  An Avatar Based Approach for Automatically Interpreting a Sign Language Notation , 2013, 2013 IEEE 13th International Conference on Advanced Learning Technologies.

[31]  Marina Papastergiou,et al.  Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation , 2009, Comput. Educ..

[32]  B. Waddy-Smith,et al.  Students Who Are Deaf and Hard of Hearing and Use Sign Language: Considerations and Strategies for Developing Spoken Language and Literacy Skills , 2012, Seminars in Speech and Language.

[33]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[34]  J. Vesel Signing Science! Andy And Tonya Are Just Like Me! They Wear Hearing Aids And Know My Language!?. , 2005 .

[35]  Aaron McVay,et al.  A Literature Review of Gaming in Education. Research Report. , 2012 .

[36]  Thad Starner,et al.  Development of an American Sign Language game for deaf children , 2005, IDC '05.