ANALYSIS OF USER REQUIREMENTS FOR A MOBILE AUGMENTED REALITY APPLICATION TO SUPPORT LITERACY DEVELOPMENT AMONGST HEARING-IMPAIRED CHILDREN

Literacy is fundamental for children’s growth and development, as it impacts their educational, societal, and vocational progress. However, the mapping of language to printed text is different for children with hearing impairments. When reading, a hearingimpaired child maps text to sign language (SL) which is a visual language that can benefit from technological advancements, such as augmented reality (AR). There exist several efforts that utilise AR for the purpose of advancing the educational needs of people who are hearing impaired for different SLs. Nevertheless, only a few directly elicit the visual needs of children who are hearing impaired. This study aims to address this gap in the literature with a series of user studies to elicit user requirements for the development of an AR application that supports the literacy development of Arab children who are hearing impaired. Three instruments were utilised in these user studies, each targeting a different group of literacy influencers: questionnaires issued to parents of children with hearing impairments, interviews with teachers, and observations of children who were deaf or hard of hearing. The findings indicated that the parents and teachers preferred Arabic SL (ArSL), pictures, and videos, whereas the children struggled with ArSL and preferred finger-spelling. These Received: 15 July 2018 Accepted: 3 September 2018 Published: 11 December 2018 Journal of ICT, 18, No. 1 (January) 2019, pp: 97–121 98 preferences highlighted the importance of integrating various resources to strengthen the written Arabic and ArSL literacy of Arab children. The findings have contributed to the literature on the preferences of Arab children who are hearing impaired, their educators, and parents. They also showed the importance of establishing requirements elicited directly from intended users who are disabled to proactively support their learning process. The results of the study were used in the preliminary development of Word & Sign, an AR mobile application intended to aid Arab children who are hearing impaired in their linguistic development.

[1]  Cathryn Jackson,et al.  Augmented reality m-learning to enhance nursing skills acquisition in the clinical skills laboratory , 2015, Interact. Technol. Smart Educ..

[2]  Chris Dede,et al.  Affordances and Limitations of Immersive Participatory Augmented Reality Simulations for Teaching and Learning , 2009 .

[3]  Yan Xu,et al.  Designing a vision-based mobile interface for in-store shopping , 2008, NordiCHI.

[4]  Tom Humphries,et al.  “Chaining" and other links: Making connections between American Sign Language and English in Two Types of School Settings , 2000 .

[5]  Silvia Baldiris,et al.  Augmented Reality Board Game for supporting learning and motivation in an indigenous community , 2017 .

[6]  Halimah Badioze Zaman,et al.  Heuristic evaluation on Augmented Reality courseware for the deaf , 2011, 2011 International Conference on User Science and Engineering (i-USEr ).

[7]  Wojciech Cellary,et al.  Evaluation of learners' attitude toward learning in ARIES augmented reality environments , 2013, Comput. Educ..

[8]  Huda Y. Alyami,et al.  Deaf or hard of hearing children in Saudi Arabia: Status of early intervention services. , 2016, International journal of pediatric otorhinolaryngology.

[9]  Sylvie Daniel,et al.  Observation and analysis of a classroom teaching and learning practice based on augmented reality and serious games on mobile platforms , 2015, Int. J. Serious Games.

[10]  Çelebi Uluyol,et al.  Augmented Reality: A New Direction in Education , 2016 .

[11]  D. Turner Qualitative Interview Design: A Practical Guide for Novice Investigators , 2010 .

[12]  B. Porter Let's Read. , 1973 .

[13]  Ines Kozuh,et al.  Assessing the Efficiency of Using Augmented Reality for Learning Sign Language , 2015, HCI.

[14]  Dirk Basten,et al.  Benefits of Augmented Reality in Educational Environments - A Systematic Literature Review , 2015, Wirtschaftsinformatik.

[15]  C. Kirner,et al.  Development of an interactive book with Augmented Reality for teaching and learning geometric shapes , 2012, 7th Iberian Conference on Information Systems and Technologies (CISTI 2012).

[16]  Areej Al-Wabil,et al.  Design and Development of an Educational Arabic Sign Language Mobile Application: Collective Impact with Tawasol , 2015, HCI.

[17]  Bjorn Ekengren,et al.  Mobile Augmented Reality , 2010 .

[18]  Susan Goldin-Meadow,et al.  How Do Profoundly Deaf Children Learn to Read? , 2001 .

[19]  Vicki,et al.  Phonology and Reading : Evidence from Profoundly Deaf Readers * , 2009 .

[20]  Mark Billinghurst,et al.  A survey of evaluation techniques used in augmented reality studies , 2008, SIGGRAPH 2008.

[21]  Deborah E. White,et al.  Thematic Analysis , 2017 .

[22]  Eleni A. Kyza,et al.  The development and validation of the ARI questionnaire: An instrument for measuring immersion in location-based augmented reality settings , 2017, Int. J. Hum. Comput. Stud..

[23]  Abeer Alnafjan,et al.  Designing “Najeeb”: Technology-Enhanced Learning For Children With Impaired Hearing Using Arabic Sign-Language ArSL Applications , 2017, 2017 International Conference on Computer and Applications (ICCA).

[24]  Ornella Mich Evaluation of software tools with deaf children , 2009, Assets '09.

[25]  Angélica González Arrieta,et al.  Development of Sign Language Communication Skill on Children through Augmented Reality and the MuCy Model , 2014, MIS4TEL.

[26]  Donna Jo Napoli,et al.  Should All Deaf Children Learn Sign Language? , 2015, Pediatrics.

[27]  Roopesh Kevin Sungkur,et al.  Augmented reality, the future of contextual mobile learning , 2016, Interact. Technol. Smart Educ..

[28]  J. Morse,et al.  Situating and Constructing Diversity in Semi-Structured Interviews , 2015, Global qualitative nursing research.

[29]  Egui Zhu,et al.  Augmented reality in healthcare education: an integrative review , 2014, PeerJ.

[30]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[31]  Rabia Yilmaz,et al.  Educational magic toys developed with augmented reality technology for early childhood education , 2016, Comput. Hum. Behav..

[32]  Mark Billinghurst,et al.  Augmented Reality in the Classroom , 2012, Computer.

[33]  R J Samuel,et al.  Do Teachers have Adequate ICT Resources and the Right ICT Skills in Integrating ICT Tools in the Teaching and Learning of English Language in Malaysian Schools? , 2007 .

[35]  A. A K. Oka Sudana,et al.  Augmented Reality Application of Sign Language for Deaf People in Android Based on Smartphone , 2016 .

[36]  Halimah Badioze Zaman,et al.  Learning Science Using AR Book: A Preliminary Study on Visual Needs of Deaf Learners , 2009, IVIC.

[37]  DEAF BILINGUAL EDUCATION: A COMPARISON OF THE ACADEMIC PERFORMANCE OF DEAF CHILDREN OF DEAF PARENTS AND DEAF CHILDREN OF HEARING PARENTS , 2007 .

[38]  Rebecca Treiman,et al.  Silent reading: Insights from second-generation deaf readers , 1983, Cognitive Psychology.