Developing Augmented Reality book for deaf in science: The determining factors

Augmented Reality book is one of augmented reality applications. Augmented reality is a current technology which is based on visually oriented technique. Its visual capability is useful in many applications such as in teaching abstract concepts in learning Science. This article is a part of continuous work in the development of AR book for deaf students. This paper describes the investigation conducted in identifying the determining factors in designing the AR book for deaf students. The qualitative approaches such as observation and interaction techniques were conducted with three deaf students. From the observation and interaction, the researcher found that they preferred to use sign language video compared to text. The students preferred English text to Malay text and they preferred to watch the Whole Communication sign language video instead of the American Sign Language video. However, their performance was not so much different in their given answer. This prompted the researcher to design and develop an AR-Book called AR-SiD in two languages; Bahasa Malaysia and English. The designed AR-SiD is aimed to enhance the understanding of deaf students in learning Microorganisms topic in Science.

[1]  Mohd Nihra Haruzuan Mohamad Said,et al.  Overview of open source augmented reality toolkit , 2007 .

[2]  C. Mayer What really matters in the early literacy development of deaf children. , 2007, Journal of deaf studies and deaf education.

[3]  Yu-Chien Chen,et al.  A study of comparing the use of augmented reality and physical models in chemistry education , 2006, VRCIA '06.

[4]  Mark Billinghurst,et al.  Edutainment with a mixed reality book: a visually augmented illustrative childrens' book , 2008, ACE '08.

[5]  Charles E. Hughes,et al.  Mixed reality in education, entertainment, and training , 2005, IEEE Computer Graphics and Applications.

[6]  M. Harris,et al.  Concurrent correlates and predictors of reading and spelling achievement in deaf and hearing school children. , 2006, Journal of deaf studies and deaf education.

[7]  Ivan Poupyrev,et al.  The MagicBook - Moving Seamlessly between Reality and Virtuality , 2001, IEEE Computer Graphics and Applications.

[8]  Anthony E. Cawkell,et al.  Understanding Virtual Reality , 2003, J. Documentation.

[9]  Nicoletta Adamo-Villani,et al.  An immersive virtual environment for learning sign language mathematics , 2006, SIGGRAPH '06.

[10]  D. R. A. Rambli,et al.  A PORTABLE AUGMENTED REALITY LAB , 2022 .

[11]  István Barakonyi bara,et al.  Augmented Reality Videoconferencing for Collaborative Work , 1996 .

[12]  Sigal Eden,et al.  Improving Flexible Thinking in Deaf and Hard of Hearing Children with Virtual Reality Technology , 2000, American annals of the deaf.

[13]  M. Turcsányi-Szabó,et al.  Augmented Reality in Education , 2018, Handbook of Mobile Teaching and Learning.

[14]  Mark Billinghurst,et al.  The design of a mixed-reality book: Is it still a real book? , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[15]  Mark Billinghurst,et al.  The mixed reality book: a new multimedia reading experience , 2007, CHI Extended Abstracts.

[16]  Halimah Badioze Zaman,et al.  Learning Science Using AR Book: A Preliminary Study on Visual Needs of Deaf Learners , 2009, IVIC.

[17]  Kirsten Risden,et al.  Evaluating computer game concepts with children , 2004, IDC '04.

[18]  Dieter Schmalstieg,et al.  Augmented Reality Agents in the Development Pipeline of Computer Entertainment , 2005, ICEC.