Intelligent Thai text - Thai sign translation for language learning

We present the Intelligent Thai text - Thai sign translation for language learning (IT^3STL). IT^3STL is able to translate Thai text into Thai sign language simply and conveniently anytime, anywhere. Thai sign language is the language of the deaf in Thailand. In the translation process, the distinction between Thai text and Thai sign language in both grammar and vocabulary are concerned in each processing step to ensure the accuracy of translation. IT^3STL was designed not only to be an automatic interpreter but also to be a language tutor assistant. It provides meaning of each word and describes the structure formation and word order of the translated sentence. With IT^3STL, the deaf and hearing-impaired are able to enhance their communication ability and to improve their knowledge and learning skills. Moreover IT^3STL has increased motivation and opportunity for them to access multimedia and e-learning. In our initial experiment, IT^3STL was implemented to translate sentences/phrases which were collected from different sources including textbooks, cartoons, bedtime story, newspapers and the public labels. IT^3STL was tested and evaluated in terms of the translation accuracy and user satisfaction. The evaluation results show that the translation accuracy and sign representation are acceptable, and it satisfies the users' needs.

[1]  Matt Huenerfauth Representing coordination and non-coordination in an american sign language animation , 2005, Assets '05.

[2]  Matt Huenerfauth,et al.  American Sign Language natural language generation and machine translation , 2005, ASAC.

[3]  Éva Sáfár,et al.  The Architecture of an English-Text-to-Sign-Languages Translation System , 2001 .

[4]  Matt Huenerfauth,et al.  A Multi-Path Architecture for Machine Translation of English Text into American Sign Language Animation , 2004, NAACL.

[5]  Max E. Jerman,et al.  Computer-Assisted Instruction , 1969, Science.

[6]  Ivan A. Sag,et al.  Book Reviews: Head-driven Phrase Structure Grammar and German in Head-driven Phrase-structure Grammar , 1996, CL.

[7]  N. Cercone,et al.  Bridging the gap : Thai-Thai Sign Machine Translation , 2007 .

[8]  James N. Butcher,et al.  Computer-Based Assessment , 2009 .

[9]  Karin Wiburg,et al.  Technology and Teaching English Language Learners , 2002 .

[10]  Nina Suszczańska TRANSLATING POLISH TEXTS INTO SIGN LANGUAGE IN THE TGT SYSTEM , 2002 .

[11]  Mark Warschauer,et al.  Network-based Language Teaching: Preface , 2000 .

[12]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[13]  J PlathWarren Early years in machine translation , 2002 .

[14]  W. Stokoe Sign Language Structure , 1980 .

[15]  Harold L. Somers,et al.  An introduction to machine translation , 1992 .

[16]  Mark Warschauer,et al.  Network-Based Language Teaching: Concepts and Practice , 2000 .

[17]  Tony Veale,et al.  The Challenges of Cross-Modal Translation: English-to-Sign-Language Translation in the Zardoz System , 1998, Machine Translation.

[18]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[19]  Booncharoen Sirinaovakul,et al.  Reordering: a stepping-stone to perfect Thai Sign generation , 2007 .

[20]  Mark Warschauer,et al.  Virtual Connections: Online Activities and Projects for Networking Language Learners , 1997 .

[21]  Mary Lee Field,et al.  From Reader to Reading Teacher: Issues and Strategies for Second Language Classrooms , 1997 .

[22]  M. Warschauer,et al.  Computers and language learning: an overview , 1998, Language Teaching.

[23]  Catherine N. Ball,et al.  Representation of american sign language for machine translation , 2002 .

[24]  Sergei Nirenburg,et al.  Book Review: Ontological Semantics, by Sergei Nirenburg and Victor Raskin , 2004, CL.

[25]  Andrew R. Molnar Computers in education: A brief history , 1997 .

[26]  Bencie Woll,et al.  The Linguistics of British Sign Language: An Introduction , 1999 .

[27]  Sandra Fotos Multimedia language teaching , 1996 .

[28]  Eugene F. Burke,et al.  Computer‐Based Assessment: A NATO Survey , 1995 .

[29]  Dean Barker,et al.  South African Sign Language Machine Translation System , 2003, AFRIGRAPH '03.

[30]  R C Atkinson,et al.  Computerized instruction and the learning process. , 1968, The American psychologist.

[31]  Matt Huenerfauth American Sign Language Generation: Multimodal NLG with Multiple Linguistic Channels , 2005, ACL.

[32]  Norman I. Badler,et al.  A machine translation system from English to American Sign Language , 2000, AMTA.