A machine translation system from English to American Sign Language

Research in computational linguistics, computer graphics and autonomous agents has led to the development of increasingly sophisticated communicative agents over the past few years, bringing new perspective to machine translation research. The engineering of language-based smooth, expressive, natural-looking human gestures can give us useful insights into the design principles that have evolved in natural communication between people. In this paper we prototype a machine translation system from English to American Sign Language (ASL), taking into account not only linguistic but also visual and spatial information associated with ASL signs.

[1]  Ken Perlin,et al.  Real Time Responsive Animation with Personality , 1995, IEEE Trans. Vis. Comput. Graph..

[2]  Norman I. Badler,et al.  Animation control for real-time virtual humans , 1999, CACM.

[3]  A. Posner.  Learning to see. , 1955, Eye, ear, nose & throat monthly.

[4]  W. Stokoe.  Sign Language Structure , 1980 .

[5]  Aravind K. Joshi,et al.  An Introduction to Tree Adjoining Grammar , 1987 .

[6]  Scott K. Liddell,et al.  American Sign Language: The Phonological Base , 2013 .

[7]  Angus B. Grieve-Smith.  Sign Synthesis and Sign Phonology , 1998 .

[8]  Nancy J. Frishberg.  ARBITRARINESS AND ICONICITY: HISTORICAL CHANGE IN AMERICAN SIGN LANGUAGE , 1975 .

[9]  Stuart M. Shieber,et al.  Synchronous Tree-Adjoining Grammars , 1990, COLING.

[10]  Aravind K. Joshi,et al.  Using Lexicalized Tags for Machine Translation , 1990, COLING.

[11]  Martin L. A. Sternberg.  American Sign Language Dictionary , 1981 .

[12]  Dimitris N. Metaxas,et al.  A Framework for Recognizing the Simultaneous Aspects of American Sign Language , 2001, Comput. Vis. Image Underst..

[13]  Norman I. Badler,et al.  Interpreting movement manner , 2000, Proceedings Computer Animation 2000.

[14]  P. Adam.  Saltmarsh ecology: Coping with the environment , 1990 .

[15]  R. Battison,et al.  Phonological Deletion in American Sign Language , 2013 .

[16]  Noam Chomsky,et al.  The Sound Pattern of English , 1968 .

[17]  Tomaso Poggio,et al.  Learning to see , 1996 .

[18]  Per Christensen.  Coping with the Environment , 2002 .

[19]  XTAG Research Group,et al.  A Lexicalized Tree Adjoining Grammar for English , 1998, ArXiv.

[20]  W. Stokoe,et al.  A dictionary of American sign language on linguistic principles , 1965 .

[21]  Jakob Nielsen,et al.  User interface directions for the Web , 1999, CACM.

[22]  R. Campbell,et al.  Gesture, Speech and Sign , 1999 .

[23]  Patricia Siple,et al.  Understanding language through sign language research , 1978 .

[24]  Anne Abeillé,et al.  A Lexicalized Tree Adjoining Grammar for English , 1990 .

[25]  Prem Kalra,et al.  Face to virtual face , 1998, Proc. IEEE.

[26]  Norman I. Badler,et al.  The EMOTE model for effort and shape , 2000, SIGGRAPH.

[27]  Charles N. Li.  Word order and word order change , 1975 .

[28]  STUART M. SHIEBER.  RESTRICTING THE WEAK‐GENERATIVE CAPACITY OF SYNCHRONOUS TREE‐ADJOINING GRAMMARS , 1994, Comput. Intell..

[29]  Victoria A. Fromkin,et al.  Sign Languages: Evidence for Language Universals and the Linguistic Capacity of the Human Brain , 2013 .

[30]  E. Klima.  The signs of language , 1979 .