论文信息 - American Sign Language Generation: Multimodal NLG with Multiple Linguistic Channels

American Sign Language Generation: Multimodal NLG with Multiple Linguistic Channels

Software to translate English text into American Sign Language (ASL) animation can improve information accessibility for the majority of deaf adults with limited English literacy. ASL natural language generation (NLG) is a special form of multimodal NLG that uses multiple linguistic output channels. ASL NLG technology has applications for the generation of gesture animation and other communication signals that are not easily encoded as text strings.

Matt Huenerfauth

[1] Scott K. Liddell. Grammar, Gesture, and Meaning in American Sign Language , 2003 .

[2] R. Mitchell,et al. How many deaf people are there in the United States? Estimates from the Survey of Income and Program Participation. , 2005, Journal of deaf studies and deaf education.

[3] Carol Neidle,et al. The Syntax of American Sign Language: Functional Categories and Hierarchical Structure , 1999 .

[4] Matt Huenerfauth,et al. Spatial and planning models of ASL classifier predicates for machine translation , 2004, TMI.

[5] Stefan Kopp,et al. Towards integrated microplanning of language and iconic gesture for multimodal output , 2004, ICMI '04.

[6] Matt Huenerfauth. American Sign Language Spatial Representations for an Accessible User-Interface , 2005 .

[7] Matt Huenerfauth,et al. A Multi-Path Architecture for Machine Translation of English Text into American Sign Language Animation , 2004, NAACL.