Czech-Sign Speech Corpus for Semantic Based Machine Translation

This paper describes progress in a development of the human-human dialogue corpus for machine translation of spoken language. We have chosen a semantically annotated corpus of phone calls to a train timetable information center. The phone calls consist of inquiries regarding their train traveler plans. Corpus dialogue act tags incorporate abstract semantic meaning. We have enriched a part of the corpus with Sign Speech translation and we have proposed methods how to do automatic machine translation from Czech to Sign Speech using semantic annotation contained in the corpus.

[1]  Andy Way,et al.  An Example-Based Approach to Translating Sign Language , 2005, MTSUMMIT.

[2]  Marilyn A. Walker,et al.  DATE: A Dialogue Act Tagging Scheme for Evaluation of Spoken Dialogue Systems , 2001, HLT.

[3]  Catherine N. Ball,et al.  Representation of american sign language for machine translation , 2002 .

[4]  Jiří Langer,et al.  Znaková zásoba českého znakového jazyka k rozšiřujícímu studiusurdopedie se zaměřením na znakový jazyk :výukový CD-ROM. , 2005 .

[5]  Julius O. Smith,et al.  Bark and ERB bilinear transforms , 1999, IEEE Trans. Speech Audio Process..

[6]  Jirí Zahradil,et al.  A human-human train timetable dialogue corpus , 2005, INTERSPEECH.

[7]  Nina Suszczańska.  TRANSLATING POLISH TEXTS INTO SIGN LANGUAGE IN THE TGT SYSTEM , 2002 .

[8]  Paul Dalsgaard,et al.  Proceedings of the 7th International Conference on Spoken Language Processing (ICSLP'2002), Denver-Colorado, USA, September 2002 , 2002 .

[9]  Ian W. Marshall,et al.  Sign language generation using HPSG. , 2002, TMI.

[10]  William J. Byrne,et al.  Issues in Annotation of the Czech Spontaneous Speech Corpus in the MALACH project , 2004, LREC.

[11]  Steve J. Young,et al.  Talking to machines (statistically speaking) , 2002, INTERSPEECH.

[12]  Hermann Ney,et al.  Statistical Sign Language Translation , 2004 .

[13]  Norman I. Badler,et al.  A machine translation system from English to American Sign Language , 2000, AMTA.

[14]  Matt Huenerfauth,et al.  A Multi-Path Architecture for Machine Translation of English Text into American Sign Language Animation , 2004, NAACL.