Automatic translation from parallel speech: Simultaneous interpretation as MT training data

State-of-the art statistical machine translation depends heavily on the availability of domain-specific bilingual parallel text. However, acquiring large amounts of bilingual parallel text is costly and, depending on the language pair, sometimes impossible. We propose an alternative to parallel text as machine translation (MT) training data; audio recordings of parallel speech (pSp) as it occurs in any scenario where interpreters are involved. Although interpretation (pSp) differs significantly from translation (parallel text), we achieve surprisingly strong translation results with our pSp-trained MT and speech translation systems.We argue that the presented approach is of special interest for developing speech translation in the context of resource-deficient languages where even monolingual resources are scarce.

[1]  Robert L. Mercer,et al.  Automatic speech recognition in machine-aided translation , 1994, Comput. Speech Lang..

[2]  Richard C. Rose,et al.  Towards domain independence in machine aided human translation , 2008, INTERSPEECH.

[3]  Fred Van Besien,et al.  Anticipation in Simultaneous Interpretation , 1999 .

[4]  Kurt Kohn,et al.  The strategic dimension of interpreting , 1996 .

[5]  Franz Josef Och,et al.  Minimum Error Rate Training in Statistical Machine Translation , 2003, ACL.

[6]  Alexander H. Waibel,et al.  Lightly supervised acoustic model training on EPPS recordings , 2008, INTERSPEECH.

[7]  Alexander H. Waibel,et al.  Extracting clues from human interpreter speech for spoken language translation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  S. Vogel,et al.  SMT decoder dissected: word reordering , 2003, International Conference on Natural Language Processing and Knowledge Engineering, 2003. Proceedings. 2003.

[9]  Roland Kuhn,et al.  French speech recognition in an automatic dictation system for translators: the transtalk project , 1995, EUROSPEECH.

[10]  A. Waibel,et al.  Speech translation enhanced automatic speech recognition , 2005, IEEE Workshop on Automatic Speech Recognition and Understanding, 2005..

[11]  Rajai Al-Khanji,et al.  On the use of compensatory strategies in simultaneous interpretation , 2000 .

[12]  Martin Raab,et al.  The ISL TC-STAR Spring 2006 ASR Evaluation Systems , 2006 .

[13]  Kai-Fu Lee,et al.  Automatic Speech Recognition , 1989 .

[14]  Hermann Ney,et al.  Automatic text dictation in computer-assisted translation , 2005, INTERSPEECH.

[15]  Hermann Ney,et al.  A Systematic Comparison of Various Statistical Alignment Models , 2003, CL.

[16]  Andreas Stolcke,et al.  SRILM - an extensible language modeling toolkit , 2002, INTERSPEECH.