The CMU TransTac 2007 Eyes-free and Hands-free Two-way Speech-to-Speech Translation System

The paper describes our portable two-way speech-tospeech translation system using a completely eyesfree/hands-free user interface. This system translates between the language pair English and Iraqi Arabic as well as between English and Farsi, and was built within the framework of the DARPA TransTac program. The Farsi language support was developed within a 90-day period, testing our ability to rapidly support new languages. The paper gives an overview of the system’s components along with the individual component objective measures and a discussion of issues relevant for the overall usage of the system. We found that usability, flexibility, and robustness serve as severe constraints on system architecture and design.

[1]  Alan W. Black,et al.  Issues in building general letter to sound rules , 1998, SSW.

[2]  Rohit Prasad,et al.  The BBN 2007 displayless English/iraqi speech-to-speech translation system , 2007, INTERSPEECH.

[3]  Ian R. Lane,et al.  The UKA/CMU statistical machine translation system for IWSLT 2006 , 2006, IWSLT.

[4]  Ying Zhang,et al.  Optimizing components for handheld two-way speech translation for an English-iraqi Arabic system , 2006, INTERSPEECH.

[5]  A. Waibel,et al.  A one-pass decoder based on polymorphic linguistic context assignment , 2001, IEEE Workshop on Automatic Speech Recognition and Understanding, 2001. ASRU '01..

[6]  Bowen Zhou,et al.  IBM MASTOR SYSTEM: Multilingual Automatic Speech-to-Speech Translator , 2006 .

[7]  Daniel Marcu,et al.  Building an English-iraqi Arabic machine translation system for spoken utterances with limited resources , 2006, INTERSPEECH.

[8]  Alan W. Black,et al.  Intelligibility of machine translation output in speech synthesis , 2006, INTERSPEECH.

[9]  S. Young,et al.  Lattice-based discriminative training for large vocabulary speech recognition , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[10]  Tanja Schultz,et al.  Challenges with Rapid Adaptation of Speech Translation Systems to New Language Pairs , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[11]  Tanja Schultz,et al.  SPICE: web-based tools for rapid language adaptation in speech processing systems , 2007, INTERSPEECH.

[12]  Philipp Koehn,et al.  Pharaoh: A Beam Search Decoder for Phrase-Based Statistical Machine Translation Models , 2004, AMTA.

[13]  Ying Zhang,et al.  An efficient phrase-to-phrase alignment model for arbitrarily long phrase and large corpora , 2005, EAMT.

[14]  Salim Roukos,et al.  Bleu: a Method for Automatic Evaluation of Machine Translation , 2002, ACL.

[15]  Steve Young,et al.  Large vocabulary speech recognition , 1995 .

[16]  Andreas Stolcke,et al.  SRILM - an extensible language modeling toolkit , 2002, INTERSPEECH.

[17]  Masaaki Nagata,et al.  NUT-NTT Statistical Machine Translation System for IWSLT 2005 , 2005, IWSLT.