Speech-Input Multi-Target Machine Translation

In order to simultaneously translate speech into multiple languages an extension of stochastic finite-state transducers is proposed. In this approach the speech translation model consists of a single network where acoustic models (in the input) and the multilingual model (in the output) are embedded. The multi-target model has been evaluated in a practical situation, and the results have been compared with those obtained using several mono-target models. Experimental results show that the multi-target one requires less amount of memory. In addition, a single decoding is enough to get the speech translated into multiple languages.

[1]  Hermann Ney,et al.  Augmenting a Small Parallel Text with Morpho-Syntactic Language , 2005, ParallelText@ACL.

[2]  Michael Riley,et al.  Speech Recognition by Composition of Weighted Finite Automata , 1996, ArXiv.

[3]  Harold L. Somers,et al.  An introduction to machine translation , 1992 .

[4]  Hermann Ney,et al.  Novel Reordering Approaches in Phrase-Based Statistical Machine Translation , 2005, ParallelText@ACL.

[5]  M. Inés Torres,et al.  k-TSS language models in speech recognition systems , 2001, Comput. Speech Lang..

[6]  Enrique Vidal,et al.  Finite-state speech-to-speech translation , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Robert L. Mercer,et al.  The Mathematics of Statistical Machine Translation: Parameter Estimation , 1993, CL.

[8]  Yaser Al-Onaizan,et al.  Translation with Finite-State Devices , 1998, AMTA.

[9]  Fernando Pereira,et al.  Weighted finite-state transducers in speech recognition , 2002, Comput. Speech Lang..

[10]  José B. Mariño,et al.  Albayzin speech database: design of the phonetic corpus , 1993, EUROSPEECH.

[11]  M. Inés Torres,et al.  Speech Translation with Phrase Based Stochastic Finite-State Transducers , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[12]  Francisco Casacuberta,et al.  Multi-Target Machine Translation using Finite-State Transducers , 2006 .

[13]  Olatz Ansa,et al.  Representation and Treatment of Multiword Expressions in Basque , 2004 .

[14]  Francisco Casacuberta,et al.  Machine Translation with Inferred Stochastic Finite-State Transducers , 2004, Computational Linguistics.

[15]  Roger K. Moore.  Computer Speech and Language , 1986 .

[16]  Enrique Vidal,et al.  Inference of k-Testable Languages in the Strict Sense and Application to Syntactic Pattern Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Antonio L. Lagarda,et al.  On the use of statistical machine-translation techniques within a memory-based translation system (AMETRA) , 2003, MTSUMMIT.