A Richly Annotated, Multilingual Parallel Corpus for Hybrid Machine Translation

In recent years, machine translation (MT) research has focused on investigating how hybrid machine translation as well as system combination approaches can be designed so that the resulting hybrid translations show an improvement over the individual “component” translations. As a first step towards achieving this objective we have developed a parallel corpus with source text and the corresponding translation output from a number of machine translation engines, annotated with metadata information, capturing aspects of the translation process performed by the different MT systems. This corpus aims to serve as a basic resource for further research on whether hybrid machine translation algorithms and system combination techniques can benefit from additional (linguistically motivated, decoding, and runtime) information provided by the different systems involved. In this paper, we describe the annotated corpus we have created. We provide an overview on the component MT systems and the XLIFF-based annotation format we have developed. We also report on first experiments with the ML4HMT corpus data.

[1]  Chin-Yew Lin,et al.  ORANGE: a Method for Evaluating Automatic Evaluation Metrics for Machine Translation , 2004, COLING.

[2]  Andy Way,et al.  MaTrEx: The DCU MT System for WMT 2008 , 2008, WMT@ACL.

[3]  Tomaz Erjavec,et al.  The JRC-Acquis: A Multilingual Aligned Parallel Corpus with 20+ Languages , 2006, LREC.

[4]  Eleftherios Avramidis,et al.  DFKI System Combination with Sentence Ranking at ML4HMT-2011 , 2011 .

[5]  Alexandra Birch,et al.  Proceedings of the Joint 5th Workshop on Statistical Machine Translation and MetricsMATR , 2010 .

[6]  Franz Josef Och,et al.  Minimum Error Rate Training in Statistical Machine Translation , 2003, ACL.

[7]  Chris Callison-Burch,et al.  Demonstration of Joshua: An Open Source Toolkit for Parsing-based Machine Translation , 2009, ACL.

[8]  Mikel L. Forcada,et al.  Opentrad Apertium open-source machine translation system: an opportunity for business and research , 2006 .

[9]  Maria Leonor Pacheco,et al.  of the Association for Computational Linguistics: , 2001 .

[10]  Tsuyoshi Okita DCU Confusion Network-based System Combination for ML 4 HMT , 2011 .

[11]  Philipp Koehn,et al.  Further Meta-Evaluation of Machine Translation , 2008, WMT@ACL.

[12]  Philipp Koehn,et al.  Moses: Open Source Toolkit for Statistical Machine Translation , 2007, ACL.

[13]  C. Federmann,et al.  DFKI System Combination using Syntactic Information at ML4HMT-2011 , 2011 .

[14]  Philipp Koehn,et al.  Europarl: A Parallel Corpus for Statistical Machine Translation , 2005, MTSUMMIT.

[15]  Stella Markantonatou,et al.  Evaluation of a Machine Translation System for Low Resource Languages: METIS-II , 2008, LREC.

[16]  Andreas Stolcke,et al.  SRILM - an extensible language modeling toolkit , 2002, INTERSPEECH.