A ranking method for example based machine translation results by learning from user feedback

Example-Based Machine Translation (EBMT) is a corpus based approach to Machine Translation (MT), that utilizes the translation by analogy concept. In our EBMT system, translation templates are extracted automatically from bilingual aligned corpora by substituting the similarities and differences in pairs of translation examples with variables. In the earlier versions of the discussed system, the translation results were solely ranked using confidence factors of the translation templates. In this study, we introduce an improved ranking mechanism that dynamically learns from user feedback. When a user, such as a professional human translator, submits his evaluation of the generated translation results, the system learns “context-dependent co-occurrence rules” from this feedback. The newly learned rules are later consulted, while ranking the results of the subsequent translations. Through successive translation-evaluation cycles, we expect that the output of the ranking mechanism complies better with user expectations, listing the more preferred results in higher ranks. We also present the evaluation of our ranking method which uses the precision values at top results and the BLEU metric.

[1]  David Chiang,et al.  A Hierarchical Phrase-Based Model for Statistical Machine Translation , 2005, ACL.

[2]  Stuart M. Shieber,et al.  Synchronous Tree-Adjoining Grammars , 1990, COLING.

[3]  Andy Way,et al.  Robust large-scale EBMT with marker-based segmentation , 2004, TMI.

[4]  Arul Menezes,et al.  A best-first alignment algorithm for automatic extraction of transfer mappings from bilingual corpora , 2001, DDMMT@ACL.

[5]  Yuji Matsumoto,et al.  Feedback Cleaning of Machine Translation Rules Using Automatic Evaluation , 2003, ACL.

[6]  Eduard Hovy,et al.  Proceedings of the Third Conference of the Association for Machine Translation in the Americas on Machine Translation and the Information Soup , 1998 .

[7]  Kevin Knight,et al.  A Syntax-based Statistical Translation Model , 2001, ACL.

[8]  Kemal Oflazer,et al.  Two-level Description of Turkish Morphology , 1993, EACL.

[9]  H. Altay Güvenir,et al.  Learning Translation Templates from Bilingual Translation Examples , 2004, Applied Intelligence.

[10]  Jaime G. Carbonell,et al.  The Translation Correction Tool: English-Spanish User Studies , 2004, LREC.

[11]  Yuan Ding,et al.  Machine Translation Using Probabilistic Synchronous Dependency Insertion Grammars , 2005, ACL.

[12]  Ilyas Cicekli,et al.  A Link Grammar for an Agglutinative Language , 2007 .

[13]  Ilyas Cicekli.  Inducing translation templates with type constraints , 2006, Machine Translation.

[14]  Alon Lavie,et al.  A framework for interactive and automatic refinement of transfer-based machine translation , 2005, EAMT.

[15]  Ralph Grishman,et al.  Chart-Based Transfer Rule Application in Machine Translation , 2000, COLING.

[16]  Ilyas Cicekli,et al.  Ordering Translation Templates by Assigning Confidence Factors , 1998, AMTA.

[17]  Alexander M. Rush,et al.  Induction of Probabilistic Synchronous Tree-Insertion Grammars for Machine Translation , 2006 .

[18]  Ilyas Cicekli,et al.  A Rule-Based Morphological Disambiguator for Turkish , 2007 .

[19]  Turhan Osman Daybelge,et al.  IMPROVING THE PRECISION OF EXAMPLE-BASED MACHINE TRANSLATION BY LEARNING FROM USER FEEDBACK , 2007 .

[20]  Salim Roukos,et al.  Bleu: a Method for Automatic Evaluation of Machine Translation , 2002, ACL.

[21]  Andy Way,et al.  Recent Advances in Example-Based Machine Translation , 2004 .

[22]  Kenji Imamura,et al.  Application of translation knowledge acquired by hierarchical phrase alignment for pattern-based MT. , 2002, TMI.

[23]  Stephan Vogel,et al.  An Efficient Two-Pass Approach to Synchronous-CFG Driven Statistical MT , 2007, NAACL.

[24]  Hande Doğan.  Example based machine translation with type associated translation examples , 2007 .

[25]  H. Altay Güvenir,et al.  Learning Translation Templates from Examples , 1998, Inf. Syst..

[26]  Makoto Nagao,et al.  A framework of a mechanical translation between Japanese and English by analogy principle , 1984 .