MT model space: statistical versus compositional versus example-based machine translation

We offer a perspective on EBMT from a statistical MT standpoint, by developing a three-dimensional MT model space based on three pairs of definitions: (1) logical versus statistical MT, (2) schema-based versus example-based MT, and (3) lexical versus compositional MT. Within this space we consider the interplay of three key ideas in the evolution of transfer, example-based, and statistical approaches to MT. We depict how all translation models face these issues in one way or another, regardless of the school of thought, and suggest where the real questions for the future may lie.

[1]  Naoto Katoh,et al.  Probabilistic Model for Example-based Machine Translation , 2005, MTSUMMIT.

[2]  Ilyas Cicekli.  Inducing translation templates with type constraints , 2006, Machine Translation.

[3]  Janet L. Kolodner,et al.  Maintaining Organization in a Dynamic Long-Term Memory , 1983, Cogn. Sci..

[4]  P. Gove.  Webster's Third New International Dictionary , 1986 .

[5]  H. Altay Güvenir,et al.  Learning Translation Rules From A Bilingual Corpus , 1996, ArXiv.

[6]  Francis Bond,et al.  A Hybrid Rule and Example-Based Method for Machine Translation , 2003 .

[7]  John HUTCHINS.  Towards a Definition of Example-based Machine Translation , 2005, MTSUMMIT.

[8]  Marti A. Hearst,et al.  HLT-NAACL 2003 : Human Language Technology conference of the North American Chapter of the Association for Computational Linguistics : proceedings of the main conference : May 27 to June 1, 2003, Edmonton, Alberta, Canada , 2003 .

[9]  Johanna D. Moore,et al.  36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, COLING-ACL '98, August 10-14, 1998, Université de Montréal, Montréal, Quebec, Canada. Proceedings of the Conference. , 1998 .

[10]  Srinivas Bangalore,et al.  Learning Dependency Translation Models as Collections of Finite-State Head Transducers , 2000, Computational Linguistics.

[11]  Rogers P. Hall,et al.  Computational Approaches to Analogical Reasoning: A Comparative Analysis , 1989, Artif. Intell..

[12]  Michael Carl.  Inducing Translation Grammars from Bracketed Alignments , 2003 .

[13]  Yair Neuman,et al.  A theory of meaning , 2006, Inf. Sci..

[14]  Dekai Wu.  Trainable Coarse Bilingual Grammars for Parallel Text Bracketing , 1995, VLC@ACL.

[15]  Michael Carl,et al.  A system-theoretical view of EBMT , 2005, Machine Translation.

[16]  Colin Cherry,et al.  Word Alignment with Cohesion Constraint , 2003, NAACL.

[17]  John Chandioux.  METEO : un système opérationnel pour la traduction automatique des bulletins météorologiques destinés au grand public , 1976 .

[18]  David W. Aha,et al.  Learning Representative Exemplars of Concepts: An Initial Case Study , 1987 .

[19]  Yuji Matsumoto,et al.  Sructural Matching of Parallel Texts , 1993, ACL.

[20]  Sara Hawker,et al.  Compact Oxford English dictionary of current English , 2005 .

[21]  Enrique Vidal,et al.  A Recursive Statistical Translation Model , 2005, ParallelText@ACL.

[22]  Tiejun Zhao,et al.  Learning Chinese Bracketing Knowledge Based on a Bilingual Language Model , 2002, COLING.

[23]  Andy Way,et al.  Hybrid Example-Based SMT: the Best of Both Worlds? , 2005, ParallelText@ACL.

[24]  Srinivas Bangalore,et al.  Automatic Acquisition of Hierarchical Transduction Models for Machine Translation , 1998, COLING-ACL.

[25]  Daniel Marcu,et al.  Statistical Phrase-Based Translation , 2003, NAACL.

[26]  Hitoshi Iida,et al.  Experiments and Prospects of Example-Based Machine Translation , 1991, ACL.

[27]  Robert Dale,et al.  Handbook of Natural Language Processing , 2001, Computational Linguistics.

[28]  Ralf D. Brown,et al.  CLUSTERED TRANSFER RULE INDUCTION FOR EXAMPLE-BASED TRANSLATION , 2003 .

[29]  H. Somers,et al.  EBMT seen as case-based reasoning , 2001, MTSUMMIT.

[30]  Yves Lepage,et al.  Purest ever example-based machine translation: Detailed presentation and assessment , 2005, Machine Translation.

[31]  John Hutchins.  Example-based machine translation: a review and commentary , 2006, Machine Translation.

[32]  Jaime G. Carbonell,et al.  Derivational Analogy in PRODIGY: Automating Case Acquisition, Storage, and Utilization , 1993, Machine Learning.

[33]  Oxford.  Compact Oxford English Dictionary of Current English , 2008 .

[34]  Andy Way,et al.  Hybrid data-driven models of machine translation , 2005, Machine Translation.

[35]  Daniel Gildea,et al.  Stochastic Lexicalized Inversion Transduction Grammar for Alignment , 2005, ACL.

[36]  Christian Boitet,et al.  Automated Translation at Grenoble University , 1985, Comput. Linguistics.

[37]  David Chiang,et al.  A Hierarchical Phrase-Based Model for Statistical Machine Translation , 2005, ACL.

[38]  Ranan B. Banerji,et al.  Artificial and human intelligence : edited review papers presented at the International NATO Symposium on Artificial and Human Intelligence , 1984 .

[39]  W. N. Locke,et al.  Machine Translation of Languages: Fourteen Essays , 1955 .

[40]  K. McTait,et al.  A language-neutral sparse-data algorithm for extracting translation patterns , 1999, TMI.

[41]  Hiroaki Kitano,et al.  High Performance Memory-Based Translation on IXM2 Massively Parallel Associative Memory Processor , 1991, AAAI.

[42]  S. Guttenplan.  Mind and language , 1975 .

[43]  M. Dummett.  What Is a Theory of Meaning? (II) , 1996 .

[44]  Taro Watanabe,et al.  Reordering Constraints for Phrase-Based Statistical Machine Translation , 2004, COLING.

[45]  Eiichiro Sumita.  An Example-Based Machine Translation System Using DP-Matching Between Word Sequences , 2003 .

[46]  Kenji Araki,et al.  EBMT of POS-Tagged Sentences by Recursive Division Via Inductive Learning , 2003 .

[47]  Ying Zhang,et al.  An efficient phrase-to-phrase alignment model for arbitrarily long phrase and large corpora , 2005, EAMT.

[48]  G. Evans,et al.  What is a Theory of Meaning , 1976 .

[49]  Fei Xia,et al.  A Comparison of Head Transducers and Transfer for a Limited Domain Translation Application , 1997, ACL.

[50]  Hua Wu,et al.  Example-based machine translation based on tree–string correspondence and statistical generation , 2006, Machine Translation.

[51]  Michael Carl,et al.  A Model of Competence for Corpus-Based Machine Translation , 2000, COLING.

[52]  Harold L. Somers,et al.  Review Article: Example-based Machine Translation , 1999, Machine Translation.

[53]  Philippe Langlais,et al.  EBMT by tree-phrasing , 2006, Machine Translation.

[54]  Hitoshi Iida,et al.  Cooperation between Transfer and Analysis in Example-Based Framework , 1992, COLING.

[55]  Michel Simard,et al.  Statistical Translation Alignment with Compositionality Constraints , 2003, ParallelTexts@NAACL-HLT.

[56]  Kevin Knight,et al.  A Syntax-based Statistical Translation Model , 2001, ACL.

[57]  Mari Ostendorf,et al.  HLT-NAACL 2003 : Human Language Technology conference of the North American Chapter of the Association for Computational Linguistics: companion volume : short parers, student research workshop, demonstrations, tutorial abstracts : May 27 to June 1, 2003, Edmonton, Alberta, Canada , 2003 .

[58]  Hermann Ney,et al.  Improved Alignment Models for Statistical Machine Translation , 1999, EMNLP.

[59]  Jean Senellart,et al.  SYSTRAN intuitive coding technology , 2003, MTSUMMIT.

[60]  Hiroyuki Kaji,et al.  Learning Translation Templates From Bilingual Text , 1992, COLING.

[61]  E. R. Bareiss,et al.  PROTOS: An Experiment in Knowledge Acquisition for Heuristic ClassificationTasks , 1986 .

[62]  Andy Way,et al.  Robust Sub-Sentential Alignment of Phrase-Structure Trees , 2004, COLING.

[63]  Ralf D. Brown,et al.  Adding linguistic knowledge to a lexical example-based translation system , 1999, TMI.

[64]  Andy Way,et al.  Recent Advances in Example-Based Machine Translation , 2004 .

[65]  Dekai Wu,et al.  An Algorithm for Simultaneously Bracketing Parallel Texts by Aligning Words , 1995, ACL.

[66]  Stuart J. Russell,et al.  Do the right thing - studies in limited rationality , 1991 .

[67]  H. Altay Güvenir,et al.  Learning Translation Templates from Bilingual Translation Examples , 2004, Applied Intelligence.

[68]  David W. Aha,et al.  Instance-Based Learning Algorithms , 1991, Machine Learning.

[69]  Robert L. Mercer,et al.  The Mathematics of Statistical Machine Translation: Parameter Estimation , 1993, CL.

[70]  Dekai Wu,et al.  A Polynomial-Time Algorithm for Statistical Machine Translation , 1996, ACL.

[71]  Fred Popowich,et al.  What is example-based machine translation? , 2001, MTSUMMIT.

[72]  ANDY WAY,et al.  Comparing example-based and statistical machine translation , 2005, Nat. Lang. Eng..

[73]  Harold L. Somers,et al.  An Overview of EBMT , 2003 .

[74]  Tiejun Zhao,et al.  Automatic Translation Template Acquisition Based on Bilingual Structure Alignment , 2001, Int. J. Comput. Linguistics Chin. Lang. Process..

[75]  Dekai Wu,et al.  Recognizing Paraphrases and Textual Entailment Using Inversion Transduction Grammars , 2005, EMSEE@ACL.

[76]  Makoto Nagao,et al.  A framework of a mechanical translation between Japanese and English by analogy principle , 1984 .

[77]  Stephan Vogel,et al.  Word Alignment Based on Bilingual Bracketing , 2003, ParallelTexts@NAACL-HLT.

[78]  Hermann Ney,et al.  Discriminative Training and Maximum Entropy Models for Statistical Machine Translation , 2002, ACL.

[79]  Yuji Matsumoto,et al.  Extracting Translation Knowledge from Parallel Corpora , 2003 .

[80]  Dekai Wu,et al.  Stochastic Inversion Transduction Grammars and Bilingual Parsing of Parallel Corpora , 1997, CL.

[81]  Hermann Ney,et al.  A Comparative Study on Reordering Constraints in Statistical Machine Translation , 2003, ACL.

[82]  William Morris.  The American Heritage dictionary of the English language , 1969 .

[83]  Harold L. Somers,et al.  An introduction to machine translation , 1992 .

[84]  Chris Quirk,et al.  Dependency treelet translation: the convergence of statistical and example-based machine-translation? , 2006, MTSUMMIT.

[85]  Dekai Wu,et al.  Machine Translation with a Stochastic Grammatical Channel , 1998, COLING-ACL.

[86]  Pascale Fung,et al.  Inversion Transduction Grammar Constraints for Mining Parallel Sentences from Quasi-Comparable Corpora , 2005, IJCNLP.

[87]  John Cocke,et al.  A Statistical Approach to Machine Translation , 1990, CL.

[88]  Janet L. Kolodner,et al.  Reconstructive Memory: A Computer Model , 1983, Cogn. Sci..

[89]  Sergei Nirenburg,et al.  Readings in Machine Translation , 2003 .

[90]  T. Veale.  Gaijin : A Bootstrapping , Template-Driven Approach to Example-Based MT , 1997 .

[91]  Dana Angluin,et al.  Inductive Inference of Formal Languages from Positive Data , 1980, Inf. Control..