Panning for EBMT gold, or “Remembering not to forget”

A very useful service to the example-based machine translation (EBMT) community was provided by Harold Somers in his summary article which appeared in 1999, and was extended in our 2003 book Recent advances in example-based machine translation. As well as providing a comprehensive review of the paradigm, Somers gives a categorisation of the different instantiations of the basic model. In this paper, we provide a complementary view to that of Somers. Today’s EBMT systems learn by analogy. Perhaps even more so than statistical models of translation, one might view these systems as being incapable of forgetting. We researchers and system developers, on the other hand, often forget or are ignorant of techniques and models presented in prior research. The primary aim of this paper is to try to ensure that golden nuggets from past (now quite distantly so) EBMT research papers are gathered together and presented here for a new generation of researchers keen to operate in the paradigm, especially given the spate of recent open-source releases of EBMT systems. We revisit the findings of the previous main research papers, relate them to some of the major research efforts which have taken place since then, and examine especially the prophecies given in the older pieces of work to see the extent to which they have been borne out in the newer research. Given the strong convergence between the leading corpus-based approaches to MT, especially since the introduction of phrase-based statistical MT, a further hope is that these findings may also prove useful to researchers and developers in other areas of MT.

[1]  Ralf D. Brown,et al.  Automated Generalization of Translation Examples , 2000, COLING.

[2]  Kenji Araki,et al.  EBMT of POS-Tagged Sentences by Recursive Division Via Inductive Learning , 2003 .

[3]  Khalil Sima'an,et al.  A Consistent and Efficient Estimator for Data-Oriented Parsing , 2005, J. Autom. Lang. Comb..

[4]  Ralf D. Brown Automated Dictionary Extraction for “Knowledge-Free” Example-Based Translation , 2006 .

[5]  Bowen Zhou,et al.  Soft Syntactic Constraints for Hierarchical Phrase-Based Translation Using Latent Syntactic Distributions , 2010, EMNLP.

[6]  Francis Bond,et al.  A Hybrid Rule and Example-Based Method for Machine Translation , 2003 .

[7]  Andy Way,et al.  Robust large-scale EBMT with marker-based segmentation , 2004, TMI.

[8]  John Cocke,et al.  A statistical approach to French/English translation , 1988, TMI.

[9]  Mark Johnson The DOP Estimation Method Is Biased and Inconsistent , 2002, Computational Linguistics.

[10]  Hermann Ney,et al.  The Alignment Template Approach to Statistical Machine Translation , 2004, CL.

[11]  Yuji Matsumoto,et al.  Acquisition of translation rules from parallel corpora , 1997 .

[12]  Zhoujun Li,et al.  An Example-based Decoder for Spoken Language Machine Translation , 2008, IJCNLP.

[13]  Stelios Piperidis,et al.  A Matching Technique in Example-Based Machine Translation , 1994, COLING.

[14]  Satoshi Sato Example-based machine translation , 1992 .

[15]  Sudip Kumar Naskar,et al.  A review of EBMT using proportional analogies , 2009 .

[16]  Ulrich Germann,et al.  Greedy Decoding for Statistical Machine Translation in Almost Linear Time , 2003, NAACL.

[17]  Yanjun Ma,et al.  Bootstrapping Word Alignment via Word Packing , 2007, ACL.

[18]  Philipp Koehn,et al.  Pharaoh: A Beam Search Decoder for Phrase-Based Statistical Machine Translation Models , 2004, AMTA.

[19]  Gökhan Tür,et al.  Prosody-based automatic segmentation of speech into sentences and topics , 2000, Speech Commun..

[20]  Eiichiro Sumita,et al.  Translating with Examples: A New Approach to Machine Translation , 2005 .

[21]  Eiichiro Sumita,et al.  A Translation Aid System Using Flexible Text Retrieval Based on Syntax-Matching , 1988 .

[22]  Chris Callison-Burch,et al.  A compact data structure for searchable translation memories , 2005, EAMT.

[23]  Andy Way,et al.  Exploiting source similarity for SMT using context-informed features , 2007, TMI.

[24]  Roland Kuhn,et al.  Rule-Based Translation with Statistical Phrase-Based Post-Editing , 2007, WMT@ACL.

[25]  Christos Malavazos,et al.  Application of Analogical Modelling to Example Based Machine Translation , 2000, COLING.

[26]  Stephen Armstrong Using EMBT to produce foreign language subtitles , 2007 .

[27]  Andy Way,et al.  MATREX: DCU machine translation system for IWSLT 2006. , 2006, IWSLT.

[28]  H. Somers,et al.  EBMT seen as case-based reasoning , 2001, MTSUMMIT.

[29]  John Hutchins Example-based machine translation: a review and commentary , 2006, Machine Translation.

[30]  Andreas Stolcke,et al.  Enriching speech recognition with automatic detection of sentence boundaries and disfluencies , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[31]  Hitoshi Iida,et al.  An Example-Based Disambiguation of Prepositional Phrase Attachment , 1993, TMI.

[32]  Ralf D. Brown,et al.  Example-Based Machine Translation in the Pangloss System , 1996, COLING.

[33]  Andy Way,et al.  Optimal Bilingual Data for French-English PB-SMT , 2009, EAMT.

[34]  Declan Groves,et al.  Evaluating syntax-driven approaches to phrase extraction for MT , 2009 .

[35]  Kun Yu,et al.  Example-based machine translation based on deeper NLP , 2006, IWSLT.

[36]  Alon Lavie,et al.  METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments , 2005, IEEvaluation@ACL.

[37]  Andy Way,et al.  Controlled Translation in an Example-based Environment: What do Automatic Evaluation Metrics Tell Us? , 2005, Machine Translation.

[38]  Marine Carpuat,et al.  How phrase sense disambiguation outperforms word sense disambiguation for statistical machine translation , 2007, TMI.

[39]  Dekai Wu,et al.  MT model space: statistical versus compositional versus example-based machine translation , 2005, Machine Translation.

[40]  A.P.J. van den Bosch,et al.  Extending memory-based machine translation to phrases , 2009 .

[41]  Yaser Al-Onaizan,et al.  Generalizing Local and Non-Local Word-Reordering Patterns for Syntax-Based Machine Translation , 2008, EMNLP.

[42]  Ilyas Cicekli,et al.  Ordering Translation Templates by Assigning Confidence Factors , 1998, AMTA.

[43]  Pete Whitelock,et al.  The SLE example-based translation system , 2006, IWSLT.

[44]  Jaime G. Carbonell,et al.  Symmetric probabilistic alignment for example-based translation , 2005, EAMT.

[45]  Daniel Marcu,et al.  SPMT: Statistical Machine Translation with Syntactified Target Language Phrases , 2006, EMNLP.

[46]  Mei Yang,et al.  Toward Smaller, Faster, and Better Hierarchical Phrase-based SMT , 2009, ACL.

[47]  Ying Zhang,et al.  An efficient phrase-to-phrase alignment model for arbitrarily long phrase and large corpora , 2005, EAMT.

[48]  Philip Koehn,et al.  Statistical Machine Translation , 2010, EAMT.

[49]  Yanjun Ma,et al.  Alignment-guided chunking , 2007 .

[50]  Michael J. Fischer,et al.  The String-to-String Correction Problem , 1974, JACM.

[51]  Andy Way,et al.  A Critique of Statistical Machine Translation , 2021, Linguistica Antverpiensia, New Series – Themes in Translation Studies.

[52]  ANDY WAY,et al.  Comparing example-based and statistical machine translation , 2005, Nat. Lang. Eng..

[53]  A Elithorn,et al.  ARTIFICIAL AND HUMAN INTELLIGENCE , 1984 .

[54]  William J. Byrne,et al.  HMM Word and Phrase Alignment for Statistical Machine Translation , 2005, HLT.

[55]  Alon Lavie,et al.  See Blockindiscussions, Blockinstats, Blockinand Blockinauthor Blockinprofiles Blockinfor Blockinthis Blockinpublication Statistical Blockintransfer Blockinsystems Blockinfor Blockinmachine Blockintranslation , 2022 .

[56]  Andy Way,et al.  Marker-Based Filtering of Bilingual Phrase Pairs for SMT , 2009, EAMT.

[57]  Andy Way,et al.  wEBMT: Developing and Validating an Example-Based Machine Translation System using the World Wide Web , 2003, CL.

[58]  Yves Lepage,et al.  Lexicons or phrase tables? An investigation in sampling-based multilingual alignment , 2009 .

[59]  Fred Popowich,et al.  What is example-based machine translation? , 2001, MTSUMMIT.

[60]  Andy Way,et al.  Disambiguation Strategies for Data-Oriented Translation , 2006, EAMT.

[61]  Yanjun Ma,et al.  Improving Word Alignment Using Syntactic Dependencies , 2008, SSST@ACL.

[62]  Andy Way,et al.  Lost in translation: the problems of using mainstream MTevaluation metrics for sign language translation , 2006 .

[63]  Vincent Vandeghinste,et al.  Top-down Transfer in Example-based MT , 2009 .

[64]  Martin Volk,et al.  Alignment Tools for Parallel Treebanks , 2007 .

[65]  Yanjun Ma,et al.  MaTrEx: The DCU MT System for WMT 2008 , 2008, WMT@ACL.

[66]  Arul Menezes,et al.  A best-first alignment algorithm for automatic extraction of transfer mappings from bilingual corpora , 2001, DDMMT@ACL.

[67]  Harold L. Somers,et al.  An Overview of EBMT , 2003 .

[68]  Yanjun Ma,et al.  Using Supertags as Source Language Context in SMT , 2009, EAMT.

[69]  Hermann Ney,et al.  A Systematic Comparison of Various Statistical Alignment Models , 2003, CL.

[70]  Heidi Christensen,et al.  Punctuation annotation using statistical prosody models. , 2001 .

[71]  Alex Waibel,et al.  The CMU TransTac 2007 Eyes-free and Hands-free Two-way Speech-to-Speech Translation System , 2007 .

[72]  Yuji Matsumoto,et al.  Automatic construction of machine translation knowledge using translation literalness , 2003 .

[73]  Sadao Kurohashi,et al.  Example-based machine translation using structural translation examples , 2004, IWSLT.

[74]  Hua Wu,et al.  Example-based machine translation based on tree–string correspondence and statistical generation , 2006, Machine Translation.

[75]  Andy Way,et al.  Robust language pair-independent sub-tree alignment , 2007, MTSUMMIT.

[76]  Jian Cai,et al.  Filtering noisy parallel corpora of web pages , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[77]  Rafael E. Banchs,et al.  Discriminative Alignment Training without Annotated Data for Machine Translation , 2007, HLT-NAACL.

[78]  Timothy Baldwin,et al.  Restoring Punctuation and Casing in English Text , 2009, Australasian Conference on Artificial Intelligence.

[79]  Hermann Ney,et al.  Improvements in Phrase-Based Statistical Machine Translation , 2004, NAACL.

[80]  Yuji Matsumoto,et al.  Automatic Construction of Machine Translation Knowledge Using Translation Literalness , 2003, EACL.

[81]  Alon Lavie,et al.  Stat-XFER: A General Search-Based Syntax-Driven Framework for Machine Translation , 2008, CICLing.

[82]  Ralf D. Brown,et al.  Adding linguistic knowledge to a lexical example-based translation system , 1999, TMI.

[83]  Khalil Sima'an,et al.  Backoff Parameter Estimation for the DOP Model , 2003, ECML.

[84]  Andy Way,et al.  Recent Advances in Example-Based Machine Translation , 2004 .

[85]  Arul Menezes,et al.  Achieving commercial-quality translation with example-based methods , 2001, MTSUMMIT.

[86]  Makoto Nagao,et al.  A framework of a mechanical translation between Japanese and English by analogy principle , 1984 .

[87]  Yoshihiko Gotoh,et al.  Sentence Boundary Detection in Broadcast Speech Transcripts , 2000 .

[88]  Hussein Almuallim,et al.  Two Methods for Learning ALT-J/E Translation Rules from Examples and a Semantic Hierarchy , 1994, COLING.

[89]  Andy Way,et al.  Syntactically Lexicalized Phrase-Based SMT , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[90]  Kevin McTait,et al.  A Building Blocks Approach to Translation Memory , 1999, TC.

[91]  Anoop Sarkar,et al.  Discriminative Reranking for Machine Translation , 2004, NAACL.

[92]  Daniel M. Bikel,et al.  A Distributional Analysis of a Lexicalized Statistical Parsing Model , 2004, EMNLP.

[93]  Dan Klein,et al.  Improved Inference for Unlexicalized Parsing , 2007, NAACL.

[94]  Etienne Denoual The Influence of Example-data Homogeneity on EBMT Quality , 2005, MTSUMMIT.

[95]  Philippe Langlais,et al.  EBMT by tree-phrasing , 2006, Machine Translation.

[96]  Joel D. Martin,et al.  Improving Translation Quality by Discarding Most of the Phrasetable , 2007, EMNLP.

[97]  Andy Way,et al.  EBMT IN A CONTROLLED ENVIRONMENT , 2003 .

[98]  H. Altay Güvenir,et al.  Learning Translation Templates from Bilingual Translation Examples , 2004, Applied Intelligence.

[99]  Michel Simard,et al.  Merging example-based and statistical machine translation: an experiment , 2002, AMTA.

[100]  Hideo Watanabe,et al.  A Similarity-Driven Transfer System , 1992, COLING.

[101]  Michael Carl,et al.  METIS-II: the German to English MT system , 2007, MTSUMMIT.

[102]  Hermann Ney,et al.  Analysing soft syntax features and heuristics for hierarchical phrase based machine translation. , 2008, IWSLT.

[103]  Satoshi Sato,et al.  Toward Memory-based Translation , 1990, COLING.

[104]  Alexander M. Fraser,et al.  Getting the Structure Right for Word Alignment: LEAF , 2007, EMNLP-CoNLL.

[105]  Robert L. Mercer,et al.  The Mathematics of Statistical Machine Translation: Parameter Estimation , 1993, CL.

[106]  I. Çiçekli Learning Translation Templates with Type Constraints , 2005, MTSUMMIT.

[107]  Hiroyuki Kaji,et al.  Learning Translation Templates From Bilingual Text , 1992, COLING.

[108]  Pete Whitelock,et al.  Shake-and-Bake Translation , 1992, COLING.

[109]  Hiroshi Maruyama,et al.  Tree Cover Search Algorithm for Example-Based Translation , 2005 .

[110]  Gorka Labaka,et al.  An Open Architecture for Transfer-based Machine Translation between Spanish and Basque , 2005 .

[111]  Ralf D. Brown,et al.  The Pangloss-Lite machine translation system , 1996, AMTA.

[112]  Osamu Furuse,et al.  An example-based method for transfer-driven machine translation , 1992, TMI.

[113]  Andy Way,et al.  Hybrid rule-based - example-based MT: feeding Apertium with sub-sentential translation units , 2009 .

[114]  Aaron B. Phillips,et al.  Cunei Machine Translation Platform : System Description , 2009 .

[115]  Hermann Ney,et al.  Discriminative Training and Maximum Entropy Models for Statistical Machine Translation , 2002, ACL.

[116]  Peter Dirix,et al.  Example-based Translation Without Parallel Corpora: First Experiments on a Prototype , 2005, MTSUMMIT.

[117]  Yuji Matsumoto,et al.  Extracting Translation Knowledge from Parallel Corpora , 2003 .

[118]  Andy Way,et al.  Exploiting Parallel Treebanks to Improve Phrase-Based Statistical Machine Translation , 2009, CICLing.

[119]  Andy Way,et al.  Hand in hand: automatic sign language to English translation , 2007, TMI.

[120]  Qun Liu,et al.  Improving Statistical Machine Translation Performance by Training Data Selection and Optimization , 2007, EMNLP-CoNLL.

[121]  Andy Way,et al.  Automatically generated parallel treebanks and their exploitability in machine translation , 2009, Machine Translation.

[122]  Chris Quirk,et al.  Dependency treelet translation: the convergence of statistical and example-based machine-translation? , 2006, MTSUMMIT.

[123]  佐藤 理史,et al.  Example-based translation of technical terms , 1993 .

[124]  John Cocke,et al.  A Statistical Approach to Machine Translation , 1990, CL.

[125]  Khalil Sima'an,et al.  Data-Oriented Parsing , 2003 .

[126]  Takehito Utsuro,et al.  Thesaurus-based Efficient Example Retrieval by Generating Retrieval Queries from Similarities , 1994, COLING.

[127]  Aaron B. Phillips Sub-phrasal matching and structural templates in example-based MT , 2007, TMI.

[128]  Sergei Nirenburg,et al.  Two Approaches to Matching in Example-Based Machine Translation , 1993, TMI.

[129]  Dekai Wu,et al.  Stochastic Inversion Transduction Grammars and Bilingual Parsing of Parallel Corpora , 1997, CL.

[130]  Ben Taskar,et al.  Alignment by Agreement , 2006, NAACL.

[131]  Philipp Koehn,et al.  Moses: Open Source Toolkit for Statistical Machine Translation , 2007, ACL.

[132]  M. Carl,et al.  Reversible Template-based Shake & Bake Generation , 2005, MTSUMMIT.

[133]  Yanjun Ma,et al.  MaTrEx: the DCU machine translation system for IWSLT 2007 , 2007, IWSLT.

[134]  Philipp Koehn,et al.  Europarl: A Parallel Corpus for Statistical Machine Translation , 2005, MTSUMMIT.

[135]  Andy Way,et al.  Hybrid data-driven models of machine translation , 2005, Machine Translation.

[136]  Adam Lopez Tera-Scale Translation Models via Pattern Matching , 2008, COLING.

[137]  Andy Way,et al.  Combining data-driven MT systems for improved sign languagetranslation , 2007 .

[138]  H. Potter,et al.  Using Example-Based Machine Translation to translate DVD Subtitles , 2009 .

[139]  Daniel Marcu,et al.  Statistical Phrase-Based Translation , 2003, NAACL.

[140]  Victor Sadler,et al.  Pilot Implementation of a Bilingual Knowledge Bank , 1990, COLING.

[141]  Hideo Watanabe A Method for Distinguishing Exceptional and General Examples in Example-based Transfer Systems , 1994, COLING.

[142]  Alexander H. Waibel,et al.  Simultaneous translation of lectures and speeches , 2007, Machine Translation.

[143]  Eiichiro Sumita An Example-Based Machine Translation System Using DP-Matching Between Word Sequences , 2003 .

[144]  Daniel Marcu,et al.  A Phrase-Based,Joint Probability Model for Statistical Machine Translation , 2002, EMNLP.

[145]  Marine Carpuat,et al.  Word Sense Disambiguation vs. Statistical Machine Translation , 2005, ACL.

[146]  Naoto Katoh,et al.  Probabilistic Model for Example-based Machine Translation , 2005, MTSUMMIT.

[147]  Ilyas Cicekli Inducing translation templates with type constraints , 2006, Machine Translation.

[148]  Hitoshi Iida,et al.  Experiments and Prospects of Example-Based Machine Translation , 1991, ACL.

[149]  Ralf D. Brown,et al.  CLUSTERED TRANSFER RULE INDUCTION FOR EXAMPLE-BASED TRANSLATION , 2003 .

[150]  Michael Carl,et al.  Linking Translation Memories with Example-Based Machine Translation , 1999 .

[151]  William Byrne,et al.  HMM Word and Phrase Alignment for Statistical Machine Translation , 2005, EMNLP 2005.

[152]  M. Volk,et al.  Bootstrapping Parallel Treebanks , 2004, COLING 2004.

[153]  Harold L. Somers,et al.  Review Article: Example-based Machine Translation , 1999, Machine Translation.

[154]  Iaki Alegria,et al.  Mixing Approaches to MT for Basque: Selecting the best output from RBMT, EBMT and SMT , 2008 .

[155]  Montserrat Civit,et al.  Building Cast3LB: A Spanish Treebank , 2004 .

[156]  Hiroshi Nomiyama,et al.  Machine Translation by Case Generalization , 1992, COLING.

[157]  Mary Hearne,et al.  Data-oriented models of parsing and translation , 2005 .

[158]  Carlos Martín-Vide,et al.  Example-Based Machine Translation Using a Dictionary of Word Pairs , 2006, LREC.

[159]  Philipp Koehn,et al.  462 Machine Translation Systems for Europe , 2009, MTSUMMIT.

[160]  Andy Way,et al.  Hybrid Example-Based SMT: the Best of Both Worlds? , 2005, ParallelText@ACL.

[161]  Marti A. Hearst,et al.  HLT-NAACL 2003 : Human Language Technology conference of the North American Chapter of the Association for Computational Linguistics : proceedings of the main conference : May 27 to June 1, 2003, Edmonton, Alberta, Canada , 2003 .

[162]  Andy Way Machine translation using LFG-DOP , 2003 .

[163]  Qiang Dong,et al.  Hownet And The Computation Of Meaning , 2006 .

[164]  Jaime G. Carbonell,et al.  Spectral Clustering for Example Based Machine Translation , 2006, HLT-NAACL.

[165]  Mary Hearne,et al.  Comparing Constituency and Dependency Representations for SMT Phrase-Extraction , 2008, JEPTALNRECITAL.

[166]  Daniel Marcu,et al.  Scalable Inference and Training of Context-Rich Syntactic Translation Models , 2006, ACL.

[167]  Andy Way,et al.  A memory-based classification approach to marker-based EBMT , 2007 .

[168]  Paul N. Bennett,et al.  Reducing boundary friction using translation-fragment overlap , 2003, MTSUMMIT.

[169]  Andy Way,et al.  MaTrEx: The DCU MT System for WMT 2008 , 2008, WMT@ACL.

[170]  J. Smith,et al.  EBMT for SMT : A New EBMT-SMT Hybrid , 2009 .

[171]  Alex Waibel,et al.  Low Cost Portability for Statistical Machine Translation based on N-gram Coverage , 2005 .

[172]  Andy Way,et al.  Statistical Machine Translation: A Guide for Linguists and Translators , 2011, Lang. Linguistics Compass.

[173]  David Chiang,et al.  A Hierarchical Phrase-Based Model for Statistical Machine Translation , 2005, ACL.

[174]  Andy Way A hybrid architecture for robust MT using LFG-DOP , 1999, J. Exp. Theor. Artif. Intell..

[175]  Kevin McTait Translation Patterns, Linguistic Knowledge and Complexity in an Approach to EBMT , 2003 .

[176]  Nello Cristianini,et al.  Learning Performance of a Machine Translation System: a Statistical and Computational Analysis , 2008, WMT@ACL.

[177]  Yves Lepage,et al.  Purest ever example-based machine translation: Detailed presentation and assessment , 2005, Machine Translation.

[178]  Hiroaki Kitano,et al.  Example-Based Machine Translation on Massively Parallel Processors , 1993, International Joint Conference on Artificial Intelligence.

[179]  Jörg Tiedemann,et al.  Combining Clues for Word Alignment , 2003, EACL.

[180]  Sadao Kurohashi,et al.  Kyoto-U: Syntactical EBMT System for NTCIR-7 Patent Translation Task , 2008, NTCIR.

[181]  Hiroaki Kitano Speech-to-speech translation - a massively parallel memory-based approach , 1994, The Kluwer international series in engineering and computer science.