Re-ranking for Bilingual Lexicon Extraction with Bi-directional Linear Transformation from Comparable Corpora

Recently a simple linear transformation with word embedding has been found to be highly effective to extract a bilingual lexicon from comparable corpora. However, the assumption that the pairs of bilingual word embedding for training this transformation satisfy a linear relationship automatically actually cant be guaranteed absolutely in practice. So the transformation of the source language to the target one is not consistent with the one of the target language to the source one. Given the translation candidate n-best list of a source word, we propose a bi-directional linear transformation based re-ranking method by combining the two direction linear score. The experimental results confirm that the proposed solution can achieve a significant improvement of 69% in the precision at Top-1 over the unidirectional baseline approach on the English-to-Chinese bilingual lexicon extraction task.

[1]  Emmanuel Morin,et al.  Looking at Unbalanced Specialized Comparable Corpora for Bilingual Lexicon Extraction , 2014, ACL.

[2]  Hermann Ney,et al.  EM Decipherment for Large Vocabularies , 2014, ACL.

[3]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Manaal Faruqui,et al.  Improving Vector Space Word Representations Using Multilingual Correlation , 2014, EACL.

[5]  Quoc V. Le,et al.  Exploiting Similarities among Languages for Machine Translation , 2013, ArXiv.

[6]  Chris Callison-Burch,et al.  Supervised Bilingual Lexicon Induction with Multiple Monolingual Signals , 2013, NAACL.

[7]  Sophia Ananiadou,et al.  Using a Random Forest Classifier to Compile Bilingual Dictionaries of Technical Terms from Comparable Corpora , 2014, EACL.

[8]  Yoshua Bengio,et al.  Word Representations: A Simple and General Method for Semi-Supervised Learning , 2010, ACL.

[9]  Marie-Francine Moens,et al.  Detecting Highly Confident Word Translations from Comparable Corpora without Any Prior Knowledge , 2012, EACL.

[10]  W. Bruce Croft,et al.  Phrasal translation and query expansion techniques for cross-language information retrieval , 1997, SIGIR '97.

[11]  Philippe Langlais,et al.  Revisiting Context-based Projection Methods for Term-Translation Spotting in Comparable Corpora , 2010, COLING.

[12]  Pierre Zweigenbaum,et al.  Looking for Candidate Translational Equivalents in Specialized, Comparable Corpora , 2002, COLING.

[13]  Reinhard Rapp,et al.  Automatic Identification of Word Translations from Unrelated English and German Corpora , 1999, ACL.

[14]  Hermann Ney,et al.  A Systematic Comparison of Various Statistical Alignment Models , 2003, CL.

[15]  Pierre Zweigenbaum,et al.  Context Vector Disambiguation for Bilingual Lexicon Extraction from Comparable Corpora , 2013, ACL.

[16]  Dong Wang,et al.  Normalized Word Embedding and Orthogonal Transform for Bilingual Word Translation , 2015, NAACL.

[17]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[18]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[19]  Pascale Fung,et al.  An IR Approach for Translating New Words from Nonparallel, Comparable Texts , 1998, ACL.