论文信息 - Towards fairer evaluations of commercial MT systems on basic travel expressions corpora

Towards fairer evaluations of commercial MT systems on basic travel expressions corpora

We compare the performance of several SYSTRAN systems on the BTEC corpus. Two language pairs: Chinese to English and Japanese to English are used. Whenever it is possible the system will be used “off the shelf” and then tuned. The first system we use is freely available on the web. The second system, SYSTRAN Premium, is commercial. It is used in two ways: (1) choosing and ordering available original dictionaries and setting parameters, (2) same + user dictionaries. As far as the evaluation is concerned, we competed in the unlimited data track.

[1] S. Siegel,et al. Nonparametric Statistics for the Behavioral Sciences , 2022, The SAGE Encyclopedia of Research Design.

[2] Vladimir I. Levenshtein,et al. Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[3] D. W. Barron. Machine Translation , 1968, Nature.

[4] Anthony Ralston,et al. Encyclopedia of Computer Science , 1971 .

[5] Jessie Pinkham,et al. Traduction automatique ancrée dans l’analyse linguistique , 2002, JEPTALNRECITAL.

[6] George R. Doddington,et al. Automatic Evaluation of Machine Translation Quality Using N-gram Co-Occurrence Statistics , 2002 .

[7] Eiichiro Sumita,et al. Toward a Broad-coverage Bilingual Corpus for Speech Translation of Travel Conversations in the Real World , 2002, LREC.

[8] Joseph P. Turian,et al. Evaluation of machine translation and its evaluation , 2003, MTSUMMIT.

[9] Francisco Casacuberta,et al. A Quantitative Method for Machine Translation Evaluation , 2003 .