In this paper, we present the Moses-based infrastructure we developed and use as a productivity tool for the localisation of software documentation and user interface (UI) strings at Autodesk into twelve languages. We describe the adjustments we have made to the machine translation (MT) training workflow to suit our needs and environment, our server environment and the MT Info Service that handles all translation requests and allows the integration of MT in our various localisation systems. We also present the results of our latest post-editing productivity test, where we measured the productivity gain for translators post-editing MT output versus translating from scratch. Our analysis of the data indicates the presence of a strong correlation between the amount of editing applied to the raw MT output by the translators and their productivity gain. In addition, within the last calendar year our system has processed over thirteen million tokens of documentation content of which we have a record of the performed post-editing. This has allowed us to evaluate the performance of our MT engines for the different languages across our product portfolio, as well as spotlight potential issues with MT in the localisation process.
[1]
C. Spearman,et al.
Demonstration of Formulae for True Measurement of Correlation
,
1907
.
[2]
M. Kendall.
A NEW MEASURE OF RANK CORRELATION
,
1938
.
[3]
Vladimir I. Levenshtein,et al.
Binary codes capable of correcting deletions, insertions, and reversals
,
1965
.
[4]
Hermann Ney,et al.
Accelerated DP based search for statistical translation
,
1997,
EUROSPEECH.
[5]
Alon Lavie,et al.
METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments
,
2005,
IEEvaluation@ACL.
[6]
Matthew G. Snover,et al.
A Study of Translation Edit Rate with Targeted Human Annotation
,
2006,
AMTA.
[7]
Philipp Koehn,et al.
Moses: Open Source Toolkit for Statistical Machine Translation
,
2007,
ACL.
[8]
François Masselot,et al.
A Productivity Test of Statistical Machine Translation Post-Editing in a Typical Localisation Context
,
2010,
Prague Bull. Math. Linguistics.
[9]
Graham Neubig,et al.
Pointwise Prediction for Robust, Adaptable Japanese Morphological Analysis
,
2011,
ACL.