Assessing post-editing efficiency in a realistic translation environment

In many experimental studies on assessing post-editing efficiency, idiosyncratic user interfaces isolate translators from translation aids that are available to them in their daily work. In contrast, our experimental design allows translators to use a well-known translator workbench for both conventional translation and post-editing. We find that post-editing reduces translation time significantly, although considerably less than reported in isolated experiments, and argue that overall assessments of post-editing efficiency should be based on a realistic translation environment.

[1]  Jeffrey Heer,et al.  The efficacy of human post-editing for language translation , 2013, CHI.

[2]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[3]  Lucia Specia,et al.  PET: a Tool for Post-editing and Assessing Machine Translation , 2012, LREC.

[4]  Ana Guerberof Arenas Productivity and Quality in the Post-editing of Outputs from Translation Memories and Machine Translation , 2008 .

[5]  Lucia Specia,et al.  Assessing the Post-Editing Effort for Automatic and Semi-Automatic Translations of DVD Subtitles , 2011, RANLP.

[6]  Peter Dalgaard,et al.  R Development Core Team (2010): R: A language and environment for statistical computing , 2010 .

[7]  Khalil Sima'an,et al.  Statistical Machine Translation for Automobile Marketing Texts , 2013, MTSUMMIT.

[8]  Ana Guerberof Arenas What do professional translators think about post-editing? , 2013 .

[9]  Philipp Koehn,et al.  Findings of the 2012 Workshop on Statistical Machine Translation , 2012, WMT@NAACL-HLT.

[10]  Maureen Ehrensberger-Dow,et al.  Indicators of translation competence: Translators’ self-concepts and the translation of titles , 2013 .

[11]  Rico Sennrich,et al.  Machine Translation of TV Subtitles for Large Scale Production , 2010 .

[12]  Maarit Koponen,et al.  Comparing human perceptions of post-editing effort with post-editing operations , 2012, WMT@NAACL-HLT.

[13]  Raymond Flournoy MT use within the enterprise: Encouraging adoption via a unified MT API , 2011, MTSUMMIT.

[14]  H. H. Clark The language-as-fixed-effect fallacy: A critique of language statistics in psychological research. , 1973 .