Translation quality assessment: a critical methodological review

ABSTRACT Translation quality assessment (TQA) represents one of the most productive lines of research in Translation Studies (TS), with scholars proposing different TQA models. In parallel to these theoretical models is the emergence of a diverse array of assessment methods trialled and used to evaluate translation quality in different settings (e.g., error analysis, corpus-based evaluation, rubric scoring, calibration of dichotomous items, Thurstonian comparative judgement). Despite these developments, it seems that little effort has been made to bring to the fore methodological aspects of the TQA practices. Against this background, this methodological review sets out to track the developmental trend of the TQA methods, hoping to bring clarity to the nature of the methodological pluralism, driving forces behind methodological evolution, as well as promises and constraints of each methodological choice. The review also attempts to interrogate the TQA practices, focusing on three overarching issues of reliability, validity and practicality. By doing so, we hope to highlight their merits and demerits, and occasionally challenge their legitimacy. Finally, the review describes some gaps in TQA practice and research, and suggests potential directions to move forward the enterprise of TQA.

[1]  A. Akbari.  Translation quality research , 2018, Babel. Revue internationale de la traduction / International Journal of Translation.

[2]  L. Thurstone.  A law of comparative judgment. , 1994 .

[3]  Koen Plevoets,et al.  Towards a Corpus-based, Statistical Approach to Translation Quality: Measuring and Visualizing Linguistic Deviance in Student Translations , 2018, Linguistica Antverpiensia, New Series – Themes in Translation Studies.

[4]  Sonia Colina,et al.  Further evidence for a functionalist approach to translation quality evaluation , 2009 .

[5]  J. Vine,et al.  Current trends on MA translation courses in the UK: changing assessment practices on core translation modules , 2017, New Perspectives on Assessment in Translator Education.

[6]  Ghodrat Hassani,et al.  A Corpus-Based Evaluation Approach to Translation Improvement , 2011 .

[8]  Lynne Bowker,et al.  A Corpus-Based Approach to Evaluating Student Translations , 2000 .

[9]  June Eyckmans,et al.  Item-based assessment of translation competence: Chimera of objectivity versus prospect of reliable measurement , 2018, Linguistica Antverpiensia, New Series – Themes in Translation Studies.

[10]  Geoffrey S. Koby,et al.  Assessing assessment: Translator training evaluation and the needs of industry quality assessment , 2003 .

[11]  Silvia Montero Martínez,et al.  The Modular Assessment Pack: a new approach to translation quality assessment at the Directorate General for Translation , 2017 .

[12]  D. Gouadec.  Paramètres de l’évaluation des traductions , 1981 .

[13]  A. Clifford.  Grading Scientific Translation: What's a New Teacher to Do? , 2007 .

[14]  Miguel A. Jiménez-Crespo.  The evaluation of pragmatic and functionalist aspects in localization: towards a holistic approach to Quality Assurance , 2009 .

[15]  Lynne Bowker,et al.  Towards a Methodology for a Corpus-Based Approach to Translation Evaluation , 2001 .

[16]  Ian Jones,et al.  A comparative judgement approach to teacher assessment , 2015 .

[17]  S. Campbell,et al.  Translation and interpreting assessment in the context of educational measurement , 2003 .

[18]  Steven E. Stemler,et al.  Best Practices in Interrater Reliability Three Common Approaches , 2008 .

[19]  Nicole Martínez Melis,et al.  Assessment in translation studies : Research needs , 2001 .

[20]  Miguel A. Jiménez-Crespo.  A corpus-based error typology: towards a more objective approach to measuring quality in localization , 2011 .

[21]  The Assessment of Professional Translation Quality: Creating Credibility out of Chaos , 1989 .

[22]  Ignacio Garcia,et al.  Improvements to NAATI testing-Development of a conceptual overview for a new model for NAATI standards, testing and assessment , 2012 .

[23]  Sonia Colina,et al.  Translation Quality Evaluation , 2008 .

[24]  Tzu-Yun Lai.  Reliability and Validity of a Scale-based Assessment for Translation Tests , 2012 .

[25]  Neng Huang,et al.  Error deduction and descriptors - A comparison of two methods of translation test assessment , 2010 .