When the ear leads the eye – the use of text during simultaneous interpretation

ABSTRACT In our study we analyse the online processing of visual-verbal input during simultaneous interpreting with text. To that end, we compared 15 professional interpreters’ eye movements during simultaneous interpreting with text (SIMTXT) to a baseline collected during reading while listening (RWL). We found that interpreters have a preference for a visual lead during RWL, following the pattern well-documented in silent and oral reading studies. During SIMTXT, in contrast, interpreters show a clear preference for a visual lag. We tentatively conclude that during SIMTXT the visual input might be used first and foremost to support the production of the output rather than the comprehension of the input. Importantly, we submit that the availability of the written text of the orally presented discourse might negatively affect predictive processing.

[1]  Jesús Baigorri-Jalón.  From Paris to Nuremberg: The birth of conference interpreting , 2014 .

[2]  Ping Li,et al.  Attentional control in interpreting: A model of language control and processing control , 2019, Bilingualism: Language and Cognition.

[3]  Lucía Ruiz Rosendo,et al.  The influence of speed on omissions in simultaneous interpretation: An experimental study , 2015 .

[4]  Reinhold Kliegl,et al.  The eye-voice span during reading aloud , 2015, Front. Psychol..

[5]  Kylene Beers.  Listen While You Read: Struggling Readers and Audiobooks. , 1998 .

[6]  Sylvie Lambert,et al.  Shared Attention during Sight Translation, Sight Interpretation and Simultaneous Interpretation , 2004 .

[7]  Agnieszka Chmiel,et al.  Syntactic processing in sight translation by professional and trainee interpreters , 2019, Target. International Journal of Translation Studies.

[8]  Lucía Ruiz Rosendo,et al.  Coping with speed , 2019, Babel. Revue internationale de la traduction / International Journal of Translation.

[9]  Keith Rayner,et al.  Understanding Eye Movements in Reading. , 1997 .

[10]  M. Pickering,et al.  A theory of prediction in simultaneous interpreting , 2020, Bilingualism: Language and Cognition.

[11]  G. McConkie,et al.  What guides a reader's eye movements? , 1976, Vision Research.

[12]  M. Riazi,et al.  Investigating the effects of speech rate and accent on simultaneous interpretation: A mixed-methods approach , 2017 .

[13]  G. V. Chernov.  Conference Interpreting in the USSR: History, Theory, New Frontiers , 1992 .

[14]  Kilian Seeber,et al.  Multimodal Processing in Simultaneous Interpreting , 2017 .

[15]  D. Barr,et al.  Random effects structure for confirmatory hypothesis testing: Keep it maximal. , 2013, Journal of memory and language.

[16]  Agnieszka Lijewska,et al.  Multimodal processing in simultaneous interpreting with text , 2020 .

[17]  Sébastien Henrard,et al.  Different Bilingual Experiences Might Modulate Executive Tasks Advantages: Comparative Analysis between Monolinguals, Translators, and Interpreters , 2017, Front. Psychol..

[18]  Mike Rinck,et al.  Chapter 16 – Eye Movement Measures to Study Global Text Processing , 2003 .

[19]  Robin Setton,et al.  Syntacrobatics: Quality and reformulation in simultaneous-with-text , 2007 .

[20]  T. Bajo,et al.  Coordinating comprehension and production in simultaneous interpreters: Evidence from the Articulatory Suppression Effect* , 2011, Bilingualism: Language and Cognition.

[21]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[22]  S. Brand-Gruwel,et al.  Tracking the reading eye: towards a model of real-world reading , 2017, J. Comput. Assist. Learn..

[23]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[24]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[25]  Lisa C. Thomas,et al.  Redundancy Gains in Communication Tasks: A Comparison of Auditory, Visual, and Redundant Auditory-Visual Information Presentation on NextGen Flight Decks , 2012 .

[26]  Dominic W. Massaro,et al.  Read my lips: an animated face helps communicate musical lyrics , 2005, AVSP.

[27]  Albrecht W. Inhoff,et al.  Parafoveal preview benefits during silent and oral reading: Testing the parafoveal information extraction hypothesis , 2014 .

[28]  A. Inhoff,et al.  Regressions during Reading , 2019, Vision.

[29]  Reinhold Kliegl,et al.  SWIFT: a dynamical model of saccade generation during reading. , 2005, Psychological review.

[30]  A. Inhoff,et al.  Temporal dynamics of the eye–voice span and eye movement control during oral reading , 2011 .

[31]  S. Vandepitte.  Anticipation in conference interpreting: a cognitive process , 2001 .

[32]  K Rayner,et al.  Saccade size in reading depends upon character spaces and not visual angle , 1981, Perception & psychophysics.

[33]  Erik D. Reichle,et al.  The E-Z Reader model of eye-movement control in reading: Comparisons to other models , 2003, Behavioral and Brain Sciences.

[34]  K. Rayner.  The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[35]  Kilian G. Seeber.  Cognitive load in simultaneous interpreting: Existing theories — new models , 2011 .

[36]  D. Spinelli,et al.  The eye-voice lead during oral reading in developmental dyslexia , 2013, Front. Hum. Neurosci..

[37]  The Impact of Non-Native Accented English on Rendition Accuracy in Simultaneous Interpreting , 2013 .

[38]  Catherine Davies,et al.  Simultaneous Interpretation with Text. Is the Text 'Friend' or 'Foe'? Laying Foundations for a Teaching Module , 2009 .

[39]  M. Pickering,et al.  Does translation involve structural priming? , 2017, Quarterly journal of experimental psychology.

[40]  Alexis Hervais-Adelman,et al.  The neurobiology of simultaneous interpreting: Where extreme language control and cognitive control intersect , 2020, Bilingualism: Language and Cognition.

[41]  Marcel Adam Just,et al.  17 – What Your Eyes Do while Your Mind Is Reading1 , 1983 .

[42]  Johanna K. Kaakinen,et al.  Eye Movements During Reading , 2019, Eye Movement Research.