The Effects of Shot Changes on Eye Movements in Subtitling

In this paper we address the question whether shot changes trigger the re-reading of subtitles. Although it has been accepted in the professional literature on subtitling that subtitles should not be displayed over shot changes as they induce subtitle re-reading, support for this claim in eye movement studies is difficult to find. In this study we examined eye movement patterns of 71 participants watching news and documentary clips. We analysed subject hit count, number of fixations, first fixation duration, fixation time percent and transition matrix before, during and after shot changes in subtitles displayed over a shot change. Results of our study show that most viewers do not re-read subtitlescrossing shot changes.

[1]  Mairéad MacSweeney,et al.  Predictors of reading delay in deaf adolescents: the relative contributions of rapid automatized naming speed and phonological awareness and decoding. , 2003, Journal of deaf studies and deaf education.

[2]  L. Kelly,et al.  The importance of processing automaticity and temporary storage capacity to the differences in comprehension between skilled and less skilled college-age deaf readers. , 2003, Journal of deaf studies and deaf education.

[3]  M. Karchmer,et al.  School achievement scores of hearing impaired children: national data on achievement status and growth patterns. , 1977, American annals of the deaf.

[4]  Zoe de Linde,et al.  The Semiotics of Subtitling , 1999 .

[5]  Gary D. Robson.  The closed captioning handbook , 2004 .

[6]  J. Henderson,et al.  Edit Blindness: The relationship between attention and global change blindness in dynamic scenes. , 2008 .

[7]  Alan Agresti,et al.  Categorical Data Analysis , 1991, International Encyclopedia of Statistical Science.

[8]  J. Birch,et al.  Captions and Reading Rates of Hearing-Impaired Students , 1980, American annals of the deaf.

[9]  R Conrad,et al.  The reading ability of deaf school-leavers. , 1977, The British journal of educational psychology.

[10]  Carl Jensema.  Viewer Reaction to Different Television Captioning Speeds , 1998, American annals of the deaf.

[11]  Ye Wang,et al.  Near-Verbatim Captioning Versus Edited Captioning for Students Who Are Deaf or Hard of Hearing: A Preliminary Investigation of Effects on Comprehension , 2007, American annals of the deaf.

[12]  Patricia S. Koskinen.  Closed-Captioned Television: A New Technology for Enhancing Reading Skills of Learning Disabled Students. , 1986 .

[13]  Brenda Stephenson,et al.  An Examination of Twenty Literacy, Science, and Mathematics Practices Used to Educate Students Who Are Deaf or Hard of Hearing , 2006, American annals of the deaf.

[14]  M. Rodda,et al.  Language, Cognition, and Deafness , 1987 .

[15]  Rudolf Groner,et al.  From eye to mind : information acquisition in perception, search, and reading , 1990 .

[16]  Melody Hertzog,et al.  Effects of caption modification and instructor intervention on comprehension of a technical film , 1989 .

[17]  Zuzanna Klyszejko,et al.  Verbatim, Standard, or Edited?: Reading Patterns of Different Captioning Styles Among Deaf, Hard of Hearing, and Hearing Viewers , 2011, American annals of the deaf.

[18]  Jorge Díaz-Cintas,et al.  Audiovisual Translation, Subtitling , 2014 .

[19]  Rafael Santana Hernández,et al.  Reading levels of Spanish deaf students. , 2005, American annals of the deaf.

[20]  Trybus Rj,et al.  School achievement scores of hearing impaired children: national data on achievement status and growth patterns. , 1977 .

[21]  Robert Burch,et al.  Time Spent Viewing Captions on Television Programs , 2000, American annals of the deaf.

[22]  Stavroula Sokoli.  Subtitling Norms in Greece and Spain , 2009 .

[23]  David Bordwell,et al.  Film Art: An Introduction , 1979 .

[24]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[25]  Géry d'Ydewalle,et al.  Film Perception: The Processing of Film Cuts , 1998 .