The Semiotics of Subtitling

Chapter 1: Subtitling and Audio-visual Language Transfer 1.1. The context of subtitling 1.2. A typology of audio-visual language transfer 1.3. Analysis of subtitling 1.4. Linguistic background 1.5. The audio-visual dimension 1.5.1. Spatial restrictions 1.5.2. Temporal restrictions 1.5.3. Synchronization 1.6. Summary Chapter 2: Intralingual Subtitling 2.1. Introduction 2.2. Importance of subtitling 2.3. Technical description of subtitling 2.3.1. Deaf and hard-of-hearing viewers 2.4. Subtitling for deaf and hard-of-hearing viewers 2.4.1. Representing the phonological component 2.4.1.1. Emphasis and phrasing 2.4.1.2. Tone of voice 2.4.1.3. Accents and foreign languages 2.4.1.4. Humour 2.4.2. Subtitling the non-verbal component 2.4.2.1. Sound effects 2.4.2.2.Music 2.4.3. Subtitling in a dynamic medium 2.4.3.1. Locating and identifying speakers 2.4.3.2. Timing and synchronization 2.4.3.3. Leading and lagging 2.4.3.4. Shot changes 2.4.3.5. The need for research 2.5. Proposed research 2.5.1. Analysis of subtitling standards 2.5.2. Transfer of language 2.5.3. Reading characteristics of viewers 2.5.4. Analysis of viewing behaviour 2.6. Summary of objectives Chapter 3: Reading Characteristics of Deaf and Hard-of-hearing Viewers 3.1. Introduction 3.2. The concept of inner-speech 3.2.1. Electromyographic recording (EMG) 3.2.2. Concurrent vocalization 3.2.3. Homophonic reading 3.3. Deaf readers 3.4. Recoding strategies among the deaf 3.4.1. Articulatory codes 3.4.2. Dactylic (fingerspelling) 3.4.3. Sign language 3.4.4. No recoding 3.5. The role of recoding in comprehension 3.6. Summary Chapter 4: The Integration of Text and Film 4.1. Introduction 4.2. Textual features 4.2.1. Language style 4.2.2. Text cohesion 4.2.3. Referential cohesion 4.2.4. Substitution and Ellipsis 4.2.5. Conjunction 4.2.6. Lexical cohesion 4.2.7. Text cohesion and subtitles 4.3. Film features 4.3.1. Camera manipulation 4.3.2. Editing 4.3.3. Film features and subtitles 4.4. Summary Chapter 5: Studying the Effect of Subtitles 5.1. Introduction 5.2. Survey method 5.3. Semi-controlled experiment method 5.4. Controlled experiment method 5.5. Summary Chapter 6: Subtitling for Adults 6.1. Introduction 6.2. Subtitle samples 6.3. Selection and analysis procedure 6.4. Results: characteristics of subtitles broadcast for adults 6.4.1. Synchronicity between subtitle and sound 6.4.2. Synchronicity between subtitle and image 6.4.3. Extent of editing 6.5. Summary Chapter 7: Subtitling for Children 7.1. Introduction 7.2. Subtitle samples 7.3. Selection and analysis procedure 7.4. Results 7.4.1. Synchronicity between subtitles and sound 7.4.2. Synchronicity between subtitles and image 7.4.3. Extent of editing 7.5. Summary Chapter 8: Analyzing Viewing Behaviour 8.1. Introduction 8.1.1. Experimental procedure 8.1.1.1. Participants 8.1.1.2. Materials 8.1.2. Procedure 8.2. Results and analysis 8.2.1. Study 1: Subtitle rate 8.2.1.1. Interactive effects of programme & subtitle 8.2.2. Study 2: Onset of speech 8.2.2.1. Main effects of group, programme, and subtitle 8.2.2.2. Interactive effect of programme and subtitle 8.2.3. Study 3: Shot changes 8.2.3.1. Main effect of programme 8.2.3.2. Interactive effect of programme and subtitle 8.2.4. Study 4: Extent of editing 8.2.4.1. Interactive effect of group & programme 8.2.4.2. Interactive effect of group & subtitle 8.2.4.3. Interactive effect of programme & subtitle 8.2.5. Study 5: Visibility of speaker 8.2.5.1. Main effect of group 8.2.5.2. Interactive effect of group & programme 8.2.5.3. Interactive effect of programme & subtitle 8.3. Summary Chapter 9: Conclusions

[1]  Michael Cockerell.  Live from Number 10: The Inside Story of Prime Ministers and Television , 1990 .

[2]  N. K. Lodge.  The European AUDETEL project-enhancing television for visually impaired people , 1993 .

[3]  A. Greeman,et al.  How do they do that , 1999 .

[4]  Sal DiFrancesca,et al.  Academic achievement test results of a national testing program for hearing impaired students, United States: spring 1971 , 1972 .

[5]  Yuko Kimura,et al.  Concurrent Vocal Interference: Its Effects on Kana and Kanji , 1984 .

[6]  J. Birch,et al.  Captions and Reading Rates of Hearing-Impaired Students , 1980, American annals of the deaf.

[7]  Mark Gluck,et al.  Memory and cognition , 2000, Clinical Neurophysiology.

[8]  Mark S. Seidenberg.  Constraining models of word recognition , 1985, Cognition.

[9]  M T Turvey,et al.  Phonetic Activity in Reading: an Experiment With Kanji , 1977, Language and speech.

[10]  W F Yik,et al.  The Effect of Visual and Acoustic Similarity on Short-Term Memory for Chinese Words , 1978, The Quarterly journal of experimental psychology.

[11]  Philip Crookes,et al.  The European Institute for the Media. , 1988 .

[12]  Åke Werner Edfeldt,et al.  Silent speech and silent reading , 1959 .

[13]  Ovid J. L. Tzeng,et al.  Speech Recoding in Reading Chinese Characters. , 1977 .

[14]  C. Clifton,et al.  Subvocalization and reading for meaning , 1980 .

[15]  Henrik Gottlieb,et al.  Subtitling: Diagonal translation , 1994 .

[16]  G. V. van Orden.  A ROWS is a ROSE: spelling, sound, and reading. , 1987, Memory & cognition.

[17]  M. Karchmer,et al.  School achievement scores of hearing impaired children: national data on achievement status and growth patterns. , 1977, American annals of the deaf.

[18]  W. Stokoe.  Sign Language Structure , 1980 .

[19]  J. Locke,et al.  Phonemic effects in the silent reading of hearing and deaf children , 1978, Cognition.

[20]  K. Goodman.  Reading: A psycholinguistic guessing game , 1967 .

[21]  B. Dodd,et al.  Phonological coding by the prelinguistically deaf , 1977 .

[22]  R N Haber,et al.  Does silent reading involve articulation? Evidence from tongue twisters. , 1982, The American journal of psychology.

[23]  Géry d’Ydewalle,et al.  Attention Allocation with Overlapping Sound, Image, and Text , 1992 .

[24]  Peter Bryant,et al.  Reading and writing in English and Japanese: A cross-cultural study of young children† , 1983 .

[25]  Diane F. Witmer,et al.  Smile when you say that: graphic accents as gender markers in computer-mediated communication , 1998 .

[26]  R. Conrad,et al.  The chronology of the development of covert speech in children. , 1971 .

[27]  Philip B. Gough,et al.  One Second of Reading. , 1972 .

[28]  R Conrad,et al.  Short-term memory in the deaf: a test for speech coding. , 1972, British journal of psychology.

[29]  L I Garrity,et al.  Electromyography: A review of the current status of subvocal speech research , 1977, Memory & cognition.

[30]  Betty Ann Levy.  Speech Analysis during Sentence Processing: Reading and Listening. , 1978 .

[31]  M. Anisfeld,et al.  Semantic and surface codes in the memory of deaf children , 1977, Cognitive Psychology.

[32]  R. Knight,et al.  FILM LANGUAGE , 1968, Studying The Lord of the Rings.

[33]  Ragnhild Söderbergh.  Language by ear and by eye , 1975, Journal of Child Language.

[34]  Zoe de Linde.  ‘Read my lips’ subtitling principles, practices, and problems , 1995 .

[35]  C Ewoldt,et al.  Problems with Rewritten Materials, as Exemplified by "To Build a Fire" , 1984, American annals of the deaf.

[36]  Peter V. Paul,et al.  Language and Deafness , 1984 .

[37]  F. J. Mc Guigan,et al.  Longitudinal Study of Covert Oral Behavior during Silent Reading , 1969 .

[38]  J. Cleve,et al.  Gallaudet encyclopedia of deaf people and deafness , 1987 .

[39]  J. Locke,et al.  Deaf children's phonetic, visual, and dactylic coding in a grapheme recall task. , 1971, Journal of experimental psychology.

[40]  L. Quinn,et al.  Reading skills of hearing and congenitally deaf children. , 1981, Journal of experimental child psychology.

[41]  David Brien,et al.  Dictionary of British sign language/English , 1992 .

[42]  Rebecca Treiman,et al.  Silent reading: Insights from second-generation deaf readers , 1983, Cognitive Psychology.

[43]  Sherman Wilcox,et al.  Gesture and the Nature of Language , 1995 .

[44]  F. Mcguigan,et al.  External auditory feedback from covert oral behavior during silent reading , 1971 .

[45]  M A Just,et al.  A theory of reading: from eye fixations to comprehension. , 1980, Psychological review.

[46]  Gideon Toury,et al.  TRANSLATED LITERATURE: SYSTEM, NORM, PERFORMANCE Toward a TT-Oriented Approach to Literary Translation* , 1981 .

[47]  R Conrad,et al.  Some correlates of speech coding in the short-term memory of the deaf. , 1973, Journal of speech and hearing research.

[48]  G. Humphreys,et al.  Are there independent lexical and nonlexical routes in word processing? An evaluation of the dual-route theory of reading , 1985, Behavioral and Brain Sciences.

[49]  R Conrad,et al.  The reading ability of deaf school-leavers. , 1977, The British journal of educational psychology.

[50]  A. Davis,et al.  The prevalence of hearing impairment and reported hearing disability among adults in Great Britain. , 1989, International journal of epidemiology.

[51]  Thomas J. Ayres,et al.  Silent reading time for tongue-twister paragraphs , 1984 .

[52]  Michael Hoey,et al.  Patterns of Lexis In Text , 1991 .

[53]  James L. McClelland.  The programmable blackboard model of reading , 1986 .

[54]  F K Hammermeister,et al.  Reading achievement in deaf adults. , 1971, American annals of the deaf.

[55]  Douglas Biber,et al.  Variation across speech and writing: Methodology , 1988 .

[56]  E. B. Huey.  The Psychology And Pedagogy Of Reading , 1908 .

[57]  Dai Vaughan.  Television Documentary Usage , 1976 .

[58]  Lucien Marleau.  Les sous-titres... un mal nécessaire , 1982 .

[59]  R Conrad,et al.  The effect of vocalizing on comprehension in the profoundly deaf. , 1971, British journal of psychology.

[60]  Howard Dittrick,et al.  Teaching By Television , 1947 .

[61]  Jelliffe..  THE PSYCHOLOGY AND PEDAGOGY OF READING , 1908 .

[62]  F McTearMichael,et al.  Review of "Relevance , 1987 .

[63]  Marilyn Jager Adams,et al.  Models of word recognition , 1979, Cognitive Psychology.

[64]  Glenn M. Kleiman,et al.  Speech recoding in reading , 1975 .

[65]  Alec Webster,et al.  Deafness, development, and literacy , 1986 .

[66]  M. Shand,et al.  Sign-based short-term coding of American Sign Language signs and printed English words by congenitally deaf signers , 1982, Cognitive Psychology.