ENHANCED CAPTIONING: SPEAKER IDENTIFICATION USING GRAPHICAL AND TEXT-BASED IDENTIFIERS

This thesis proposes a new technique for speaker identification in captioning using three identifiers: image, name and colour. This technique was implemented as a proofof-concept system called the Enhanced Captioning: Speaker Identification (EC: SID). This EC: SID was developed using participatory design and evaluated with people who are deaf or hard-of-hearing. This system evaluation used questionnaires and eye tracking methodologies, and the control was closed captioning, the existing system for North America. The results indicated that there is potential for using graphical and textbased identifiers for speaker identification. The placement of captioning or displaying the name of the speaker may not be effective for indicating who is speaking. The ability to customize these identifiers allows for changes in the content and different needs of users. Further design and evaluation is required to determine the long-term practicality of this graphical speaker identification technique.

[1]  J S Burt,et al.  Case-Mixing Effects on Spelling Recognition: The Importance of Test Format , 2000, Journal of psycholinguistic research.

[2]  Deborah I. Fels,et al.  Using Placement and Name for Speaker Identification in Captioning , 2010, ICCHP.

[3]  Deborah I. Fels,et al.  Enhanced captioning - Speaker identification: text vs. images , 2011 .

[4]  Courtney L. Burks.  Improving Access to Commercial Websites Under the Americans with Disabilities Act and the Twenty-First Century Communications and Video Accessibility Act , 2013 .

[5]  長瀬 修.  わかりやすい障害者の権利条約 : 知的障害のある人の権利のために = Convention on the rights of persons with disabilities , 2009 .

[6]  Deborah I. Fels,et al.  Methods for inclusion: Employing think aloud protocols in software usability studies with individuals who are deaf , 2006, Int. J. Hum. Comput. Stud..

[7]  Mark Witkowski,et al.  A comparison of static and moving presentation modes for image collections , 2006, AVI '06.

[8]  Deborah I. Fels,et al.  Dancing with Words: Using Animated Text for Captioning , 2008, Int. J. Hum. Comput. Interact..

[9]  L. Mathiassen,et al.  Professional systems development: experience, ideas and action , 1990 .

[10]  Beverley J. Oda.  Canadian Radio-television and Telecommunications Commission , 2020, The SAGE International Encyclopedia of Mass Media and Society.

[11]  Andrew Zisserman,et al.  Taking the bite out of automated naming of characters in TV video , 2009, Image Vis. Comput..

[12]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[13]  Sean Zdenek.  Which Sounds are Significant? Towards a Rhetoric of Closed Captioning , 2011 .

[14]  Deborah I. Fels,et al.  Emotive captioning , 2007, CIE.

[15]  Deborah I. Fels,et al.  Using Avatars for Improving Speaker Identification in Captioning , 2009, INTERACT.

[16]  G. C. van der Veer.  Working with computers : theory versus outcome , 1988 .

[17]  J. Bongaarts.  United Nations Department of Economic and Social Affairs, Population Division World Mortality Report 2005 , 2006 .

[18]  Barbara Ringer,et al.  The Role of Product Quality Information, Market State Information and Transaction Costs in Electronic Auctions , 2002 .

[19]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[20]  Pascal Béguin,et al.  Design as a mutual learning process between users and designers , 2003, Interact. Comput..

[21]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[22]  Jesper Simonsen,et al.  MUST: A Method for Participatory Design , 1998, Hum. Comput. Interact..

[23]  T.L.J. Ferris,et al.  Participatory IT Design: Designing for Business and Workplace Realities , 2005, IEEE Transactions on Professional Communication.

[24]  Lars Mathiassen,et al.  Mapping situations within a system development project , 1985, Inf. Manag..

[25]  Deborah I. Fels,et al.  EnACT: A Software Tool for Creating Animated Text Captions , 2008, ICCHP.