论文信息 - Deaf Individuals' Views on Speaking Behaviors of Hearing Peers when Using an Automatic Captioning App

Deaf Individuals' Views on Speaking Behaviors of Hearing Peers when Using an Automatic Captioning App

As automatic speech recognition (ASR) becomes more accurate, many deaf and hard-of-hearing (DHH) individuals are interested in ASR-based mobile applications to facilitate in-person communication with hearing peers. We investigate DHH users' preferences regarding the behaviors of the hearing person in this context. Using an ASR-based captioning app, eight Deaf/deaf participants held short conversations, with a hearing actor who exhibited certain behaviors, e.g. speaking quietly/loudly or slowly/quickly. Participants indicated some of the hearing individual's behaviors were more influential as to their subjective impression of the communication efficacy. We also found that these behaviors differed in how noticeable they were to the Deaf participants. This study provides guidance, from a Deaf perspective, about the types of behaviors hearing users should ideally exhibit in this context, motivating a focus on such behaviors in future design or evaluation of ASR-based communication apps.

Matt Huenerfauth | Matthew Seita

[1] Richard E. Ladner,et al. Improving Real-Time Captioning Experiences for Deaf and Hard of Hearing Students , 2016, ASSETS.

[2] Jon Barker,et al. The CHiME Challenges: Robust Speech Recognition in Everyday Environments , 2017, New Era for Robust Speech Recognition, Exploiting Deep Learning.

[3] S Oviatt,et al. Modeling global and focal hyperarticulation during human-computer error resolution. , 1998, The Journal of the Acoustical Society of America.

[4] Lisa B. Elliot,et al. Personal Perspectives on Using Automatic Speech Recognition to Facilitate Communication between Deaf Students and Hearing Customers , 2017, ASSETS.

[5] Rein Ove Sikveland,et al. How do we Speak to Foreigners? – Phonetic Analyses of Speech Communication between L1 and L2 Speakers of Norwegian , 2009 .

[6] Lisa B. Elliot,et al. User Experiences When Testing a Messaging App for Communication Between Individuals who are Hearing and Deaf or Hard of Hearing , 2017, ASSETS.

[7] Amanda Stent,et al. Adapting speaking after evidence of misrecognition: Local and global hyperarticulation , 2008, Speech Commun..

[8] Matt Huenerfauth,et al. Behavioral Changes in Speakers who are Automatically Captioned in Meetings with Deaf or Hard-of-Hearing Peers , 2018, ASSETS.

[9] Larwan Berke,et al. Deaf and Hard-of-Hearing Perspectives on Imperfect Automatic Speech Recognition for Captioning One-on-One Meetings , 2017, ASSETS.