The Impact of Assistive Technology on Communication Quality Between Deaf and Hearing Individuals

Deaf individuals often experience communication difficulties in face-to-face interactions with hearing people. In order to support deaf individuals in such situations, an active stream of assistive technology (AT) research focuses on real-time translation of sign language. We investigate the impact of real-time translation-based ATs on communication quality between deaf and hearing individuals. We conducted a focus group and aWizard of Oz study in which deaf and hearing participants jointly interacted with different assistive technologies. We find that while ATs facilitate communication, communication quality is degraded by to breaks in the conversation. Using Co-Cultural Theory, we identify deaf people as a subordinate group inside a hearing society. Our results indicate that current ATs reinforce this subordination by emphasizing deficiency of mastering the dominant form of communication. Based on our findings, we propose a change in design perspective by enabling the hearing to sign rather than the deaf to "hear". We argue that ATs should not be seen as "just" a tool for the Deaf but rather as a collaborative technology.

[1]  Nicole Fassbinder.  Extraordinary Human Computer Interaction Interfaces For Users With Disabilities , 2016 .

[2]  Lih-Jen Kau,et al.  A real-time portable sign language translation system , 2015, 2015 IEEE 58th International Midwest Symposium on Circuits and Systems (MWSCAS).

[3]  Matt Huenerfauth,et al.  Comparing Methods of Displaying Language Feedback for Student Videos of American Sign Language , 2015, ASSETS.

[4]  Tsukasa Nishida.  Anxiety/Uncertainty Management (AUM) Theory , 2015 .

[5]  Soraia Silva Prietch,et al.  Technology Acceptance Evaluation by Deaf Students Considering the Inclusive Education Context , 2015, INTERACT.

[6]  Matt Huenerfauth,et al.  Demographic and Experiential Factors Influencing Acceptance of Sign Language Animation by Deaf Users , 2015, ASSETS.

[7]  Brent N. Shiver,et al.  Evaluating Alternatives for Better Deaf Accessibility to Selected Web-Based Multimedia , 2015, ASSETS.

[8]  B Phillips,et al.  Predictors of assistive technology abandonment. , 1993, Assistive technology : the official journal of RESNA.

[9]  Focus Group Design and Group Dynamics: Lessons from Deaf and Hard of Hearing Participants , 1999 .

[10]  Thad Starner,et al.  An evaluation of video intelligibility for novice american sign language learners on a mobile device , 2010, ASSETS '10.

[11]  Christian Vogler,et al.  Mixed local and remote participation in teleconferences from a deaf and hard of hearing perspective , 2013, ASSETS.

[12]  Mark P. Orbe.  Constructing Co-Cultural Theory: An Explication of Culture, Power, and Communication , 1997 .

[13]  Jerold L. Hale,et al.  Nonverbal expectancy violations: Model elaboration and application to immediacy behaviors , 1988 .

[14]  Alexis Héloir,et al.  Assessing the deaf user perspective on sign language avatars , 2011, ASSETS.

[15]  Hans-Werner Gellersen,et al.  Personal Projectors for Pervasive Computing , 2012, IEEE Pervasive Computing.

[16]  N. Hartsock.  The Feminist Standpoint: Developing the Ground for a Specifically Feminist Historical Materialism , 2019, The Feminist Standpoint Revisited and Other Essays.

[17]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[18]  Anne Marie Piper,et al.  Supporting medical conversations between deaf and hearing individuals with tabletop displays , 2008, CSCW.

[19]  Albert M. Cook,et al.  Assistive Technologies: Principles and Practice , 1995 .

[20]  Phillipp Meister,et al.  The Explanation Of Social Behaviour , 2016 .

[21]  Richard S. Hallam,et al.  Conversation tactics in persons with normal hearing and hearing-impairment , 2014, International journal of audiology.

[22]  Matt Huenerfauth,et al.  Comparing native signers' perception of American Sign Language animations and videos via eye tracking , 2013, ASSETS.

[23]  Walter S. Lasecki,et al.  A readability evaluation of real-time crowd captions in the classroom , 2012, ASSETS '12.

[24]  Kai Kunze,et al.  Eyewear computers for human-computer interaction , 2016, Interactions.

[25]  Albert M. Cook,et al.  Cook & Hussey's Assistive Technologies Principles and Practice , 2007 .

[26]  H. Giles,et al.  Contexts of Accommodation: Developments in Applied Sociolinguistics , 2010 .

[27]  Jacob O. Wobbrock,et al.  In the shadow of misperception: assistive technology use and social interactions , 2011, CHI.

[28]  John A. Albertini,et al.  Deafness and Hearing Loss , 2010 .

[29]  Vassilis Athitsos,et al.  Sign language recognition using dynamic time warping and hand shape distance based on histogram of oriented gradient features , 2014, PETRA.

[30]  G G Woodworth,et al.  Reported use of communication strategies by SHHH members: client, talker, and situational variables. , 1992, Journal of speech and hearing research.

[31]  Richard E. Ladner,et al.  Analyzing the intelligibility of real-time mobile sign language video transmitted below recommended standards , 2014, ASSETS.

[32]  A. Edwards.  Extra-ordinary human-computer interaction: interfaces for users with disabilities , 1995 .

[33]  J. Klein,et al.  Community participatory research with deaf sign language users to identify health inequities. , 2011, American journal of public health.

[34]  Donna M. Mertens,et al.  Focus Group Design and Group Dynamics: Lessons from Deaf and Hard of Hearing Participants , 1999 .

[35]  Oscar Mauricio Serrano Jaimes,et al.  EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability , 2012 .

[36]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[37]  Thad Starner,et al.  We need to communicate!: helping hearing parents of deaf children learn american sign language , 2011, ASSETS '11.

[38]  M E Demorest,et al.  Scale composition and item analysis of the Communication Profile for the Hearing Impaired. , 1986, Journal of speech and hearing research.

[39]  Raja S. Kushalnagar,et al.  Multiple view perspectives: improving inclusiveness and video compression in mainstream classroom recordings , 2010, ASSETS '10.

[40]  Marti L. Riemer-Reiss,et al.  Factors Associated with Assistive Technology Discontinuance among Individuals with Disabilities , 2000 .

[41]  Harold L. Somers,et al.  HCI for the Deaf community: Developing human-like avatars for sign language synthesis , 2010 .

[42]  Rainer Brück,et al.  A Pilot Study about the Smartwatch as Assistive Device for Deaf People , 2015, ASSETS.

[43]  Luca Chittaro,et al.  Using mobile devices to support communication between emergency medical responders and deaf people , 2010, Mobile HCI.

[44]  Jon Froehlich,et al.  Head-Mounted Display Visualizations to Support Sound Awareness for the Deaf and Hard of Hearing , 2015, CHI.

[45]  Ayan Banerjee,et al.  SCEPTRE: A Pervasive, Non-Invasive, and Programmable Gesture Recognition Technology , 2016, IUI.