Exploring Sound Awareness in the Home for People who are Deaf or Hard of Hearing

The home is filled with a rich diversity of sounds from mundane beeps and whirs to dog barks and children's shouts. In this paper, we examine how deaf and hard of hearing (DHH) people think about and relate to sounds in the home, solicit feedback and reactions to initial domestic sound awareness systems, and explore potential concerns. We present findings from two qualitative studies: in Study 1, 12 DHH participants discussed their perceptions of and experiences with sound in the home and provided feedback on initial sound awareness mockups. Informed by Study 1, we designed three tablet-based sound awareness prototypes, which we evaluated with 10 DHH participants using a Wizard-of-Oz approach. Together, our findings suggest a general interest in smarthome-based sound awareness systems particularly for displaying contextually aware, personalized and glanceable visualizations but key concerns arose related to privacy, activity tracking, cognitive overload, and trust.

[1]  Allison Woodruff,et al.  Sabbath day home automation: "it's like mixing technology and religion" , 2007, CHI.

[2]  Rainer Brück,et al.  A Pilot Study about the Smartwatch as Assistive Device for Deaf People , 2015, ASSETS.

[3]  Jon Froehlich,et al.  Head-Mounted Display Visualizations to Support Sound Awareness for the Deaf and Hard of Hearing , 2015, CHI.

[4]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[5]  Ron Wakkary,et al.  Investigating Genres and Perspectives in HCI Research on the Home , 2015, CHI.

[6]  Xin Wang,et al.  UbiEar: Bringing Location-independent Sound Awareness to the Hard-of-hearing People with Smartphones , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[7]  Tara Matthews,et al.  Designing and evaluating glanceable peripheral displays , 2006, DIS '06.

[8]  Harmanpreet Kaur,et al.  Towards More Robust Speech Interactions for Deaf and Hard of Hearing Users , 2018, ASSETS.

[9]  Jon Froehlich,et al.  Deaf and Hard-of-hearing Individuals' Preferences for Wearable and Mobile Sound Awareness Technologies , 2019, CHI.

[10]  Jonathan LaCour.  Amazon Echo Show , 2017 .

[11]  S. Kochkin.  MarkeTrak V: “Why my hearing aids are in the drawer” The consumers' perspective , 2000 .

[12]  Jeffrey P. Bigham,et al.  On How Deaf People Might Use Speech to Control Devices , 2017, ASSETS.

[13]  Heather Fortnum,et al.  Why do people fitted with hearing aids not wear them? , 2013, International journal of audiology.

[14]  Leah Findlater,et al.  "Accessibility Came by Accident": Use of Voice-Controlled Intelligent Personal Assistants by People with Disabilities , 2018, CHI.

[15]  Richard E. Ladner,et al.  Hearing Impairments , 2008, Web Accessibility.

[16]  Richard E. Ladner,et al.  A Personalizable Mobile Sound Detector App Design for Deaf and Hard-of-Hearing Users , 2016, ASSETS.

[17]  Sunny Consolvo,et al.  Living in a glass house: a survey of private moments in the home , 2011, UbiComp '11.

[18]  William Odom,et al.  Designing for Domestic Memorialization and Remembrance: A Field Study of Fenestra in Japan , 2016, CHI.

[19]  Mark W. Newman,et al.  Learning from a learning thermostat: lessons for intelligent systems for the home , 2013, UbiComp.

[20]  Rainer Brück,et al.  Design and evaluation of a smartphone application for non-speech sound awareness for people with hearing loss , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[21]  Eric C. Larson,et al.  The design and evaluation of prototype eco-feedback displays for fixture-level water usage data , 2012, CHI.

[22]  Tara Matthews,et al.  Evaluating non-speech sound visualizations for the deaf , 2006, Behav. Inf. Technol..

[23]  Mari Carmen Domingo,et al.  An overview of the Internet of Things for people with disabilities , 2012, J. Netw. Comput. Appl..

[24]  Eric Paulos,et al.  Home, habits, and energy: examining domestic interactions and energy consumption , 2010, CHI.