HearMeVirtual Reality: Using Virtual Reality to Facilitate Empathy Between Hearing Impaired Children and Their Parents

Cochlear implants (CI) enable hearing in individuals with sensorineural hearing loss, albeit with difficulties in speech perception and sound localization. In noisy environments, these difficulties are disproportionately greater for CI users than for children with no reported hearing loss. Parents of children with CIs are motivated to experience what CIs sound like, but options to do so are limited. This study proposes using virtual reality to simulate having CIs in a school setting with two contrasting settings: a noisy playground and a quiet classroom. To investigate differences between hearing conditions, an evaluation utilized a between-subjects design with 15 parents (10 female, 5 male; age M = 38.5, SD = 6.6) of children with CIs with no reported hearing loss. In the virtual environment, a word recognition and sound localization test using an open-set speech corpus compared differences between simulated unilateral CI, simulated bilateral CI, and normal hearing conditions in both settings. Results of both tests indicate that noise influences word recognition more than it influences sound localization, but ultimately affects both. Furthermore, bilateral CIs are equally to or significantly beneficial over having a simulated unilateral CI in both tests. A follow-up qualitative evaluation showed that the simulation enabled users to achieve a better understanding of what it means to be an hearing impaired child.

[1]  Thomas Lenarz,et al.  Benefits of Bilateral Electrical Stimulation with the Nucleus Cochlear Implant in Adults: 6-Month Postoperative Results , 2004, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[2]  William A. Yost,et al.  Sound Source Localization by Normal-Hearing Listeners, Hearing-Impaired Listeners and Cochlear Implant Listeners , 2016, Audiology and Neurotology.

[3]  Vinciane Despret The Body We Care for: Figures of Anthropo-zoo-genesis , 2004 .

[4]  Gary Kiger,et al.  Disability Simulations: Logical, Methodological and Ethical Issues , 1992 .

[5]  Charles B. Owen,et al.  Review on cybersickness in applications and visual displays , 2016, Virtual Reality.

[6]  E. Truy,et al.  Cochlear implant: On the number of channels , 2018, Modelling, Measurement and Control C.

[7]  J Thomas Roland,et al.  Long-Term Effects of Cochlear Implants in Children , 2002, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[8]  J. Müller,et al.  Speech Understanding in Quiet and Noise in Bilateral Users of the MED-EL COMBI 40/40+ Cochlear Implant System , 2002, Ear and hearing.

[9]  Sun Joo Grace Ahn,et al.  The Effect of Embodied Experiences on Self-Other Merging, Attitude, and Helping Behavior , 2013 .

[10]  H. Bastian Sensation and Perception.—I , 1869, Nature.

[11]  T. Chartrand,et al.  Using Nonconscious Behavioral Mimicry to Create Affiliation and Rapport , 2003, Psychological science.

[12]  Ruth Aylett,et al.  Technology-enhanced role-play for social and emotional learning context - Intercultural empathy , 2011, Entertain. Comput..

[13]  M. Thompson,et al.  Auditory localization of infants as a function of reinforcement conditions. , 1975, The Journal of speech and hearing disorders.

[14]  K. Hopkins Deafness in cochlear and auditory nerve disorders. , 2015, Handbook of clinical neurology.

[15]  A. Snik,et al.  Sound Localization Ability of Young Children With Bilateral Cochlear Implants , 2007, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[16]  R V Shannon,et al.  Speech Recognition with Primarily Temporal Cues , 1995, Science.

[17]  Richard H Wilson,et al.  The Words-in-Noise (WIN) test with multitalker babble and speech-spectrum noise maskers. , 2007, Journal of the American Academy of Audiology.

[18]  Stefan Kerber,et al.  Sound Localization in Noise by Normal-Hearing Listeners and Cochlear Implant Users , 2012, Ear and hearing.

[19]  Robert W. Lindeman,et al.  A SWOT Analysis of the Field of Virtual Reality for Firefighter Training , 2019, Front. Robot. AI.

[20]  Zachary M. Smith,et al.  Re-examining the relationship between number of cochlear implant channels and maximal speech intelligibility. , 2017, The Journal of the Acoustical Society of America.

[21]  D. Sladen,et al.  Cochlear Implantation in Children 12 Months of Age and Younger , 2013, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[22]  Harrison Si,et al.  Handbook of Research Methods in Social and Personality Psychology: Author Index , 2013 .

[23]  Meredith Ringel Morris,et al.  Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation , 2018, CHI.

[24]  Piotr Majdak,et al.  Effects of upper-frequency boundary and spectral warping on speech intelligibility in electrical stimulation. , 2008, The Journal of the Acoustical Society of America.

[25]  Daniel Casasanto,et al.  When Does Virtual Embodiment Change Our Minds? , 2016, PRESENCE: Teleoperators and Virtual Environments.

[26]  Torsten Dau,et al.  A Danish open-set speech corpus for competing-speech studies. , 2014, The Journal of the Acoustical Society of America.

[27]  Andrej Kral,et al.  Brain plasticity under cochlear implant stimulation. , 2006, Advances in oto-rhino-laryngology.

[28]  Sequential bilateral cochlear implantation in children , 2004 .

[29]  N Marangos,et al.  COCHLEAR IMPLANTS , 1976, The Lancet.

[30]  Jeremy N. Bailenson,et al.  How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence , 2016 .

[31]  A. Geers,et al.  Estimating the influence of cochlear implantation on language development in children , 2007, Audiological medicine.

[32]  James D. Ivory,et al.  The Virtual Doppelganger: Effects of a Virtual Reality Simulator on Perceptions of Schizophrenia , 2010, The Journal of nervous and mental disease.

[33]  G. Hickok,et al.  The human auditory system : fundamental organization and clinical disorders , 2015 .

[34]  M. Kompis,et al.  Minimum Audible Angle, Just Noticeable Interaural Differences and Speech Intelligibility with Bilateral Cochlear Implants Using Clinical Speech Processors , 2005, Audiology and Neurotology.

[35]  Meredith Ringel Morris,et al.  SeeingVR: A Set of Tools to Make Virtual Reality More Accessible to People with Low Vision , 2019, CHI.

[36]  Stefania Serafin,et al.  Immersion revisited: A review of existing definitions of immersion and their relation to different theories of presence , 2016 .

[37]  P Nopp,et al.  Sound Localization and Sensitivity to Interaural Cues in Bilateral Users of the Med-El Combi 40/40+Cochlear Implant System , 2005, Otology and Neurotology.

[38]  R. Mayer,et al.  Cognitive Principles of Multimedia Learning: The Role of Modality and Contiguity , 1999 .

[39]  Jeremy N. Bailenson,et al.  The Proteus Effect , 2009, Commun. Res..

[40]  W. T. Nelson,et al.  A speech corpus for multitalker communications research. , 2000, The Journal of the Acoustical Society of America.

[41]  L. Kishon-Rabin,et al.  Listening in Noise Remains a Significant Challenge for Cochlear Implant Users: Evidence from Early Deafened and Those with Progressive Hearing Loss Compared to Peers with Normal Hearing , 2020, Journal of clinical medicine.

[42]  Fan-Gang Zeng,et al.  Cochlear implant speech recognition with speech maskers. , 2004, The Journal of the Acoustical Society of America.

[43]  J. S. Anderson Development of the hearing , 1910 .

[44]  Mel Slater,et al.  The Sense of Embodiment in Virtual Reality , 2012, PRESENCE: Teleoperators and Virtual Environments.

[45]  Gavin Kearney,et al.  An HRTF Database for Virtual Loudspeaker Rendering , 2015 .

[46]  S. Soli,et al.  Development of the Hearing in Noise Test for the measurement of speech reception thresholds in quiet and in noise. , 1994, The Journal of the Acoustical Society of America.

[47]  Daniela Karin Rosner,et al.  The Promise of Empathy: Design, Disability, and Knowing the "Other" , 2019, CHI.

[48]  Qian-Jie Fu,et al.  Noise Susceptibility of Cochlear Implant Users: The Role of Spectral Resolution and Smearing , 2005, Journal of the Association for Research in Otolaryngology.

[49]  Thomas Lenarz,et al.  Binaural speech unmasking and localization in noise with bilateral cochlear implants using envelope and fine-timing based strategies. , 2008, The Journal of the Acoustical Society of America.

[50]  Emma Brunskill,et al.  Global and regional hearing impairment prevalence: an analysis of 42 studies in 29 countries. , 2013, European journal of public health.

[51]  Gnau Fb,et al.  Cochlear implant. , 1985, ASHA.

[52]  Béatrice S. Hasler,et al.  Virtual race transformation reverses racial in-group bias , 2017, PloS one.

[53]  Emma Brunskill,et al.  Global and regional hearing impairment prevalence , 2012 .

[54]  Richard Ramsden,et al.  Evaluation of Bilaterally Implanted Adult Subjects with the Nucleus 24 Cochlear Implant System , 2005, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[55]  M. Lutman,et al.  Auditory Localization Abilities in Bilateral Cochlear Implant Recipients , 2005, Otology & neurotology : official publication of the American Otological Society, American Neurotology Society [and] European Academy of Otology and Neurotology.

[56]  T. Parsons Virtual Reality for Enhanced Ecological Validity and Experimental Control in the Clinical, Affective and Social Neurosciences , 2015, Front. Hum. Neurosci..

[57]  Peter C. Wright,et al.  Empathy and experience in HCI , 2008, CHI.

[58]  Ruth Y Litovsky,et al.  Benefits of bilateral cochlear implants and/or hearing aids in children , 2006, International journal of audiology.

[59]  Ben A. M. Schouten,et al.  The Curious Case of the Transdiegetic Cow, or a Mission to Foster Other-Oriented Empathy Through Virtual Reality , 2020, CHI.

[60]  Employing Disability Simulations and Virtual Reality Technology to Foster Cognitive and Affective Empathy Towards Individuals With Disabilities , 2019 .

[61]  John A. Albertini,et al.  Deafness and Hearing Loss , 2010 .

[62]  M. Brewer,et al.  Research Design and Issues of Validity , 2000 .

[63]  Gerard Jounghyun Kim,et al.  A SWOT Analysis of the Field of Virtual Reality Rehabilitation and Therapy , 2005, Presence: Teleoperators & Virtual Environments.