Accessible Broadcast Audio Personalisation for Hard of Hearing Listeners

Improvements to the accessibility of broadcast audio for Hard of Hearing listeners is needed. However, an understanding of what constitutes accessible and intelligible audio for this viewer group remains undetermined. This doctoral work begins to address this by investigating and quantifying the relationship between dialogue intelligibility and non-speech broadcast objects, like sound effects. Results from initial work has demonstrated that the inclusion of salient sound effects increases word recognition in noise from 35.8% to 60.7% for normal hearing listeners. When the dialogue is highly predictable, this increases to 73.7%. Preliminary studies with a Hard of Hearing cohort have shown that salient sound effects only improve intelligibility for 50% of Hard of Hearing listeners. This paper also outlines the work planned to complete the doctorate, including an investigation of how these results may be used in intelligent accessible audio solutions based on object-based broadcast methods.

[1]  Nancy Tye-Murray,et al.  Effects of Context Type on Lipreading and Listening Performance and Implications for Sentence Processing. , 2015, Journal of speech, language, and hearing research : JSLHR.

[2]  Jürgen Herre,et al.  MPEG Spatial Audio Object Coding—The ISO/MPEG Standard for Efficient Coding of Interactive Audio Scenes , 2010 .

[3]  Ben Shirley,et al.  Clean Audio for TV broadcast: an object-based approach for hearing impaired viewers , 2015 .

[4]  A. Zekveld,et al.  Cognitive Load During Speech Perception in Noise: The Influence of Age, Hearing Loss, and Cognition on the Pupil Response , 2011, Ear and hearing.

[5]  Nao Hodoshima.  Effects of Urgent Speech and Preceding Sounds on Speech Intelligibility in Noisy and Reverberant Environments , 2016, INTERSPEECH.

[6]  L L Elliott,et al.  Development of a test of speech intelligibility in noise using sentence materials with controlled word predictability. , 1977, The Journal of the Acoustical Society of America.

[7]  Kelly L Watts,et al.  The Revised Speech Perception in Noise Test (R-SPIN) in a multiple signal-to-noise ratio paradigm. , 2012, Journal of the American Academy of Audiology.

[8]  A. R. Carmichael.  Evaluating digital “on-line” background noise suppression: Clarifying television dialogue for older, hard-of-hearing viewers , 2004 .

[9]  Harald Fuchs,et al.  Recent advances in broadcast audio coding , 2013, 2013 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[10]  R. Mayer,et al.  A coherence effect in multimedia learning: The case for minimizing irrelevant sounds in the design of multimedia instructional messages. , 2000 .

[11]  Samantha Sharpe,et al.  Action on hearing loss , 2015 .

[12]  H. Fuchs,et al.  Advanced clean audio solution: dialogue enhancement , 2013 .

[13]  Colin Mathers,et al.  A study of sound balances for the hard of hearing , 1991 .

[14]  James Woodcock,et al.  Personalized Object-Based Audio for Hearing Impaired TV Viewers , 2017 .

[15]  Paul Kendrick,et al.  The clean audio project: Digital TV as assistive technology , 2006 .