The relationship between speech recognition, behavioural listening effort, and subjective ratings

Abstract Objective: The purpose of this study was to evaluate the reliability and validity of four subjective questions related to listening effort. A secondary purpose of this study was to evaluate the effects of hearing aid beamforming microphone arrays on word recognition and listening effort. Design: Participants answered subjective questions immediately following testing in a dual-task paradigm with three microphone settings in a moderately reverberant laboratory environment in two noise configurations. Participants rated their: (1) mental work, (2) desire to improve the situation, (3) tiredness, and (4) desire to give up. Data were analysed using repeated measures and reliability analyses. Study sample: Eighteen adults with symmetrical sensorineural hearing loss participated. Results: Beamforming differentially affected word recognition and listening effort. Analysis revealed the same pattern of results for behavioural listening effort and subjective ratings of desire to improve the situation. Conversely, ratings of work revealed the same pattern of results as word recognition performance. Ratings of tiredness and desire to give up were unaffected by hearing aid microphone or noise configuration. Conclusions: Participant ratings of their desire to control the listening situation appear to reliable subjective indicators of listening effort that align with results from a behavioural measure of listening effort.

[1]  Virginia Best,et al.  An evaluation of the performance of two binaural beamformers in complex and dynamic multitalker environments , 2015, International journal of audiology.

[2]  T. Lunner,et al.  The Ease of Language Understanding (ELU) model: theoretical, empirical, and clinical advances , 2013, Front. Syst. Neurosci..

[3]  Erin M Picou,et al.  How Hearing Aids, Background Noise, and Visual Cues Influence Objective Listening Effort , 2013, Ear and hearing.

[4]  Travis M. Moore,et al.  The Effects of Directional Processing on Objective and Subjective Listening Effort. , 2017, Journal of speech, language, and hearing research : JSLHR.

[5]  Bruce A Schneider,et al.  Comparing the effects of aging and background noise on short-term memory performance. , 2000, Psychology and aging.

[6]  B. Hornsby.  The Effects of Hearing Aid Use on Listening Effort and Mental Fatigue Associated With Sustained Speech Processing Demands , 2013, Ear and hearing.

[7]  S Gatehouse,et al.  Response times to speech stimuli as measures of benefit from amplification. , 1990, British journal of audiology.

[8]  Matthew Rizzo,et al.  Measuring Listening Effort: Driving Simulator Versus Simple Dual-Task Paradigm , 2014, Ear and hearing.

[9]  U. Lemke,et al.  Behavioral Assessment of Listening Effort Using a Dual-Task Paradigm , 2017, Trends in hearing.

[10]  Bruce A. Schneider,et al.  Investigating the Influence of Continuous Babble on Auditory Short-Term Memory Performance , 2008, Quarterly journal of experimental psychology.

[11]  T CAWTHORNE,et al.  Hearing and deafness. , 1961, London Clinic medical journal.

[12]  L. Humes,et al.  Speech-recognition difficulties of the hearing-impaired elderly: the contributions of audibility. , 1990, Journal of speech and hearing research.

[13]  Erin M Picou,et al.  Potential Benefits and Limitations of Three Types of Directional Processing in Hearing Aids , 2014, Ear and hearing.

[14]  Erin M Picou,et al.  An Evaluation of Hearing Aid Beamforming Microphone Arrays in a Noisy Laboratory Setting , 2019, Journal of the American Academy of Audiology.

[15]  D. Streiner.  Starting at the Beginning: An Introduction to Coefficient Alpha and Internal Consistency , 2003, Journal of personality assessment.

[16]  Sridhar Kalluri,et al.  Objective measures of listening effort: effects of background noise and noise reduction. , 2009, Journal of speech, language, and hearing research : JSLHR.

[17]  D D Dirks,et al.  A procedure for quantifying the effects of noise on speech recognition. , 1982, The Journal of speech and hearing disorders.

[18]  F.R.H. Zijlstra,et al.  Efficiency in work behaviour: A design approach for modern tools , 1993 .

[19]  Carol L Mackersie,et al.  Subjective and psychophysiological indexes of listening effort in a competing-talker task. , 2011, Journal of the American Academy of Audiology.

[20]  P. Rabbitt,et al.  Channel-Capacity, Intelligibility and Immediate Memory , 1968, The Quarterly journal of experimental psychology.

[21]  Erin M Picou,et al.  The Effect of Changing the Secondary Task in Dual-Task Paradigms for Measuring Listening Effort , 2014, Ear and hearing.

[22]  R M Cox,et al.  Use of the Connected Speech Test (CST) with hearing-impaired listeners. , 1988, Ear and hearing.

[23]  Hiroshi Sato,et al.  Using listening difficulty ratings of conditions for speech communication in rooms. , 2005, The Journal of the Acoustical Society of America.

[24]  Jean-Pierre Gagné,et al.  Older adults expend more listening effort than young adults recognizing speech in noise. , 2011, Journal of speech, language, and hearing research : JSLHR.

[25]  Giso Grimm,et al.  Multicenter evaluation of signal enhancement algorithms for hearing aids. , 2010, The Journal of the Acoustical Society of America.

[26]  Birger Kollmeier,et al.  Listening effort and speech intelligibility in listening situations affected by noise and reverberation. , 2014, The Journal of the Acoustical Society of America.

[27]  O. J. Dunn.  Multiple Comparisons among Means , 1961 .

[28]  G. Studebaker.  A "rationalized" arcsine transform. , 1985, Journal of speech and hearing research.

[29]  C. Wickens,et al.  Dissociation of Performance and Subjective Measures of Workload , 1988 .

[30]  A. Wingfield,et al.  Hearing Impairment and Cognitive Energy: The Framework for Understanding Effortful Listening (FUEL) , 2016, Ear and hearing.

[31]  Erin M Picou,et al.  The Effects of Noise and Reverberation on Listening Effort in Adults With Normal Hearing , 2016, Ear and hearing.

[32]  D. Kahneman.  Attention and Effort , 1973 .

[33]  Burkhard Maess,et al.  Adverse Listening Conditions and Memory Load Drive a Common Alpha Oscillatory Network , 2012, The Journal of Neuroscience.

[34]  Jamie L Desjardins.  The Effects of Hearing Aid Directional Microphone and Noise Reduction Processing on Listening Effort in Older Adults with Hearing Loss. , 2016, Journal of the American Academy of Audiology.

[35]  A. Zekveld,et al.  Pupil Response as an Indication of Effortful Listening: The Influence of Sentence Intelligibility , 2010, Ear and hearing.

[36]  Gitte Keidser,et al.  NAL-NL2 Empirical Adjustments , 2012, Trends in amplification.

[37]  Quality of life, effort and disturbance perceived in noise: A comparison between employees with aided hearing impairment and normal hearing , 2013, International journal of audiology.

[38]  Arthur Wingfield,et al.  Hearing Loss and Perceptual Effort: Downstream Effects on Older Adults’ Memory for Speech , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[39]  R. Plomp.  A signal-to-noise ratio model for the speech-reception threshold of the hearing impaired. , 1986, Journal of speech and hearing research.

[40]  Ma Sasse,et al.  Straight from the heart: using physiological measurements in the evaluation of multimedia quality , 2001 .

[41]  Erin M Picou,et al.  Increasing motivation changes subjective reports of listening effort and choice of coping strategy , 2014, International journal of audiology.

[42]  A. Zekveld,et al.  Cognitive processing load across a wide range of listening conditions: insights from pupillometry. , 2014, Psychophysiology.

[43]  Candace Bourland Hick,et al.  Listening effort and fatigue in school-age children with and without hearing loss. , 2002, Journal of speech, language, and hearing research : JSLHR.

[44]  Tammo Houtgast,et al.  Occupational performance: Comparing normally-hearing and hearing-impaired employees using the Amsterdam Checklist for Hearing and Work , 2006, International journal of audiology.

[45]  Carol L Mackersie,et al.  Effects of Hearing Loss on Heart Rate Variability and Skin Conductance Measured During Sentence Recognition in Noise , 2015, Ear and hearing.

[46]  Erin M Picou,et al.  Visual cues and listening effort: individual variability. , 2011, Journal of speech, language, and hearing research : JSLHR.

[47]  Arthur Boothroyd,et al.  The performance/intensity function: an underused resource. , 2008, Ear and hearing.