Assessing listening effort by measuring short-term memory storage and processing of speech in noise

Abstract Objective The aim of this study was to investigate the effect of working memory capacity (WMC) and updating ability (UA) on listening effort measured using a new test, the Auditory Inference Span Test (AIST), as an objective measure of listening effort. Design The AIST is based on Swedish five-word sentences and taps into three memory load levels (MLLs). It was administered in stationary speech-shaped noise at −2, −4, and −6 dB signal-to-noise ratio (SNR). WMC was assessed using the reading span test, and UA was assessed using the letter memory test. We also collected data on speech-in-noise performance and subjectively rated listening effort at the three SNRs. Study sample Thirty-nine participants with normal hearing thresholds (≤20 dB HL for 250 to 4000 Hz) took part in the study. Results AIST performance decreased with increasing MLL and was related to WMC and UA. Participants with high WMC performed better than those with low WMC at more favorable SNRs. Participants with high UA performed better than participants with low UA at the intermediate MLL, which made particular demands on the UA. Neither speech recognition scores nor subjectively rated listening effort was associated with AIST performance or either of the cognitive variables. Conclusion AIST taps into cognitive functions necessary for understanding speech in noise. However, in its current form AIST may be too cognitively taxing to successfully measure graded listening effort in participants with lower cognitive capacity.

[1]  Thomas Lunner,et al.  Seeing the talker’s face supports executive processing of speech in steady state noise , 2013, Front. Syst. Neurosci..

[2]  Thomas Lunner,et al.  Relationships between self-report and cognitive measures of hearing aid outcome , 2013, Speech, language and hearing.

[3]  Thomas Lunner,et al.  Cognitive Spare Capacity as a Window on Hearing Aid Benefit , 2013, Seminars in Hearing.

[4]  T. Lunner,et al.  Visual information can hinder working memory processing of speech. , 2013, Journal of speech, language, and hearing research : JSLHR.

[5]  T. Lunner,et al.  The Ease of Language Understanding (ELU) model: theoretical, empirical, and clinical advances , 2013, Front. Syst. Neurosci..

[6]  Thomas Lunner,et al.  Effects of noise and working memory capacity on memory processing of speech for hearing-aid users , 2013, International journal of audiology.

[7]  Joost M Festen,et al.  How Linguistic Closure and Verbal Working Memory Relate to Speech Recognition in Noise—A Review , 2013, Trends in amplification.

[8]  T. Lunner,et al.  Working memory capacity may influence perceived effort during aided speech recognition in noise. , 2012, Journal of the American Academy of Audiology.

[9]  Ingrid S. Johnsrude,et al.  Behavioral and fMRI evidence that cognitive ability modulates the effect of semantic context on speech intelligibility , 2012, Brain and Language.

[10]  Jerker Rönnberg,et al.  The Influence of Semantically Related and Unrelated Text Cues on the Intelligibility of Sentences in Noise , 2011, Ear and hearing.

[11]  Jean-Pierre Gagné,et al.  Older adults expend more listening effort than young adults recognizing speech in noise. , 2011, Journal of speech, language, and hearing research : JSLHR.

[12]  T. Lunner,et al.  Cognitive Hearing Science , 2011, Trends in amplification.

[13]  M. Rudner,et al.  Testing Listening Effort for Speech Comprehension Using the Individuals’ Cognitive Spare Capacity , 2011, Audiology research.

[14]  B.A. Schneider,et al.  How Age Affects Auditory-Cognitive Interactions in Speech Comprehension , 2011, Audiology research.

[15]  Thomas Lunner,et al.  Working memory supports listening in noise for persons with hearing impairment. , 2011, Journal of the American Academy of Audiology.

[16]  Thomas Lunner,et al.  When cognition kicks in: working memory and speech understanding in noise. , 2010, Noise & health.

[17]  A. Zekveld,et al.  Pupil Response as an Indication of Effortful Listening: The Influence of Sentence Intelligibility , 2010, Ear and hearing.

[18]  Jean-Pierre Gagné,et al.  Evaluating the effort expended to understand speech in noise using a dual-task paradigm: the effects of providing visual speech cues. , 2010, Journal of speech, language, and hearing research : JSLHR.

[19]  T. Lunner,et al.  Speech understanding and cognitive spare capacity , 2009 .

[20]  T. Lunner,et al.  Cognition and aided speech recognition in noise: specific role for cognitive factors following nine-week experience with adjusted compression settings in hearing aids. , 2009, Scandinavian journal of psychology.

[21]  Stefan Stenfelt,et al.  The signal-cognition interface: interactions between degraded auditory signals and cognitive processes. , 2009, Scandinavian journal of psychology.

[22]  Thomas Lunner,et al.  Cognition and hearing aids. , 2009, Scandinavian journal of psychology.

[23]  Sridhar Kalluri,et al.  Objective measures of listening effort: effects of background noise and noise reduction. , 2009, Journal of speech, language, and hearing research : JSLHR.

[24]  A. Wingfield,et al.  Aging, hearing acuity, and the attentional costs of effortful listening. , 2009, Psychology and aging.

[25]  Tammo Houtgast,et al.  The Influence of Age, Hearing, and Working Memory on the Speech Comprehension Benefit Derived from an Automatic Speech Recognition System , 2009, Ear and hearing.

[26]  M. Akeroyd Are individual differences in speech reception related to individual differences in cognitive ability? A survey of twenty experimental studies with normal and hearing-impaired adults , 2008, International journal of audiology.

[27]  T. Lunner,et al.  Cognition counts: A working memory system for ease of language understanding (ELU) , 2008, International journal of audiology.

[28]  R. Engle,et al.  On the division of short-term and working memory: an examination of simple and complex span and their relation to higher order abilities. , 2007, Psychological bulletin.

[29]  Thomas Lunner,et al.  Interactions between cognition, compression, and listening conditions: effects on speech-in-noise performance in a two-channel hearing aid. , 2007, Journal of the American Academy of Audiology.

[30]  Thomas Lunner,et al.  Recognition of speech in noise with new hearing instrument compression release settings requires explicit cognitive storage and processing capacity. , 2007, Journal of the American Academy of Audiology.

[31]  Brent Edwards,et al.  The Future of Hearing Aid Technology , 2007, Trends in amplification.

[32]  Gurjit Singh,et al.  Effects of Age on Auditory and Cognitive Processing: Implications for Hearing Aid Fitting and Audiologic Rehabilitation , 2006, Trends in amplification.

[33]  Birgitta Larsby,et al.  A Swedish version of the Hearing In Noise Test (HINT) for measurement of speech recognition , 2006, International journal of audiology.

[34]  L Hickson,et al.  Candidature for and delivery of audiological services: special needs of older people , 2003, International journal of audiology.

[35]  Thomas Lunner,et al.  Cognitive function in relation to hearing aid use , 2003, International journal of audiology.

[36]  Graham Naylor,et al.  Benefits from hearing aids in relation to the interaction between the user and the environment , 2003, International journal of audiology.

[37]  Candace Bourland Hick,et al.  Listening effort and fatigue in school-age children with and without hearing loss. , 2002, Journal of speech, language, and hearing research : JSLHR.

[38]  A. Baddeley The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[39]  M. J. Emerson,et al.  The Unity and Diversity of Executive Functions and Their Contributions to Complex “Frontal Lobe” Tasks: A Latent Variable Analysis , 2000, Cognitive Psychology.

[40]  P F Seitz,et al.  Assessing the Cognitive Demands of Speech Listening for People with Hearing Losses , 1996, Ear and hearing.

[41]  S Gatehouse,et al.  Response times to speech stimuli as measures of benefit from amplification. , 1990, British Journal of Audiology.

[42]  S. Arlinger,et al.  Visual evoked potentials: relation to adult speechreading and cognitive function. , 1989, Journal of speech and hearing research.

[43]  D. Downs Effects of hearing and use on speech discrimination and listening effort. , 1982, Journal of Speech and Hearing Disorders.

[44]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .

[45]  John P. Gilbert,et al.  Statistical Power Analysis for the Behavioral Sciences. Jacob Cohen. Academic Press, New York, 1969. xvi + 416 pp. $13.50 , 1970 .

[46]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[47]  P. Rabbitt,et al.  Channel-Capacity, Intelligibility and Immediate Memory , 1968, The Quarterly journal of experimental psychology.

[48]  T. Lunner,et al.  Improved cognitive processing of speech for hearing aid users with noise reduction , 2011 .

[49]  M. Rudner Cognitive spare capacity as a measure of listening effort , 2011 .

[50]  T. Lunner,et al.  Cognitive Hearing Science : The lagacy of Stuart Gatehouse , 2010 .

[51]  Birgitta Larsby,et al.  Cognitive performance and perceived effort in speech processing tasks: effects of different noise backgrounds in normal-hearing and hearing-impaired subjects. , 2005, International journal of audiology.

[52]  Kirsten Carola Wagener,et al.  Factors influencing sentence intelligibility in noise , 2004 .

[53]  B Hagerman,et al.  Efficient adaptive methods for measuring speech reception threshold in quiet and in noise. , 1995, Scandinavian audiology.

[54]  M. Daneman,et al.  How young and old adults listen to and remember speech in noise. , 1995, The Journal of the Acoustical Society of America.

[55]  P. Rabbitt Mild hearing loss can cause apparent memory failures which increase with age and reduce with IQ. , 1990, Acta oto-laryngologica. Supplementum.

[56]  B Hagerman,et al.  Sentences for testing speech intelligibility in noise. , 1982, Scandinavian audiology.