Novel sounds as a psychophysiological measure of listening effort in older listeners with and without hearing loss

OBJECTIVE To investigate whether task-irrelevant novel sounds presented during an auditory task can provide information about the level of listening effort. METHODS Event-related potentials (ERPs) were recorded for novel sounds presented during two Experiments, a frequency discrimination task and a speech-perception-in-noise (SPIN) test, each with varying degrees of task difficulty (easy, medium, hard). Difficulty was adjusted to the individual frequency discrimination threshold and 50% speech recognition signal-to-noise ratio (SNR), respectively. Older listeners (age range 60-86 years) with either normal hearing for their age or a mild-to-moderate hearing loss participated. RESULTS Amplitudes of Novelty P3 and late positive potential (LPP) increased with increasing task difficulty, whereas amplitudes of N1 and N2 decreased. Participants with hearing loss had significantly larger LPP amplitudes in the easy condition of the SPIN test than did normal-hearing listeners. Most correlations between ERP amplitudes and behavioral data were not significant suggesting that listening effort is not a simple equivalent of behavioral performance. CONCLUSIONS LPP amplitude appeared to be the most sensitive component for capturing listening effort reflecting the arousal level of the listener. SIGNIFICANCE ERPs to novel sounds could be easily recorded during hearing tests and provide an objective physiological measure of listening effort, thus supplementing behavioral performance data.

[1]  D. Ruchkin,et al.  Toward a functional categorization of slow waves. , 1988, Psychophysiology.

[2]  E. Donchin,et al.  Performance of concurrent tasks: a psychophysiological analysis of the reciprocity of information-processing resources. , 1983, Science.

[3]  D Friedman,et al.  Age-related changes in scalp topography to novel and target stimuli. , 1993, Psychophysiology.

[4]  S. Hillyard,et al.  Electrical Signs of Selective Attention in the Human Brain , 1973, Science.

[5]  A. Muller-Gass,et al.  The effect of visual task difficulty and attentional direction on the detection of acoustic change as indexed by the Mismatch Negativity , 2006, Brain Research.

[6]  David Friedman,et al.  P300 and slow wave: The effects of reaction time quartile , 1984, Biological Psychology.

[7]  Arthur Wingfield,et al.  Hearing Loss and Perceptual Effort: Downstream Effects on Older Adults’ Memory for Speech , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[8]  R. Knight,et al.  Prefrontal deficits in attention and inhibitory control with aging. , 1997, Cerebral cortex.

[9]  Carles Escera,et al.  When Loading Working Memory Reduces Distraction: Behavioral and Electrophysiological Evidence from an Auditory-Visual Distraction Paradigm , 2008, Journal of Cognitive Neuroscience.

[10]  A. Zekveld,et al.  Pupil Response as an Indication of Effortful Listening: The Influence of Sentence Intelligibility , 2010, Ear and hearing.

[11]  Performance of normally hearing and hearing-impaired listeners using a German version of the SPIN test. , 1994, Scandinavian audiology.

[12]  Erin M Picou,et al.  How Hearing Aids, Background Noise, and Visual Cues Influence Objective Listening Effort , 2013, Ear and hearing.

[13]  Peng Yuan,et al.  The effect of visuospatial attentional load on the processing of irrelevant acoustic distractors , 2006, NeuroImage.

[14]  Sander Nieuwenhuis,et al.  Functional significance of the emotion-related late positive potential , 2012, Front. Hum. Neurosci..

[15]  N. Squires,et al.  Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in man. , 1975, Electroencephalography and clinical neurophysiology.

[16]  M. Tervaniemi,et al.  ‘I love Rock ‘n’ Roll’—Music genre preference modulates brain responses to music , 2013, Biological Psychology.

[17]  Matthew W. Miller,et al.  A novel approach to the physiological measurement of mental workload. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[18]  E. Schröger,et al.  Perceptual and cognitive task difficulty has differential effects on auditory distraction , 2007, Brain Research.

[19]  M. L. Kietzman,et al.  Slow wave and P300 in signal detection. , 1980, Electroencephalography and clinical neurophysiology.

[20]  U. Erdmann,et al.  Auditory probe sensitivity to mental workload changes - an event-related potential study. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[21]  Karen A Doherty,et al.  Age-Related Changes in Listening Effort for Various Types of Masker Noises , 2013, Ear and hearing.

[22]  Brendan Z. Allison,et al.  Workload assessment of computer gaming using a single-stimulus event-related potential paradigm , 2008, Biological Psychology.

[23]  Jean-Pierre Gagné,et al.  Use of a Dual-Task Paradigm to Measure Listening Effort Utilisation d ’ un paradigme de double tâche pour mesurer l ’ attention auditive , 2010 .

[24]  A. Heyman,et al.  The Consortium to Establish a Registry for Alzheimer's Disease (CERAD). Part III. Reliability of a standardized MRI evaluation of Alzheimer's disease , 1992, Neurology.

[25]  Trevor J. Cox,et al.  Event-related potential study to aversive auditory stimuli , 2007, Neuroscience Letters.

[26]  M. Fabiani,et al.  Changes in brain activity patterns in aging: the novelty oddball. , 1995, Psychophysiology.

[27]  David Friedman,et al.  Effect of Sound Familiarity on the Event-Related Potentials Elicited by Novel Environmental Sounds , 1998, Brain and Cognition.

[28]  D. Kahneman Attention and Effort , 1973 .

[29]  J. Smurzyński,et al.  Effects of Age, Age-Related Hearing Loss, and Contralateral Cafeteria Noise on the Discrimination of Small Frequency Changes: Psychoacoustic and Electrophysiological Measures , 2005, Journal of the Association for Research in Otolaryngology.

[30]  A. Wingfield,et al.  Aging, hearing acuity, and the attentional costs of effortful listening. , 2009, Psychology and aging.

[31]  M. Daneman,et al.  How young and old adults listen to and remember speech in noise. , 1995, The Journal of the Acoustical Society of America.

[32]  Stephan Getzmann,et al.  Understanding of spoken language under challenging listening conditions in younger and older listeners: A combined behavioral and electrophysiological study , 2011, Brain Research.

[33]  W Ritter,et al.  A Review of Event‐Related Potential Components Discovered in the Context of Studying P3 a , 1992, Annals of the New York Academy of Sciences.

[34]  C. Peota Novel approach. , 2011, Minnesota medicine.

[35]  Stefanie E. Kuchinsky,et al.  Pupil size varies with word listening and response selection difficulty in older adults with hearing loss. , 2013, Psychophysiology.

[36]  J. Polich,et al.  Stimulus context determines P3a and P3b. , 1998, Psychophysiology.

[37]  Terence W. Picton,et al.  Event-related potentials recorded during the discrimination of improbable stimuli , 1983, Biological Psychology.

[38]  G. Hajcak,et al.  Event-Related Potentials, Emotion, and Emotion Regulation: An Integrative Review , 2010, Developmental neuropsychology.

[39]  Jean-Pierre Gagné,et al.  Older adults expend more listening effort than young adults recognizing speech in noise. , 2011, Journal of speech, language, and hearing research : JSLHR.

[40]  Christopher J. Plack,et al.  Listening effort at signal-to-noise ratios that are typical of the school classroom , 2010, International journal of audiology.

[41]  G. V. Simpson,et al.  ERP amplitude and scalp distribution to target and novel events: effects of temporal order in young, middle-aged and older adults. , 1994, Brain research. Cognitive brain research.

[42]  David Friedman,et al.  The old switcheroo: when target environmental sounds elicit a novelty P3 , 2004, Clinical Neurophysiology.

[43]  F L Wightman,et al.  Resolution of front-back ambiguity in spatial hearing by listener and source movement. , 1999, The Journal of the Acoustical Society of America.

[44]  Wouter De Baene,et al.  Cognitive vs. affective listening modes and judgments of music – An ERP study , 2010, Biological Psychology.

[45]  E. Donchin,et al.  P300 and tracking difficulty: evidence for multiple resources in dual-task performance. , 1980, Psychophysiology.

[46]  A. Monsch,et al.  The cerad neuropsychological assessment battery (Cerad-NAB)—A minimal data set as a common tool for German-speaking Europe , 2000, Neurobiology of Aging.

[47]  T Fernández,et al.  Primary task demands modulate P3a amplitude. , 2000, Brain research. Cognitive brain research.

[48]  B. Hornsby The Effects of Hearing Aid Use on Listening Effort and Mental Fatigue Associated With Sustained Speech Processing Demands , 2013, Ear and hearing.

[49]  D. Friedman,et al.  The novelty P3: an event-related brain potential (ERP) sign of the brain's evaluation of novelty , 2001, Neuroscience & Biobehavioral Reviews.

[50]  N. Lavie Distracted and confused?: Selective attention under load , 2005, Trends in Cognitive Sciences.

[51]  Boaz M Ben-David,et al.  Effects of aging and noise on real-time spoken word recognition: evidence from eye movements. , 2011, Journal of speech, language, and hearing research : JSLHR.

[52]  M. Fabiani,et al.  Naming norms for brief environmental sounds: effects of age and dementia. , 1996, Psychophysiology.

[53]  T. Jacobsen,et al.  Aesthetic judgments of music in experts and laypersons--an ERP study. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[54]  Carryl L. Baldwin,et al.  Impact of sensory acuity on auditory working memory span in young and older adults. , 2011, Psychology and aging.

[55]  C D Wickens,et al.  The Event‐Related Potential as an Index of the Processing Demands of a Complex Target Acquisition Task a , 1984, Annals of the New York Academy of Sciences.

[56]  Stefan Berti,et al.  Examining task-dependencies of different attentional processes as reflected in the P3a and reorienting negativity components of the human event-related brain potential , 2006, Neuroscience Letters.

[57]  Carol L Mackersie,et al.  Subjective and psychophysiological indexes of listening effort in a competing-talker task. , 2011, Journal of the American Academy of Audiology.

[58]  B S Kopell,et al.  Long-latency evoked potentials and reaction time. , 1978, Psychophysiology.

[59]  P. Reuter-Lorenz New visions of the aging mind and brain , 2002, Trends in Cognitive Sciences.

[60]  W. Ritter,et al.  Development of auditory selective attention: event-related potential measures of channel selection and target detection. , 2007, Psychophysiology.

[61]  N. Butters,et al.  The Consortium to Establish a Registry for Alzheimer's Disease (CERAD). Part V. A normative study of the neuropsychological battery , 1994, Neurology.

[62]  Jiang Qiu,et al.  The electrophysiological effect of working memory load on involuntary attention in an auditory–visual distraction paradigm: an ERP study , 2010, Experimental Brain Research.

[63]  R. Mohs,et al.  Consortium to establish a registry for Alzheimer's disease (CERAD) clinical and neuropsychological assessment of Alzheimer's disease. , 2002, Psychopharmacology bulletin.

[64]  Perrine Ruby,et al.  What is the specificity of the response to the own first-name when presented as a novel in a passive oddball paradigm? An ERP study , 2012, Brain Research.

[65]  John Polich,et al.  P3a from auditory white noise stimuli , 2006, Clinical Neurophysiology.

[66]  A. Wingfield,et al.  Language and the aging brain: patterns of neural compensation revealed by functional brain imaging. , 2006, Journal of neurophysiology.

[67]  A. Zekveld,et al.  Cognitive Load During Speech Perception in Noise: The Influence of Age, Hearing Loss, and Cognition on the Pupil Response , 2011, Ear and hearing.

[68]  Darryl G. Humphrey,et al.  Assessment of mental workload with task-irrelevant auditory probes , 1995, Biological Psychology.

[69]  Erich Schröger,et al.  Working memory controls involuntary attention switching: evidence from an auditory distraction paradigm , 2003, The European journal of neuroscience.

[70]  D. Filion,et al.  Aging, selective attention, and inhibitory processes: a psychophysiological approach. , 1992, Psychology and Aging.

[71]  M. Rudner,et al.  Testing Listening Effort for Speech Comprehension Using the Individuals’ Cognitive Spare Capacity , 2011, Audiology research.

[72]  Elena G. Patsenko,et al.  The Quarterly Journal of Experimental Psychology Pupillometry Reveals Processing Load during Spoken Language Comprehension , 2022 .

[73]  Jean-Pierre Gagné,et al.  Evaluating the effort expended to understand speech in noise using a dual-task paradigm: the effects of providing visual speech cues. , 2010, Journal of speech, language, and hearing research : JSLHR.

[74]  Sridhar Kalluri,et al.  Objective measures of listening effort: effects of background noise and noise reduction. , 2009, Journal of speech, language, and hearing research : JSLHR.