The role of speech fidelity in the irrelevant sound effect: Insights from noise-vocoded speech backgrounds

The Irrelevant Sound Effect (ISE) is the finding that background sound impairs accuracy for visually presented serial recall tasks. Among various auditory backgrounds, speech typically acts as the strongest distractor. Based on the changing-state hypothesis, speech is a disruptive background because it is more complex than other nonspeech backgrounds. In the current study, we evaluate an alternative explanation by examining whether the speech-likeness of the background (speech fidelity) contributes, beyond signal complexity, to the ISE. We did this by using noise-vocoded speech as a background. In Experiment 1, we varied the complexity of the background by manipulating the number of vocoding channels. Results indicate that the ISE increases with the number of channels, suggesting that more complex signals produce greater ISEs. In Experiment 2, we varied complexity and speech fidelity independently. At each channel level, we selectively reversed a subset of channels to design a low-fidelity signal that was equated in overall complexity. Experiment 2 results indicated that speech-like noise-vocoded speech produces a larger ISE than selectively reversed noise-vocoded speech. Finally, in Experiment 3, we evaluated the locus of the speech-fidelity effect by assessing the distraction produced by these stimuli in a missing-item task. In this task, even though noise-vocoded speech disrupted task performance relative to silence, neither its complexity nor speech fidelity contributed to this effect. Together, these findings indicate a clear role for speech fidelity of the background beyond its changing-state quality and its attention capture potential.

[1]  P C Loizou,et al.  On the number of channels needed to understand speech. , 1999, The Journal of the Acoustical Society of America.

[2]  G. Rizzolatti,et al.  Speech listening specifically modulates the excitability of tongue muscles: a TMS study , 2002, The European journal of neuroscience.

[3]  A Baddeley,et al.  Phonological similarity and the irrelevant speech effect: Implications for models of short-term verbal memory , 2000, Memory.

[4]  Wolfgang Ellermeier,et al.  The psychoacoustics of the irrelevant sound effect , 2014 .

[5]  Dylan M. Jones,et al.  Disruption of proofreading by irrelevant speech: Effects of attention, arousal or memory? , 1990 .

[6]  Dylan M. Jones,et al.  The phonological store of working memory: is it phonological and is it a store? , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[7]  Dylan M. Jones,et al.  Irrelevant tones produce an irrelevant speech effect : Implications for phonological coding in working memory , 1993 .

[8]  A. Baddeley,et al.  Attention : selection, awareness, and control : a tribute to Donald Broadbent , 1996 .

[9]  Emily M. Elliott,et al.  Distraction in verbal short-term memory: insights from developmental differences , 2016 .

[10]  Bill Macken Auditory distraction and perceptual organization: Streams of unconscious processing. , 2014, PsyCh journal.

[11]  Alan D. Baddeley,et al.  Disruption of short-term memory by unattended speech : Implications for the structure of working memory , 1982 .

[12]  Alan B. Welsh,et al.  Acoustic masking in primary memory. , 1976 .

[13]  A. Buchner,et al.  Artificially induced valence of distractor words increases the effects of irrelevant speech on serial recall , 2006, Memory & cognition.

[14]  Navin Viswanathan,et al.  The Role of Speech-Specific Properties of the Background in the Irrelevant Sound Effect , 2014, Quarterly journal of experimental psychology.

[15]  Dylan M. Jones,et al.  Objects, streams, and threads of auditory attention. , 1993 .

[16]  C. Fowler,et al.  Information for coarticulation: Static signal properties or formant dynamics? , 2014, Journal of experimental psychology. Human perception and performance.

[17]  Wolfgang Ellermeier,et al.  Memory disruption by irrelevant noise-vocoded speech: Effects of native language and the number of frequency bands. , 2015, The Journal of the Acoustical Society of America.

[18]  A. Buchner,et al.  Self-relevance increases the irrelevant sound effect: Attentional disruption by one's own name , 2013 .

[19]  Dylan M. Jones,et al.  Disruption of short-term memory by changing and deviant sounds: support for a duplex-mechanism account of auditory distraction. , 2007, Journal of experimental psychology. Learning, memory, and cognition.

[20]  J. Obleser,et al.  Acoustic Detail But Not Predictability of Task-Irrelevant Speech Disrupts Working Memory , 2016, Front. Hum. Neurosci..

[21]  Alan D. Baddeley,et al.  Effects of Background Music on Phonological Short-Term Memory , 1989 .

[22]  E. Elliott,et al.  Investigating the role of attentional resources in the irrelevant speech effect. , 2012, Acta psychologica.

[23]  Matthew H. Davis,et al.  Lexical information drives perceptual learning of distorted speech: evidence from the comprehension of noise-vocoded sentences. , 2005, Journal of experimental psychology. General.

[24]  R V Shannon,et al.  Speech Recognition with Primarily Temporal Cues , 1995, Science.

[25]  A Baddeley,et al.  Noise, unattended speech and short-term memory. , 1987, Ergonomics.

[26]  Axel Buchner,et al.  Valence of distractor words increases the effects of irrelevant speech on serial recall , 2004, Memory & cognition.

[27]  Hugo Fastl,et al.  Algorithmic modeling of the irrelevant sound effect (ISE) by the hearing sensation fluctuation strength , 2011, Attention, Perception, & Psychophysics.

[28]  D. Pisoni,et al.  Speech perception without traditional speech cues. , 1981, Science.

[29]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[30]  J. Marsh,et al.  The Functional Determinants of Short-Term Memory: Evidence From Perceptual-Motor Interference in Verbal Serial Recall , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[31]  R. Hughes,et al.  Auditory distraction: A duplex-mechanism account. , 2014, PsyCh journal.

[32]  Alastair P. Nicholls,et al.  The irrelevant sound effect: does speech play a special role? , 2000, Journal of experimental psychology. Learning, memory, and cognition.