Neural mechanisms for illusory filling-in of degraded speech

The brain uses context and prior knowledge to repair degraded sensory inputs and improve perception. For example, listeners hear speech continuing uninterrupted through brief noises, even if the speech signal is artificially removed from the noisy epochs. In a functional MRI study, we show that this temporal filling-in process is based on two dissociable neural mechanisms: the subjective experience of illusory continuity, and the sensory repair mechanisms that support it. Areas mediating illusory continuity include the left posterior angular gyrus (AG) and superior temporal sulcus (STS) and the right STS. Unconscious sensory repair occurs in Broca's area, bilateral anterior insula, and pre-supplementary motor area. The left AG/STS and all the repair regions show evidence for word-level template matching and communicate more when fewer acoustic cues are available. These results support a two-path process where the brain creates coherent perceptual objects by applying prior knowledge and filling-in corrupted sensory information.

[1]  Peter De Weerd,et al.  Perceptual filling-in: More than the eye can see. , 2006, Progress in brain research.

[2]  Angela D. Friederici,et al.  Phonemic restoration in a sentence context: Evidence from early and late ERP effects , 2006, Brain Research.

[3]  Doris-Eva Bamiou,et al.  The insula (Island of Reil) and its role in auditory processing Literature review , 2003, Brain Research Reviews.

[4]  R. Goebel,et al.  Hearing Illusory Sounds in Noise: Sensory-Perceptual Transformations in Primary Auditory Cortex , 2007, The Journal of Neuroscience.

[5]  B. Horwitz,et al.  Functional connectivity of the angular gyrus in normal reading and dyslexia. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[6]  R. M. Warren Perceptual Restoration of Missing Speech Sounds , 1970, Science.

[7]  Antonio Ulloa,et al.  Investigating the Neural Basis of the Auditory Continuity Illusion , 2005, Journal of Cognitive Neuroscience.

[8]  S. Blumstein,et al.  The Role of Segmentation in Phonological Processing: An fMRI Investigation , 2000, Journal of Cognitive Neuroscience.

[9]  Jeffrey R Binder,et al.  Human brain regions involved in recognizing environmental sounds. , 2004, Cerebral cortex.

[10]  Y. Sugita Neuronal correlates of auditory induction in the cat cortex , 1997, Neuroreport.

[11]  E. T. Possing,et al.  Neural Correlates of Lexical Access during Visual Word Recognition , 2003, Journal of Cognitive Neuroscience.

[12]  Ingrid S. Johnsrude,et al.  Illusory Vowels Resulting from Perceptual Continuity: A Functional Magnetic Resonance Imaging Study , 2008, Journal of Cognitive Neuroscience.

[13]  Ling Qin,et al.  Comparison between offset and onset responses of primary auditory cortex ON-OFF neurons in awake cats. , 2007, Journal of neurophysiology.

[14]  Cory T. Miller,et al.  Amodal completion of acoustic signals by a nonhuman primate , 2001, Nature Neuroscience.

[15]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[16]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[17]  Matthew H. Davis,et al.  Hierarchical Processing in Spoken Language Comprehension , 2003, The Journal of Neuroscience.

[18]  Stefan Koelsch,et al.  Cognitive priming in sung and instrumental music: Activation of inferior frontal cortex , 2006, NeuroImage.

[19]  C. Price,et al.  Speech-specific auditory processing: where is it? , 2005, Trends in Cognitive Sciences.

[20]  D Bavelier,et al.  Cerebral organization for language in deaf and hearing subjects: biological constraints and effects of experience. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[21]  B. Horwitz,et al.  Phonological and orthographic components of word recognition. A PET-rCBF study. , 1997, Brain : a journal of neurology.

[22]  B H Repp,et al.  Perceptual restoration of a “missing” speech sound: Auditory induction or illusion? , 1992, Perception & psychophysics.

[23]  Lutz Jäncke,et al.  The Neural Correlate of Speech Rhythm as Evidenced by Metrical Speech Processing , 2008, Journal of Cognitive Neuroscience.

[24]  A S Bregman,et al.  Is a common grouping mechanism involved in the phenomena of illusory continuity and stream segregation? , 1999, Perception & psychophysics.

[25]  P. Weerd Perceptual filling-in: More than the eye can see. , 2006 .

[26]  David A. Medler,et al.  Neural correlates of sensory and decision processes in auditory object identification , 2004, Nature Neuroscience.

[27]  Kathryn M. McMillan,et al.  N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studies , 2005, Human brain mapping.

[28]  Brian C J Moore,et al.  Auditory processing of real and illusory changes in frequency modulation (FM) phase. , 2004, The Journal of the Acoustical Society of America.

[29]  Michael S Vitevitch,et al.  A Web-based interface to calculate phonotactic probability for words and nonwords in English , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[30]  Eveline Geiser,et al.  Segmental processing in the human auditory dorsal stream , 2008, Brain Research.

[31]  Norbert Kathmann,et al.  Neural correlates of error awareness , 2007, NeuroImage.

[32]  S. Scott,et al.  The neuroanatomical and functional organization of speech perception , 2003, Trends in Neurosciences.

[33]  John J. Foxe,et al.  Neural mechanisms involved in error processing: A comparison of errors made with and without awareness , 2005, NeuroImage.

[34]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[35]  Frank H. Guenther,et al.  An fMRI investigation of syllable sequence production , 2006, NeuroImage.

[36]  R. F. Braaten,et al.  Temporal Induction of Missing Birdsong Segments in European Starlings , 1999 .

[37]  M. Wertheimer Max Wertheimer and Gestalt Theory , 2004 .

[38]  Adam Gazzaley,et al.  Measuring functional connectivity during distinct stages of a cognitive task , 2004, NeuroImage.

[39]  R. P. Carlyon,et al.  Dynamic aspects of the continuity illusion: Perception of level and of the depth, rate, and phase of modulation , 2005, Hearing Research.

[40]  Vinod Menon,et al.  Functional connectivity in the resting brain: A network analysis of the default mode hypothesis , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Alan C. Evans,et al.  Lateralization of phonetic and pitch discrimination in speech processing. , 1992, Science.

[42]  Thomas E. Nichols,et al.  Optimization of experimental design in fMRI: a general framework using a genetic algorithm , 2003, NeuroImage.

[43]  K. O’Connor,et al.  Encoding of Illusory Continuity in Primary Auditory Cortex , 2007, Neuron.

[44]  R. L. Gregory,et al.  Perceptual filling in of artificially induced scotomas in human vision , 1991, Nature.

[45]  A. Samuel Phonemic restoration: insights from a new methodology. , 1981, Journal of experimental psychology. General.

[46]  Barbara G Shinn-Cunningham,et al.  Influences of auditory object formation on phonemic restoration. , 2008, The Journal of the Acoustical Society of America.

[47]  Colin Phillips,et al.  The influence of meaning on the perception of speech sounds. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[48]  S. Scott,et al.  Behavioral/systems/cognitive Functional Integration across Brain Regions Improves Speech Perception under Adverse Listening Conditions , 2022 .

[49]  Frank Tong,et al.  Filling-in of visual phantoms in the human brain , 2005, Nature Neuroscience.

[50]  C. Micheyl,et al.  The Neurophysiological Basis of the Auditory Continuity Illusion: A Mismatch Negativity Study , 2003 .

[51]  R. M. Warren,et al.  Illusory continuity of interrupted speech: speech rate determines durational limits. , 1988, The Journal of the Acoustical Society of America.

[52]  H. Komatsu The neural mechanisms of perceptual filling-in , 2006, Nature Reviews Neuroscience.

[53]  J A Bashford,et al.  Use of speech-modulated noise adds strong “bottom-up” cues for phonemic restoration , 1996, Perception & psychophysics.

[54]  S. Bookheimer Functional MRI of language: new approaches to understanding the cortical organization of semantic processing. , 2002, Annual review of neuroscience.

[55]  K. O’Connor,et al.  Illusory Sound Perception in Macaque Monkeys , 2003, The Journal of Neuroscience.