A role for the inferior colliculus in multisensory speech integration

Multisensory integration can occur at relatively low levels within the central nervous system. Recent evidence suggests that multisensory audio-visual integration for speech may have a subcortical component, as acoustic processing in the human brainstem is influenced by lipreading during speech perception. Here, stimuli depicting the McGurk illusion (a demonstration of auditory–visual integration using speech stimuli) were presented to a 12-year-old child (FX) with a circumscribed unilateral lesion of the right inferior colliculus. When McGurk-type stimuli were presented in the contralesional hemifield, illusory perception reflecting bimodal integration was significantly reduced compared with the ipsilesional hemifield and a group of age-matched controls. These data suggest a functional role for the inferior colliculus in the audio-visual integration of speech stimuli.

[1]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[2]  H. McGurk,et al.  Visual influences on speech perception processes , 1978, Perception & psychophysics.

[3]  G. W. Hoesen,et al.  Retinal innervation of the inferior colliculus in rat and monkey , 1982, Brain Research.

[4]  B. Stein,et al.  Interactions among converging sensory inputs in the superior colliculus. , 1983, Science.

[5]  The Inferior Colliculus , 1986 .

[6]  G. Mascetti,et al.  Visual cells in the inferior colliculus of the cat , 1988, Brain Research.

[7]  G. Ettlinger,et al.  Cross-modal performance: behavioural processes, phylogenetic considerations and neural mechanisms , 1990, Behavioural Brain Research.

[8]  Projections to the inferior colliculus from the dorsal column nuclei. An experimental electron microscopic study in the cat. , 1992, Journal fur Hirnforschung.

[9]  N. Soroker,et al.  “McGurk illusion” to bilateral administration of sensory stimuli in patients with hemispatial neglect , 1995, Neuropsychologia.

[10]  D. Massaro.  Perceiving talking faces: from speech perception to a behavioral principle , 1999 .

[11]  S Kuwada,et al.  Simultaneous anterograde labeling of axonal layers from lateral superior olive and dorsal cochlear nucleus in the inferior colliculus of cat , 1997, The Journal of comparative neurology.

[12]  M A Schmuckler,et al.  The McGurk effect in infants. , 1995, Perception & psychophysics.

[13]  Mark S. Cohen,et al.  Spatiotopic Organization in Human Superior Colliculus Observed with fMRI , 2000, NeuroImage.

[14]  S. Iversen,et al.  Detection of Audio-Visual Integration Sites in Humans by Application of Electrophysiological Criteria to the BOLD Effect , 2001, NeuroImage.

[15]  S. Inati,et al.  Eye Position Influences Auditory Responses in Primate Inferior Colliculus , 2001, Neuron.

[16]  John J. Foxe,et al.  Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. , 2002, Brain research. Cognitive brain research.

[17]  R. Litovsky,et al.  Functional role of the human inferior colliculus in binaural hearing , 2002, Hearing Research.

[18]  R. Wickesberg,et al.  Ascending Pathways Through Ventral Nuclei of the Lateral Lemniscus and Their Possible Role in Pattern Recognition in Natural Sounds , 2002 .

[19]  Wan Jiang,et al.  Cortex controls multisensory depression in superior colliculus. , 2003, Journal of neurophysiology.

[20]  M. Crommelinck,et al.  When audition alters vision: an event-related potential study of the cross-modal interactions between faces and voices , 2004, Neuroscience Letters.

[21]  John J. Foxe,et al.  The case for feedforward multisensory convergence during early cortical processing , 2005, Neuroreport.

[22]  John J. Foxe,et al.  Multisensory contributions to low-level, ‘unisensory’ processing , 2005, Current Opinion in Neurobiology.

[23]  Mikko Sams,et al.  Seeing speech affects acoustic information processing in the human brainstem , 2005, Experimental Brain Research.

[24]  Geraint Rees,et al.  Sound alters activity in human V1 in association with illusory visual perception , 2006, NeuroImage.