Deactivation of Sensory-Specific Cortex by Cross-Modal Stimuli

Visual and auditory cortices traditionally have been considered to be modality-specific. Thus, their activity has been thought to be unchanged by information in other sensory modalities. However, using functional magnetic resonance imaging (fMRI), the present experiments revealed that ongoing activity in the visual cortex could be modulated by auditory information and ongoing activity in the auditory cortex could be modulated by visual information. In both cases, this cross-modal modulation of activity took the form of deactivation. Yet, the deactivation response was not evident in either cortical area during the paired presentation of visual and auditory stimuli. These data suggest that cross-modal inhibitory processes operate within traditional modality-specific cortices and that these processes can be switched on or off in different circumstances.

[1]  W. H. Sumby,et al.  Visual contribution to speech intelligibility in noise , 1954 .

[2]  K Murata,et al.  Neuronal convergence of noxious, acoustic, and visual stimuli in the visual cortex of the cat. , 1965, Journal of neurophysiology.

[3]  G Horn,et al.  The effect of somaesthetic and photic stimuli on the activity of units in the striate cortex of unanaesthetized, unrestrained cats. , 1965, The Journal of physiology.

[4]  D. N. Spinelli,et al.  Auditory specificity in unit recordings from cat's visual cortex. , 1968, Experimental neurology.

[5]  T. Powell,et al.  An anatomical study of converging sensory pathways within the cerebral cortex of the monkey. , 1970, Brain : a journal of neurology.

[6]  FRANK MORRELL,et al.  Visual System's View of Acoustic Space , 1972, Nature.

[7]  C. R. Michael,et al.  Integration of auditory information in the cat's visual cortex. , 1973, Vision research.

[8]  J. L. Davis,et al.  Interactions of the evoked responses to visual, somatic, and auditory stimuli in polysensory areas of the cat cortex. , 1974, Physiology & behavior.

[9]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[10]  D O Frost,et al.  Orderly anomalous retinal projections to the medial geniculate, ventrobasal, and lateral posterior nuclei of the hamster , 1981, The Journal of comparative neurology.

[11]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[12]  M. Sur,et al.  Cross-modal plasticity in cortical development: differentiation and specification of sensory neocortex , 1990, Trends in Neurosciences.

[13]  R. Hari,et al.  Seeing speech: visual information from lip movements modifies activity in the human auditory cortex , 1991, Neuroscience Letters.

[14]  Alan C. Evans,et al.  A Three-Dimensional Statistical Analysis for CBF Activation Studies in Human Brain , 1992, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[15]  A. King,et al.  Multisensory integration. , 1993, Science.

[16]  B. Stein,et al.  The Merging of the Senses , 1993 .

[17]  Karl J. Friston,et al.  Changes in global cerebral blood flow in humans: effect on regional cerebral blood flow during a neural activation task. , 1993, The Journal of physiology.

[18]  Karl J. Friston,et al.  Assessing the significance of focal activations using their spatial extent , 1994, Human brain mapping.

[19]  Leslie G. Ungerleider,et al.  The functional organization of human extrastriate cortex: a PET-rCBF study of selective attention to faces and locations , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  D. Barth,et al.  The spatiotemporal organization of auditory, visual, and auditory-visual evoked potentials in rat cortex , 1995, Brain Research.

[21]  R Kawashima,et al.  Positron-emission tomography studies of cross-modality inhibition in selective attentional tasks: closing the "mind's eye". , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[22]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[23]  B. Stein,et al.  Enhancement of Perceived Visual Intensity by Auditory Stimuli: A Psychophysical Analysis , 1996, Journal of Cognitive Neuroscience.

[24]  M. Corbetta,et al.  Top-down modulation of early sensory cortex. , 1997 .

[25]  E. Bullmore,et al.  Activation of auditory cortex during silent lipreading. , 1997, Science.

[26]  M. Hallett,et al.  Functional relevance of cross-modal plasticity in blind humans , 1997, Nature.

[27]  G. Glover,et al.  Self‐navigated spiral fMRI: Interleaved versus single‐shot , 1998, Magnetic resonance in medicine.

[28]  Leslie G. Ungerleider,et al.  A neural system for human visual working memory. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Karl J. Friston,et al.  Different activation patterns in the visual cortex of late and congenitally blind subjects. , 1998, Brain : a journal of neurology.

[30]  M. D’Esposito,et al.  The Inferential Impact of Global Signal Covariates in Functional Neuroimaging Analyses , 1998, NeuroImage.

[31]  Karl J. Friston,et al.  A multimodal language region in the ventral visual pathway , 1998, Nature.

[32]  C. Spence,et al.  Attention and the crossmodal construction of space , 1998, Trends in Cognitive Sciences.

[33]  M. Giard,et al.  Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study , 1999, Journal of Cognitive Neuroscience.

[34]  J. A. Frost,et al.  Conceptual Processing during the Conscious Resting State: A Functional MRI Study , 1999, Journal of Cognitive Neuroscience.

[35]  E. Bullmore,et al.  Response amplification in sensory-specific cortices during crossmodal binding. , 1999, Neuroreport.

[36]  C. Koch,et al.  Attention activates winner-take-all competition among visual filters , 1999, Nature Neuroscience.

[37]  G. Rees,et al.  Covariation of activity in visual and prefrontal cortex associated with subjective visual perception. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[38]  C. Frith,et al.  Modulation of human visual cortex by crossmodal spatial attention. , 2000, Science.

[39]  M. Hallett,et al.  The relative metabolic demand of inhibition and excitation , 2000, Nature.

[40]  J L Lancaster,et al.  Automated Talairach Atlas labels for functional brain mapping , 2000, Human brain mapping.

[41]  E. DeYoe,et al.  A comparison of visual and auditory motion processing in human cerebral cortex. , 2000, Cerebral cortex.

[42]  R. Campbell,et al.  Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex , 2000, Current Biology.

[43]  西村 洋.  Sign language "heard"in the auditory cortex , 2000 .

[44]  John J. Foxe,et al.  Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. , 2000, Brain research. Cognitive brain research.

[45]  R. Näätänen,et al.  Cross-modal reorganization of human cortical functions , 2000, Trends in Neurosciences.

[46]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[47]  F. Rösler,et al.  Speech processing activates visual cortex in congenitally blind humans , 2002, The European journal of neuroscience.

[48]  Paul J. Laurienti,et al.  Dietary Caffeine Consumption Modulates fMRI Measures , 2002, NeuroImage.

[49]  Isabel Gauthier,et al.  Auditory and Action Semantic Features Activate Sensory-Specific Perceptual Brain Regions , 2003, Current Biology.

[50]  Paul J Laurienti,et al.  The single-epoch fMRI design: validation of a simplified paradigm for the collection of subjective ratings , 2003, NeuroImage.

[51]  Joseph A Maldjian,et al.  Cross‐modal sensory processing in the anterior cingulate and medial prefrontal cortices , 2003, Human brain mapping.

[52]  G. McCarthy,et al.  Faces evoke spatially differentiated patterns of BOLD activation and deactivation , 2003, Neuroreport.

[53]  Emiliano Macaluso,et al.  Multimodal Spatial Representations Engaged in Human Parietal Cortex during Both Saccadic and Manual Spatial Orienting , 2003, Current Biology.

[54]  Joseph A Maldjian,et al.  Separating neural processes using mixed event-related and epoch-based fMRI paradigms , 2003, Journal of Neuroscience Methods.

[55]  A. Diederich,et al.  Multisensory Interaction in Saccadic Reaction Time: A Time-Window-of-Integration Model , 2004, Journal of Cognitive Neuroscience.