Change-driven cortical activation in multisensory environments: An MEG study

The quick detection of dynamic changes in multisensory environments is essential to survive dangerous events and orient attention to informative events. Previous studies have identified multimodal cortical areas activated by changes of visual, auditory, and tactile stimuli. In the present study, we used magnetoencephalography (MEG) to examine time-varying cortical processes responsive to unexpected unimodal changes during continuous multisensory stimulation. The results showed that there were change-driven cortical responses in multimodal areas, such as the temporo-parietal junction and middle and inferior frontal gyri, regardless of the sensory modalities where the change occurred. These multimodal activations accompanied unimodal activations, both of which in general had some peaks within 300 ms after the changes. Thus, neural processes responsive to unimodal changes in the multisensory environment are distributed at different timing in these cortical areas.

[1]  Koji Inui,et al.  Somatosensory off-response in humans: An MEG study , 2009, NeuroImage.

[2]  Koji Inui,et al.  Somatosensory off-response in humans: an ERP study , 2008, Experimental Brain Research.

[3]  T. Powell,et al.  An anatomical study of converging sensory pathways within the cerebral cortex of the monkey. , 1970, Brain : a journal of neurology.

[4]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[5]  L. Benevento,et al.  Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey , 1977, Experimental Neurology.

[6]  R Kakigi,et al.  A comparative magnetoencephalographic study of cortical activations evoked by noxious and innocuous somatosensory stimulations , 2003, Neuroscience.

[7]  J. Mäkelä,et al.  Whole-head mapping of middle-latency auditory evoked magnetic fields. , 1994, Electroencephalography and clinical neurophysiology.

[8]  M. Mesulam.  Spatial attention and neglect: parietal, frontal and cingulate contributions to the mental representation and attentional targeting of salient extrapersonal events. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[9]  T. Allison,et al.  Human extrastriate visual cortex and the perception of faces, words, numbers, and colors. , 1994, Cerebral cortex.

[10]  E. Miller,et al.  THE PREFRONTAL CORTEX AND COGNITIVE CONTROL , 2000 .

[11]  N. Kanwisher,et al.  Visual attention: Insights from brain imaging , 2000, Nature Reviews Neuroscience.

[12]  Harold Burton,et al.  Second somatosensory cortical area in macaque monkeys. I. Neuronal responses to controlled, punctate indentations of glabrous skin on the hand , 1990, Brain Research.

[13]  Aina Puce,et al.  Category-sensitive excitatory and inhibitory processes in human extrastriate cortex. , 2002, Journal of neurophysiology.

[14]  G. Baylis,et al.  Shape-coding in IT cells generalizes over contrast and mirror reversal, but not figure-ground reversal , 2001, Nature Neuroscience.

[15]  P. Chauvel,et al.  Localization of the primary auditory area in man. , 1991, Brain : a journal of neurology.

[16]  C. Frith,et al.  Modulation of human visual cortex by crossmodal spatial attention. , 2000, Science.

[17]  B. Argall,et al.  Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus , 2004, Neuron.

[18]  J. Mäkelä,et al.  Human auditory cortical mechanisms of sound lateralisation: III. Monaural and binaural shift responses , 1994, Hearing Research.

[19]  J. Downar,et al.  A cortical network sensitive to stimulus salience in a neutral behavioral context across multiple sensory modalities. , 2002, Journal of neurophysiology.

[20]  T. Elbert,et al.  Specific tonotopic organizations of different areas of the human auditory cortex revealed by simultaneous magnetic and electric recordings. , 1995, Electroencephalography and clinical neurophysiology.

[21]  Keiji Tanaka.  Columns for complex visual object features in the inferotemporal cortex: clustering of cells with similar but slightly different stimulus selectivities. , 2003, Cerebral cortex.

[22]  J. Mäkelä,et al.  Neuromagnetic responses of the human auditory cortex to on- and offsets of noise bursts. , 1987, Audiology : official organ of the International Society of Audiology.

[23]  R Hari,et al.  Cerebral magnetic responses to noise bursts and pauses of different durations. , 1989, Audiology : official organ of the International Society of Audiology.

[24]  H. Scheich,et al.  Nonauditory Events of a Behavioral Procedure Activate Auditory Cortex of Highly Trained Monkeys , 2005, The Journal of Neuroscience.

[25]  R. Desimone,et al.  Visual areas in the temporal cortex of the macaque , 1979, Brain Research.

[26]  E. Rolls,et al.  Functional subdivisions of the temporal lobe neocortex , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  Keiji Tanaka,et al.  Polysensory properties of neurons in the anterior bank of the caudal superior temporal sulcus of the macaque monkey. , 1988, Journal of neurophysiology.

[28]  M. Mishkin,et al.  Functional Mapping of the Primate Auditory System , 2003, Science.

[29]  W. Jiang,et al.  Neuronal encoding of texture changes in the primary and the secondary somatosensory cortical areas of monkeys during passive texture discrimination. , 1997, Journal of neurophysiology.

[30]  D. Pandya,et al.  Efferent cortical connections of multimodal cortex of the superior temporal sulcus in the rhesus monkey , 1992, The Journal of comparative neurology.

[31]  P. Chauvel,et al.  Neuromagnetic source localization of auditory evoked fields and intracerebral evoked potentials: a comparison of data in the same patients , 2001, Clinical Neurophysiology.

[32]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[33]  Harold Burton,et al.  Second somatosensory cortical area in macaque monkeys: 2. Neuronal responses to punctate vibrotactile stimulation of glabrous skin on the hand , 1991, Brain Research.

[34]  E. Miller,et al.  The prefontral cortex and cognitive control , 2000, Nature Reviews Neuroscience.

[35]  D. Pandya,et al.  Anatomy of the auditory cortex. , 1995, Revue neurologique.

[36]  Deepak N. Pandya,et al.  Further observations on corticofrontal connections in the rhesus monkey , 1976, Brain Research.

[37]  C. Schroeder,et al.  Neuronal Oscillations and Multisensory Interaction in Primary Auditory Cortex , 2007, Neuron.

[38]  R. Kakigi.  Somatosensory evoked magnetic fields following median nerve stimulation , 1994, Neuroscience Research.

[39]  N. Logothetis,et al.  Visual modulation of neurons in auditory cortex. , 2008, Cerebral cortex.

[40]  Ryusuke Kakigi,et al.  The somatosensory evoked magnetic fields , 2000, Progress in Neurobiology.

[41]  S S Hsiao,et al.  Effects of selective attention on spatial form processing in monkey primary and secondary somatosensory cortex. , 1993, Journal of neurophysiology.

[42]  Emi Tanaka,et al.  Time-varying cortical activations related to visual-tactile cross-modal links in spatial selective attention. , 2007, Journal of neurophysiology.

[43]  El-Mehdi Meftah,et al.  Independent controls of attentional influences in primary and secondary somatosensory cortex. , 2005, Journal of neurophysiology.

[44]  J. Mattingley,et al.  Parietal neglect and visual awareness , 1998, Nature Neuroscience.

[45]  J. Downar,et al.  The Effect of Task Relevance on the Cortical Response to Changes in Visual and Auditory Stimuli: An Event-Related fMRI Study , 2001, NeuroImage.

[46]  T. Allison,et al.  Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. , 1999, Cerebral cortex.

[47]  Emi Tanaka,et al.  A transition from unimodal to multimodal activations in four sensory modalities in humans: an electrophysiological study , 2008, BMC Neuroscience.

[48]  M Hämäläinen,et al.  Somatosensory evoked cerebral magnetic fields from SI and SII in man. , 1984, Electroencephalography and clinical neurophysiology.

[49]  Charles G. Gross,et al.  Visual responses with and without fixation: neurons in premotor cortex encode spatial locations independently of eye position , 1998, Experimental Brain Research.

[50]  A. K. Luo,et al.  In Transition , 2010, Annals of Internal Medicine.

[51]  B. Argall,et al.  Unraveling multisensory integration: patchy organization within human STS multisensory cortex , 2004, Nature Neuroscience.

[52]  John J. Foxe,et al.  The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. , 2002, Brain research. Cognitive brain research.

[53]  F. Bloom,et al.  Modulation of early sensory processing in human auditory cortex during auditory selective attention. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[54]  D. I. Perrett,et al.  Visual and somatosensory processing in the macaque temporal cortex: the role of ‘expectation’ , 2004, Experimental Brain Research.

[55]  Joost X. Maier,et al.  Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex , 2005 .

[56]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[57]  E. Halgren,et al.  Intracerebral potentials to rare target and distractor auditory and visual stimuli. I. Superior temporal plane and parietal lobe. , 1995, Electroencephalography and clinical neurophysiology.

[58]  Veikko Jousmäki,et al.  Sensorimotor integration in human primary and secondary somatosensory cortices , 1998, Brain Research.

[59]  J. Duncan.  An adaptive coding model of neural function in prefrontal cortex , 2001 .

[60]  松橋 眞生.  Multisensory convergence at human temporo-parietal junction : Epicortical recording of evoked responses , 2004 .

[62]  G. Calvert.  Crossmodal processing in the human brain: insights from functional neuroimaging studies. , 2001, Cerebral cortex.

[63]  H. Spiers,et al.  Prefrontal and medial temporal lobe interactions in long-term memory , 2003, Nature Reviews Neuroscience.

[64]  Patrick Chauvel,et al.  Intracranial ERPs in humans during a lateralized visual oddball task: II. Temporal, parietal, and frontal recordings , 1999, Clinical Neurophysiology.

[65]  Emi Tanaka,et al.  Common cortical responses evoked by appearance, disappearance and change of the human face , 2009, BMC Neuroscience.

[66]  Koji Inui,et al.  Temporal dynamics of adaptation to natural sounds in the human auditory cortex. , 2008, Cerebral cortex.

[67]  R. Goebel,et al.  The functional neuroanatomy of target detection: an fMRI study of visual and auditory oddball tasks. , 1999, Cerebral cortex.

[68]  R. Hari,et al.  Recording and interpretation of cerebral magnetic fields. , 1989, Science.

[69]  R. Hari,et al.  Magnetoencephalography in the study of human somatosensory cortical processing. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[70]  M. Mesulam,et al.  Insula of the old world monkey. III: Efferent cortical output and comments on function , 1982, The Journal of comparative neurology.

[71]  El-Mehdi Meftah,et al.  Effects of a cross-modal manipulation of attention on somatosensory cortical neuronal responses to tactile stimuli in the monkey. , 2002, Journal of neurophysiology.

[72]  S. Supek,et al.  Simulation studies of multiple dipole neuromagnetic source localization: model order and limits of source resolution , 1993, IEEE Transactions on Biomedical Engineering.

[73]  R. Kakigi,et al.  Serial and parallel processing in the human auditory cortex: a magnetoencephalographic study. , 2006, Cerebral cortex.

[74]  N. Sigala,et al.  Visual categorization shapes feature selectivity in the primate temporal cortex , 2002, Nature.

[75]  J. Downar,et al.  A multimodal cortical network for the detection of changes in the sensory environment , 2000, Nature Neuroscience.

[76]  Koji Inui,et al.  Centrifugal regulation of human cortical responses to a task-relevant somatosensory signal triggering voluntary movement , 2006, NeuroImage.

[77]  D. Pandya,et al.  Thalamic connections of the cortex of the superior temporal sulcus in the rhesus monkey , 1989, The Journal of comparative neurology.

[78]  H Burton,et al.  Neuronal activity in the second somatosensory cortex of monkeys (Macaca mulatta) during active touch of gratings. , 1993, Journal of neurophysiology.

[79]  T. Allison,et al.  Face-sensitive regions in human extrastriate cortex studied by functional MRI. , 1995, Journal of neurophysiology.

[80]  H. Karnath.  New insights into the functions of the superior temporal cortex , 2001, Nature Reviews Neuroscience.

[81]  Hidenao Fukuyama,et al.  Multisensory convergence at human temporo-parietal junction – epicortical recording of evoked responses , 2004, Clinical Neurophysiology.

[82]  Michael Scherg,et al.  Functional imaging and localization of electromagnetic brain activity , 2005, Brain Topography.

[83]  Keiji Tanaka.  Mechanisms of visual object recognition: monkey and human studies , 1997, Current Opinion in Neurobiology.

[84]  Stewart Boyd,et al.  Identification and characterization of somatosensory off responses , 2006, Brain Research.

[85]  I..  THE ATTENTION SYSTEM OF THE HUMAN BRAIN , 2002 .

[86]  Kristina J. Nielsen,et al.  Dissociation Between Local Field Potentials and Spiking Activity in Macaque Inferior Temporal Cortex Reveals Diagnosticity-Based Encoding of Complex Objects , 2006, The Journal of Neuroscience.

[87]  R. Kakigi,et al.  Serial processing in the human somatosensory system. , 2004, Cerebral cortex.

[88]  J M Badier,et al.  Evoked potentials recorded from the auditory cortex in man: evaluation and topography of the middle latency components. , 1994, Electroencephalography and clinical neurophysiology.

[89]  Minami Ito,et al.  Columns for visual features of objects in monkey inferotemporal cortex , 1992, Nature.

[90]  Koji Inui,et al.  Temporal analysis of the flow from V1 to the extrastriate cortex in humans. , 2006, Journal of neurophysiology.

[91]  E. Macaluso,et al.  Spatial attention and crossmodal interactions between vision and touch , 2001, Neuropsychologia.

[92]  D. Pandya,et al.  Converging visual and somatic sensory cortical input to the intraparietal sulcus of the rhesus monkey , 1980, Brain Research.

[93]  D. Pandya,et al.  Afferent cortical connections and architectonics of the superior temporal sulcus and surrounding cortex in the rhesus monkey , 1978, Brain Research.

[94]  C. Spence,et al.  Multisensory representation of limb position in human premotor cortex , 2003, Nature Neuroscience.