Crossmodal effect with rubber hand illusion and gamma-band activity.

The integration of multimodal stimuli has been regarded as important for the promotion of adaptive behavior. Although recent work has identified brain areas that respond to multimodal stimuli, the temporal features are not clear yet. Earlier event-related potential studies revealed crossmodal attention effects, but did not focus on mechanisms underlying crossmodal integration. Here, electroencephalography (EEG) activity in the gamma band was considered as a correlate of multimodal integration. Participants localized a tactile stimulus on their fingers while seeing visual stimuli on rubber hands with the same posture as their hands. EEG analyses using wavelet transform suggested that interelectrode phase synchrony in the gamma-band range (40-50 Hz) was related to behavioral indices of the intermodal illusion under consideration. The findings suggest a role of high-frequency oscillations in the integrative processing of stimuli across modalities.

[1]  P. König,et al.  Top-down processing mediated by interareal synchronization. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[2]  R. Lesser,et al.  Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. II. Event-related synchronization in the gamma band. , 1998, Brain : a journal of neurology.

[3]  J. Driver,et al.  Cross-modal links in endogenous spatial attention are mediated by common external locations: evidence from event-related brain potentials , 2001, Experimental Brain Research.

[4]  U. Böckenholt,et al.  Bootstrapping: applications to psychophysiology. , 1989, Psychophysiology.

[5]  O. Bertrand,et al.  Auditory induced 40-Hz activity during a frequency discrimination task , 1998, NeuroImage.

[6]  J Driver,et al.  An event-related brain potential study of cross-modal links in spatial attention between vision and touch. , 2000, Psychophysiology.

[7]  Miles A. Whittington,et al.  New Roles for the Gamma Rhythm: Population Tuning and Preprocessing for the Beta Rhythm , 2004, Journal of Computational Neuroscience.

[8]  A. Haig,et al.  Peak gamma latency correlated with reaction time in a conventional oddball paradigm , 1999, Clinical Neurophysiology.

[9]  C. C. Wood,et al.  The relationship between human long-latency somatosensory evoked potentials recorded from the cortical surface and from the scalp. , 1992, Electroencephalography and clinical neurophysiology.

[10]  K. Zilles,et al.  Polymodal Motion Processing in Posterior Parietal and Premotor Cortex A Human fMRI Study Strongly Implies Equivalencies between Humans and Monkeys , 2001, Neuron.

[11]  Martin Eimer,et al.  Effects of hand posture on preparatory control processes and sensory modulations in tactile-spatial attention , 2004, Clinical Neurophysiology.

[12]  F. Varela,et al.  Guiding the study of brain dynamics by using first-person data: Synchrony patterns correlate with ongoing conscious states during a simple visual task , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[13]  O W Sakowitz,et al.  Bisensory stimulation increases gamma-responses over multiple cortical regions. , 2001, Brain research. Cognitive brain research.

[14]  G Pfurtscheller,et al.  Visualization of significant ERD/ERS patterns in multichannel EEG and ECoG data , 2002, Clinical Neurophysiology.

[15]  Dylan F. Cooke,et al.  The Cortical Control of Movement Revisited , 2002, Neuron.

[16]  Patrick Haggard,et al.  Vision Modulates Somatosensory Cortical Processing , 2002, Current Biology.

[17]  O. Bertrand,et al.  Oscillatory gamma activity in humans and its role in object representation , 1999, Trends in Cognitive Sciences.

[18]  J. Driver,et al.  Multimodal mechanisms of attention related to rates of spatial shifting in vision and touch , 2001, Experimental Brain Research.

[19]  E. Macaluso,et al.  Multisensory spatial interactions: a window onto functional integration in the human brain , 2005, Trends in Neurosciences.

[20]  F. Mauguière,et al.  Timing and spatial distribution of somatosensory responses recorded in the upper bank of the sylvian fissure (SII area) in humans. , 1999, Cerebral cortex.

[21]  Werner Lutzenberger,et al.  Hearing lips: gamma-band activity during audiovisual speech perception. , 2005, Cerebral cortex.

[22]  Daniel Senkowski,et al.  Multisensory processing and oscillatory gamma responses: effects of spatial selective attention , 2005, Experimental Brain Research.

[23]  G. Calvert,et al.  Multisensory integration: methodological approaches and emerging principles in the human brain , 2004, Journal of Physiology-Paris.

[24]  Martin Eimer,et al.  The attentional selection of spatial and non-spatial attributes in touch: ERP evidence for parallel and independent processes , 2004, Biological Psychology.

[25]  Matthias M. Müller,et al.  Oscillatory brain activity dissociates between associative stimulus content in a repetition priming task in the human EEG. , 2004, Cerebral cortex.

[26]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[27]  C. Spence,et al.  Visual Capture of Touch: Out-of-the-Body Experiences With Rubber Gloves , 2000, Psychological science.

[28]  D. Shore,et al.  Integration of visual and tactile stimuli: top-down influences require time , 2005, Experimental Brain Research.

[29]  E. Macaluso,et al.  Spatial attention and crossmodal interactions between vision and touch , 2001, Neuropsychologia.

[30]  T. Iidaka,et al.  Gamma band activity and its synchronization reflect the dysfunctional emotional processing in alexithymic persons. , 2006, Psychophysiology.

[31]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[32]  G. Ermentrout,et al.  Gamma rhythms and beta rhythms have different synchronization properties. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Matthias M. Müller,et al.  Oscillatory brain activity in the human EEG during indirect and direct memory tasks , 2006, Brain Research.

[34]  Andrew C. N. Chen,et al.  Perception of pain coincides with the spatial expansion of electroencephalographic dynamics in human subjects , 2001, Neuroscience Letters.

[35]  O. Blanke,et al.  Neuropsychology: Stimulating illusory own-body perceptions , 2002, Nature.

[36]  Martin Eimer,et al.  Covert attention in touch: behavioral and ERP evidence for costs and benefits. , 2005, Psychophysiology.

[37]  A. von Stein,et al.  Different frequencies for different scales of cortical integration: from local gamma to long range alpha/theta synchronization. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[38]  R. Schmidt,et al.  On the nature of intersensory facilitation of reaction time , 1983, Perception & psychophysics.

[39]  Rodrigo Quian Quiroga,et al.  Spatio-temporal frequency characteristics of intersensory components in audiovisually evoked potentials. , 2005, Brain research. Cognitive brain research.

[40]  Olivier David,et al.  Waves of consciousness: ongoing cortical patterns during binocular rivalry , 2004, NeuroImage.

[41]  R J Snowden,et al.  Identification of Visual Stimuli is Improved by Accompanying Auditory Stimuli: The Role of Eye Movements and Sound Location , 2001, Perception.

[42]  Nancy Kopell,et al.  Alpha-Frequency Rhythms Desynchronize over Long Cortical Distances: A Modeling Study , 2000, Journal of Computational Neuroscience.

[43]  J. Pernier,et al.  Oscillatory γ-Band (30–70 Hz) Activity Induced by a Visual Search Task in Humans , 1997, The Journal of Neuroscience.

[44]  J. Desmedt,et al.  Transient phase-locking of 40 Hz electrical oscillations in prefrontal and parietal human cortex reflects the process of conscious somatic perception , 1994, Neuroscience Letters.

[45]  F. Varela,et al.  Perception's shadow: long-distance synchronization of human brain activity , 1999, Nature.

[46]  Francesco Pavani,et al.  Acoustical Vision of Neglected Stimuli: Interaction among Spatially Converging Audiovisual Inputs in Neglect Patients , 2002, Journal of Cognitive Neuroscience.

[47]  John J. Foxe,et al.  Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. , 2002, Brain research. Cognitive brain research.