Perception of the touch-induced visual double-flash illusion correlates with changes of rhythmic neuronal activity in human visual and somatosensory areas

A single brief visual stimulus accompanied by two brief tactile stimuli is frequently perceived incorrectly as two flashes, a phenomenon called double-flash illusion (DFI). We investigated whether the DFI is accompanied by changes in rhythmic neuronal activity, using magnetoencephalography in human subjects. Twenty-two subjects received visuo-tactile stimulation and reported the number of perceived visual stimuli. We sorted trials with identical physical stimulation according to the reported subjective percept and assessed differences in spectral power in somatosensory and occipital sensors. In DFI trials, occipital sensors displayed a contralateral enhancement of gamma-band (80-140 Hz) activity in response to stimulation. In somatosensory sensors, the DFI was associated with an increase of spectral power for low frequencies (5-17.5 Hz) around stimulation and a decrease of spectral power in the 22.5-30 Hz range between 450 and 750 ms post-stimulation. In summary, several components of rhythmic activity predicted variable subjective experience for constant physical stimulation. Notably, the enhanced occipital gamma-band activity during DFI was similar in time and frequency extent to the somatosensory gamma-band response to tactile stimulation. We speculate that the DFI might therefore occur when the somatosensory gamma-response is transmitted to visual cortex. This transmission might be supported by the observed modulations in low-frequency activity.

[1]  Daniel Senkowski,et al.  Good times for multisensory integration: Effects of the precision of temporal synchrony as revealed by gamma-band oscillations , 2007, Neuropsychologia.

[2]  P. Mitra,et al.  Analysis of dynamic brain imaging data. , 1998, Biophysical journal.

[3]  Shinsuke Shimojo,et al.  Touch-induced visual illusion , 2005, Neuroreport.

[4]  T. Sejnowski,et al.  Correlated neuronal activity and the flow of neural information , 2001, Nature Reviews Neuroscience.

[5]  Gregor Thut,et al.  Feeling by Sight or Seeing by Touch? , 2004, Neuron.

[6]  J Driver,et al.  An event-related brain potential study of cross-modal links in spatial attention between vision and touch. , 2000, Psychophysiology.

[7]  S. Shimojo,et al.  Illusions: What you see is what you hear , 2000, Nature.

[8]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[9]  Geraint Rees,et al.  Sound alters activity in human V1 in association with illusory visual perception , 2006, NeuroImage.

[10]  Asif A Ghazanfar,et al.  Interactions between the Superior Temporal Sulcus and Auditory Cortex Mediate Dynamic Face/Voice Integration in Rhesus Monkeys , 2008, The Journal of Neuroscience.

[11]  W. Freiwald,et al.  Oscillatory synchrony in the monkey temporal lobe correlates with performance in a visual short-term memory task. , 2004, Cerebral cortex.

[12]  Catherine Tallon-Baudry,et al.  The many faces of the gamma band response to complex visual stimuli , 2005, NeuroImage.

[13]  Antígona Martínez,et al.  Effect of Attention on Early Cortical Processes Associated with the Sound-induced Extra Flash Illusion , 2010, Journal of Cognitive Neuroscience.

[14]  C. Schroeder,et al.  Neuronal Oscillations and Multisensory Interaction in Primary Auditory Cortex , 2007, Neuron.

[15]  Kimron Shapiro,et al.  Modulation of long-range neural synchrony reflects temporal limitations of visual attention in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[16]  M A Nicolelis,et al.  Neonatal whisker removal reduces the discrimination of tactile stimuli by thalamic ensembles in adult rats. , 1997, Journal of neurophysiology.

[17]  Robert Oostenveld,et al.  Localizing human visual gamma-band activity in frequency, time and space , 2006, NeuroImage.

[18]  R. Desimone,et al.  The Effects of Visual Stimulation and Selective Visual Attention on Rhythmic Neuronal Synchronization in Macaque Area V4 , 2008, The Journal of Neuroscience.

[19]  O W Sakowitz,et al.  Bisensory stimulation increases gamma-responses over multiple cortical regions. , 2001, Brain research. Cognitive brain research.

[20]  J. Rieger,et al.  Audiovisual Temporal Correspondence Modulates Human Multisensory Superior Temporal Sulcus Plus Primary Sensory Cortices , 2007, The Journal of Neuroscience.

[21]  N. Logothetis,et al.  Local field potential reflects perceptual suppression in monkey visual cortex , 2006, Proceedings of the National Academy of Sciences.

[22]  J Driver,et al.  Crossmodal Spatial Influences of Touch on Extrastriate Visual Areas Take Current Gaze Direction into Account , 2002, Neuron.

[23]  T. Sejnowski,et al.  Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion , 2007, The Journal of Neuroscience.

[24]  David A. Leopold,et al.  Stable perception of visually ambiguous patterns , 2002, Nature Neuroscience.

[25]  W. Singer,et al.  Dynamic predictions: Oscillations and synchrony in top–down processing , 2001, Nature Reviews Neuroscience.

[26]  Ankoor S. Shah,et al.  Auditory Cortical Neurons Respond to Somatosensory Stimulation , 2003, The Journal of Neuroscience.

[27]  H. Kennedy,et al.  Anatomical Evidence of Multimodal Integration in Primate Striate Cortex , 2002, The Journal of Neuroscience.

[28]  R. Deichmann,et al.  Eye-specific effects of binocular rivalry in the human lateral geniculate nucleus , 2005, Nature.

[29]  C. Frith,et al.  Modulation of human visual cortex by crossmodal spatial attention. , 2000, Science.

[30]  W. Singer,et al.  Modulation of Neuronal Interactions Through Neuronal Synchronization , 2007, Science.

[31]  G. Nolte.  The magnetic lead field theorem in the quasi-static approximation and its use for magnetoencephalography forward calculation in realistic volume conductors. , 2003, Physics in medicine and biology.

[32]  Istvan Ulbert,et al.  Sources of Somatosensory Input to the Caudal Belt Areas of Auditory Cortex , 2007, Perception.

[33]  P. Fries.  A mechanism for cognitive dynamics: neuronal communication through neuronal coherence , 2005, Trends in Cognitive Sciences.

[34]  Thomas R Knösche,et al.  Tangential derivative mapping of axial MEG applied to event-related desynchronization research , 2000, Clinical Neurophysiology.

[35]  O. Bertrand,et al.  Attention modulates gamma-band oscillations differently in the human lateral occipital cortex and fusiform gyrus. , 2005, Cerebral cortex.

[36]  M. Berger,et al.  High Gamma Power Is Phase-Locked to Theta Oscillations in Human Neocortex , 2006, Science.

[37]  Martin Eimer,et al.  Crossmodal links in spatial attention are mediated by supramodal control processes: evidence from event-related potentials. , 2002, Psychophysiology.

[38]  Marisa Carrasco,et al.  Attention improves or impairs visual performance by enhancing spatial resolution , 1998, Nature.

[39]  Kathleen S Rockland,et al.  Multisensory convergence in calcarine visual areas in macaque monkey. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[40]  Scott T. Grafton,et al.  Involvement of visual cortex in tactile discrimination of orientation , 1999, Nature.

[41]  D. Barth,et al.  The spatiotemporal organization of auditory, visual, and auditory-visual evoked potentials in rat cortex , 1995, Brain Research.

[42]  Shinsuke Shimojo,et al.  Sound-induced illusory flash perception: role of gamma band responses , 2002, Neuroreport.

[43]  Th R Knösche,et al.  Transformation of Whole-Head MEG Recordings Between Different Sensor Positions / Transformation von Ganzkopf-MEG-Messungen zwischen verschiedenen Sensorpositionen , 2002, Biomedizinische Technik. Biomedical engineering.

[44]  P. Mamassian,et al.  What does the illusory-flash look like? , 2010, Vision Research.

[45]  J. Martinerie,et al.  The brainweb: Phase synchronization and large-scale integration , 2001, Nature Reviews Neuroscience.

[46]  R. Oostenveld,et al.  Tactile Spatial Attention Enhances Gamma-Band Activity in Somatosensory Cortex and Reduces Low-Frequency Activity in Parieto-Occipital Areas , 2006, The Journal of Neuroscience.

[47]  Hauke R. Heekeren,et al.  What Happens in Between? Human Oscillatory Brain Activity Related to Crossmodal Spatial Cueing , 2008, PloS one.

[48]  I. Nelken,et al.  Physiological and Anatomical Evidence for Multisensory Interactions in Auditory Cortex , 2006, Cerebral cortex.

[49]  J. Schoffelen,et al.  Neuronal Coherence as a Mechanism of Effective Corticospinal Interaction , 2005, Science.