Auditory Event-Related Response in Visual Cortex Modulates Subsequent Visual Responses in Humans

Growing evidence from electrophysiological data in animal and human studies suggests that multisensory interaction is not exclusively a higher-order process, but also takes place in primary sensory cortices. Such early multisensory interaction is thought to be mediated by means of phase resetting. The presentation of a stimulus to one sensory modality resets the phase of ongoing oscillations in another modality such that processing in the latter modality is modulated. In humans, evidence for such a mechanism is still sparse. In the current study, the influence of an auditory stimulus on visual processing was investigated by measuring the electroencephalogram (EEG) and behavioral responses of humans to visual, auditory, and audiovisual stimulation with varying stimulus-onset asynchrony (SOA). We observed three distinct oscillatory EEG responses in our data. An initial gamma-band response around 50 Hz was followed by a beta-band response around 25 Hz, and a theta response around 6 Hz. The latter was enhanced in response to cross-modal stimuli as compared to either unimodal stimuli. Interestingly, the beta response to unimodal auditory stimuli was dominant in electrodes over visual areas. The SOA between auditory and visual stimuli—albeit not consciously perceived—had a modulatory impact on the multisensory evoked beta-band responses; i.e., the amplitude depended on SOA in a sinusoidal fashion, suggesting a phase reset. These findings further support the notion that parameters of brain oscillations such as amplitude and phase are essential predictors of subsequent brain responses and might be one of the mechanisms underlying multisensory integration.

[1]  Julien Krieg,et al.  A comparison of methods for assessing alpha phase resetting in electrophysiology, with application to intracerebral EEG in visual areas , 2011, NeuroImage.

[2]  J. Pernier,et al.  Stimulus Specificity of Phase-Locked and Non-Phase-Locked 40 Hz Visual Responses in Human , 1996, The Journal of Neuroscience.

[3]  Simon Hanslmayr,et al.  Prestimulus oscillations predict visual perception performance between and within subjects , 2007, NeuroImage.

[4]  Christoph S. Herrmann,et al.  Early gamma-band responses reflect anticipatory top-down modulation in the auditory cortex , 2009, NeuroImage.

[5]  A. Puce,et al.  Neuronal oscillations and visual amplification of speech , 2008, Trends in Cognitive Sciences.

[6]  N. Logothetis,et al.  Visual modulation of neurons in auditory cortex. , 2008, Cerebral cortex.

[7]  J. Schoffelen,et al.  Prestimulus Oscillatory Activity in the Alpha Band Predicts Visual Discrimination Ability , 2008, The Journal of Neuroscience.

[8]  John J. Foxe,et al.  The case for feedforward multisensory convergence during early cortical processing , 2005, Neuroreport.

[9]  E. Basar EEG-brain dynamics: Relation between EEG and Brain evoked potentials , 1980 .

[10]  P. Sprent,et al.  Statistical Analysis of Circular Data. , 1994 .

[11]  Brigitte Röder,et al.  Semantic confusion regarding the development of multisensory integration: a practical solution , 2010, The European journal of neuroscience.

[12]  Daniel Senkowski,et al.  Good times for multisensory integration: Effects of the precision of temporal synchrony as revealed by gamma-band oscillations , 2007, Neuropsychologia.

[13]  T. Sejnowski,et al.  Dynamic Brain Sources of Visual Evoked Responses , 2002, Science.

[14]  T. Inouye,et al.  Medial prefrontal cortex generates frontal midline theta rhythm. , 1999, Neuroreport.

[15]  Á. Pascual-Leone,et al.  α-Band Electroencephalographic Activity over Occipital Cortex Indexes Visuospatial Attention Bias and Predicts Visual Target Detection , 2006, The Journal of Neuroscience.

[16]  Maren Grigutsch,et al.  EEG oscillations and wavelet analysis , 2005 .

[17]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[18]  Ingo Fründ,et al.  Inter- and Intra-Individual Covariations of Hemodynamic and Oscillatory Gamma Responses in the Human Cortex , 2009, Front. Hum. Neurosci..

[19]  Christoph S. Herrmann,et al.  Evoked γ oscillations in human scalp EEG are test–retest reliable , 2007, Clinical Neurophysiology.

[20]  John J. Foxe,et al.  Crossmodal binding through neural coherence: implications for multisensory processing , 2008, Trends in Neurosciences.

[21]  Nicholas I. Fisher,et al.  Statistical Analysis of Circular Data , 1993 .

[22]  R. VanRullen,et al.  The Phase of Ongoing EEG Oscillations Predicts Visual Perception , 2009, The Journal of Neuroscience.

[23]  Simon Hanslmayr,et al.  The best of both worlds: phase-reset of human EEG alpha activity and additive power contribute to ERP generation. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[24]  W. Klimesch,et al.  Are event-related potential components generated by phase resetting of brain oscillations? A critical discussion , 2007, Neuroscience.

[25]  Rodrigo Quian Quiroga,et al.  Spatio-temporal frequency characteristics of intersensory components in audiovisually evoked potentials. , 2005, Brain research. Cognitive brain research.

[26]  F. Lin,et al.  Onset timing of cross‐sensory activations and multisensory interactions in auditory and visual sensory cortices , 2010, The European journal of neuroscience.

[27]  T. Ergenoğlu,et al.  Alpha rhythm of the EEG modulates visual detection performance in humans. , 2004, Brain research. Cognitive brain research.

[28]  Ingo Fründ,et al.  Evoked gamma oscillations in human scalp EEG are test-retest reliable. , 2007, Clinical neurophysiology : official journal of the International Federation of Clinical Neurophysiology.

[29]  Wael El-Deredy,et al.  Exploring event‐related brain dynamics with tests on complex valued time–frequency representations , 2008, Statistics in medicine.

[30]  T. Stanford,et al.  Challenges in quantifying multisensory integration: alternative criteria, models, and inverse effectiveness , 2009, Experimental Brain Research.

[31]  Jochen Kaiser,et al.  Cortical Oscillations and Multisensory Interactions in Humans , 2010 .

[32]  J. Kaiser,et al.  Multisensory Object Perception in the Primate Brain , 2010 .

[33]  J. Driver,et al.  Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments , 2008, Neuron.

[34]  N. Busch,et al.  Gamma amplitudes are coupled to theta phase in human EEG during visual perception. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[35]  C. Schroeder,et al.  The Leading Sense: Supramodal Control of Neurophysiological Context by Attention , 2009, Neuron.

[36]  E. Basar,et al.  Gamma-band responses in the brain: a short review of psychophysiological correlates and functional significance. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[37]  C. Schroeder,et al.  Neuronal Oscillations and Multisensory Interaction in Primary Auditory Cortex , 2007, Neuron.

[38]  S. Debener,et al.  Cross-Modal Phase Reset Predicts Auditory Task Performance in Humans , 2011, The Journal of Neuroscience.

[39]  Albert R. Powers,et al.  Perceptual Training Narrows the Temporal Window of Multisensory Binding , 2009, The Journal of Neuroscience.