Stereotactic electroencephalography in humans reveals multisensory signal in early visual and auditory cortices

Unequivocally demonstrating the presence of multisensory signals at the earliest stages of cortical processing remains challenging in humans. In our study, we relied on the unique spatio-temporal resolution provided by intracranial stereotactic electroencephalographic (SEEG) recordings in patients with drug-resistant epilepsy to characterize the signal extracted from early visual (calcarine and pericalcarine) and auditory (Heschl’s gyrus and planum temporale) regions during a simple audio-visual oddball task. We provide evidences that both cross-modal responses (visual responses in auditory cortex or the reverse) and multisensory processing (alteration of the unimodal responses during bimodal stimulation) can be observed in intracranial event-related potentials (iERPs) and in power modulations of oscillatory activity at different temporal scales within the first 150 ms after stimulus onset. The temporal profiles of the iERPs are compatible with the hypothesis that MSI occurs by means of direct pathways linking early visual and auditory regions. Our data indicate, moreover, that MSI mainly relies on modulations of the low-frequency bands (foremost the theta band in the auditory cortex and the alpha band in the visual cortex), suggesting the involvement of feedback pathways between the two sensory regions. Remarkably, we also observed high-gamma power modulations by sounds in the early visual cortex, thus suggesting the presence of neuronal populations involved in auditory processing in the calcarine and pericalcarine region in humans.

[1]  Gregor Thut,et al.  The multisensory function of the human primary visual cortex , 2016, Neuropsychologia.

[2]  P. Fries Rhythms for Cognition: Communication through Coherence , 2015, Neuron.

[3]  John J. Foxe,et al.  Neuro-Oscillatory Phase Alignment Drives Speeded Multisensory Response Times: An Electro-Corticographic Investigation , 2015, The Journal of Neuroscience.

[4]  Zenas C. Chao,et al.  Studying brain functions with mesoscopic measurements: Advances in electrocorticography for non-human primates , 2015, Current Opinion in Neurobiology.

[5]  Gabriele Arnulfo,et al.  Phase and amplitude correlations in resting-state activity in human stereotactical EEG recordings , 2015, NeuroImage.

[6]  Laura Lee Colgin,et al.  Beta and Gamma Rhythms Go with the Flow , 2015, Neuron.

[7]  P. Roelfsema,et al.  Alpha and gamma oscillations characterize feedback and feedforward processing in monkey visual cortex , 2014, Proceedings of the National Academy of Sciences.

[8]  Anne-Lise Giraud,et al.  The contribution of frequency-specific activity to hierarchical information processing in the human auditory cortex , 2014, Nature Communications.

[9]  Mark R. Bower,et al.  High frequency oscillations are associated with cognitive processing in human recognition memory. , 2014, Brain : a journal of neurology.

[10]  H. Kennedy,et al.  Visual Areas Exert Feedforward and Feedback Influences through Distinct Frequency Channels , 2014, Neuron.

[11]  Michael X Cohen,et al.  Analyzing Neural Time Series Data: Theory and Practice , 2014 .

[12]  E. Halgren,et al.  Intracranial Cortical Responses during Visual–Tactile Integration in Humans , 2014, The Journal of Neuroscience.

[13]  Manuel R. Mercier,et al.  Auditory-driven phase reset in visual cortex: Human electrocorticography reveals mechanisms of early multisensory integration , 2013, NeuroImage.

[14]  S. Muthukumaraswamy High-frequency brain activity and muscle artifacts in MEG/EEG: a review and recommendations , 2013, Front. Hum. Neurosci..

[15]  J. Simon,et al.  Power and phase properties of oscillatory neural responses in the presence of background activity , 2013, Journal of Computational Neuroscience.

[16]  Gabriele Arnulfo,et al.  Stereoelectroencephalography: surgical methodology, safety, and stereotactic application accuracy in 500 procedures. , 2013, Neurosurgery.

[17]  R. Kikinis,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[18]  E. Halgren,et al.  High-frequency neural activity and human cognition: Past, present and possible future of intracranial EEG research , 2012, Progress in Neurobiology.

[19]  Bruce Fischl,et al.  FreeSurfer , 2012, NeuroImage.

[20]  G. Buzsáki,et al.  Mechanisms of gamma oscillations. , 2012, Annual review of neuroscience.

[21]  Giuliano Iurilli,et al.  Sound-Driven Synaptic Inhibition in Primary Visual Cortex , 2012, Neuron.

[22]  Andreas K. Engel,et al.  The saccadic spike artifact in MEG , 2012, NeuroImage.

[23]  A. Engel,et al.  Spectral fingerprints of large-scale neuronal interactions , 2012, Nature Reviews Neuroscience.

[24]  C. Schroeder,et al.  How Local Is the Local Field Potential? , 2011, Neuron.

[25]  R. Desimone,et al.  Laminar differences in gamma and alpha coherence in the ventral stream , 2011, Proceedings of the National Academy of Sciences.

[26]  S. Debener,et al.  Cross-Modal Phase Reset Predicts Auditory Task Performance in Humans , 2011, The Journal of Neuroscience.

[27]  D. Senkowski,et al.  The multifaceted interplay between attention and multisensory integration , 2010, Trends in Cognitive Sciences.

[28]  Christoph Kayser,et al.  The Multisensory Nature of Unisensory Cortices: A Puzzle Continued , 2010, Neuron.

[29]  Rogelio Luna,et al.  Do Sensory Cortices Process More than One Sensory Modality during Perceptual Judgments? , 2010, Neuron.

[30]  Xiao-Jing Wang Neurophysiological and computational principles of cortical rhythms in cognition. , 2010, Physiological reviews.

[31]  F. Lin,et al.  Onset timing of cross‐sensory activations and multisensory interactions in auditory and visual sensory cortices , 2010, The European journal of neuroscience.

[32]  A. Engel,et al.  Beta-band oscillations—signalling the status quo? , 2010, Current Opinion in Neurobiology.

[33]  C. Schroeder,et al.  Neuronal mechanisms, response dynamics and perceptual functions of multisensory interactions in auditory cortex , 2009, Hearing Research.

[34]  E. M. Rouiller,et al.  Multisensory anatomical pathways , 2009, Hearing Research.

[35]  Jeremy R. Manning,et al.  Broadband Shifts in Local Field Potential Power Spectra Are Correlated with Single-Neuron Spiking in Humans , 2009, The Journal of Neuroscience.

[36]  T. Stanford,et al.  Challenges in quantifying multisensory integration: alternative criteria, models, and inverse effectiveness , 2009, Experimental Brain Research.

[37]  R. Goebel,et al.  Multisensory functional magnetic resonance imaging: a future perspective , 2009, Experimental Brain Research.

[38]  R. Desimone,et al.  High-Frequency, Long-Range Coupling Between Prefrontal and Visual Cortex During Attention , 2009, Science.

[39]  Marcelo A. Montemurro,et al.  Spike-Phase Coding Boosts and Stabilizes Information Carried by Spatial and Temporal Spike Patterns , 2009, Neuron.

[40]  C. Schroeder,et al.  Low-frequency neuronal oscillations as instruments of sensory selection , 2009, Trends in Neurosciences.

[41]  Stephen G. Lomber,et al.  Auditory cortex projections target the peripheral field representation of primary visual cortex , 2008, Experimental Brain Research.

[42]  N. Logothetis,et al.  Visual modulation of neurons in auditory cortex. , 2008, Cerebral cortex.

[43]  T. Stanford,et al.  Multisensory integration: current issues from the perspective of the single neuron , 2008, Nature Reviews Neuroscience.

[44]  J. Driver,et al.  Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments , 2008, Neuron.

[45]  S. Hillyard,et al.  Neural Basis of the Ventriloquist Illusion , 2007, Current Biology.

[46]  Jean-Philippe Thiran,et al.  Multisensory interactions within human primary cortices revealed by BOLD dynamics. , 2007, Cerebral cortex.

[47]  John J. Foxe,et al.  Multisensory processing and oscillatory activity: analyzing non-linear electrophysiological measures in humans and simians , 2007, Experimental Brain Research.

[48]  C. Schroeder,et al.  Neuronal Oscillations and Multisensory Interaction in Primary Auditory Cortex , 2007, Neuron.

[49]  H. Scheich,et al.  Multisensory processing via early cortical stages: Connections of the primary auditory cortical field with other sensory systems , 2006, Neuroscience.

[50]  Hitten P. Zaveri,et al.  On the use of bipolar montages for time-series analysis of intracranial electroencephalograms , 2006, Clinical Neurophysiology.

[51]  F. R. Nodal,et al.  Physiological and Anatomical Evidence for Multisensory Interactions in Auditory Cortex , 2006, Cerebral cortex.

[52]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[53]  P. Barone,et al.  Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey , 2005, The European journal of neuroscience.

[54]  Stefan J Kiebel,et al.  Parametric analysis of oscillatory activity as measured with EEG/MEG , 2005, Human brain mapping.

[55]  H. Scheich,et al.  Nonauditory Events of a Behavioral Procedure Activate Auditory Cortex of Highly Trained Monkeys , 2005, The Journal of Neuroscience.

[56]  Marty G. Woldorff,et al.  Selective Attention and Multisensory Integration: Multiple Phases of Effects on the Evoked Brain Activity , 2005, Journal of Cognitive Neuroscience.

[57]  Joost X. Maier,et al.  Multisensory Integration of Dynamic Faces and Voices in Rhesus Monkey Auditory Cortex , 2005, The Journal of Neuroscience.

[58]  Brigitte Röder,et al.  Multisensory processing in the redundant-target effect: A behavioral and event-related potential study , 2005, Perception & psychophysics.

[59]  A. Fort,et al.  Bimodal speech: early suppressive visual effects in human auditory cortex , 2004, The European journal of neuroscience.

[60]  Kathleen S Rockland,et al.  Multisensory convergence in calcarine visual areas in macaque monkey. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[61]  R. Wennberg,et al.  Intracranial volume conduction of cortical spikes and sleep potentials recorded with deep brain stimulating electrodes , 2003, Clinical Neurophysiology.

[62]  John J. Foxe,et al.  Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. , 2002, Journal of neurophysiology.

[63]  H. Kennedy,et al.  Anatomical Evidence of Multimodal Integration in Primate Striate Cortex , 2002, The Journal of Neuroscience.

[64]  John J. Foxe,et al.  Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. , 2002, Brain research. Cognitive brain research.

[65]  S A Hillyard,et al.  An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. , 2002, Brain research. Cognitive brain research.

[66]  S. Iversen,et al.  Detection of Audio-Visual Integration Sites in Humans by Application of Electrophysiological Criteria to the BOLD Effect , 2001, NeuroImage.

[67]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[68]  C. Frith,et al.  Modulation of human visual cortex by crossmodal spatial attention. , 2000, Science.

[69]  G. Recanzone,et al.  Frequency and intensity response properties of single neurons in the auditory cortex of the behaving macaque monkey. , 2000, Journal of neurophysiology.

[70]  M. Giard,et al.  Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study , 1999, Journal of Cognitive Neuroscience.

[71]  B. Stein,et al.  The Merging of the Senses , 1993 .

[72]  B. Stein,et al.  Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.