Neuro-Oscillatory Phase Alignment Drives Speeded Multisensory Response Times: An Electro-Corticographic Investigation

Even simple tasks rely on information exchange between functionally distinct and often relatively distant neuronal ensembles. Considerable work indicates oscillatory synchronization through phase alignment is a major agent of inter-regional communication. In the brain, different oscillatory phases correspond to low- and high-excitability states. Optimally aligned phases (or high-excitability states) promote inter-regional communication. Studies have also shown that sensory stimulation can modulate or reset the phase of ongoing cortical oscillations. For example, auditory stimuli can reset the phase of oscillations in visual cortex, influencing processing of a simultaneous visual stimulus. Such cross-regional phase reset represents a candidate mechanism for aligning oscillatory phase for inter-regional communication. Here, we explored the role of local and inter-regional phase alignment in driving a well established behavioral correlate of multisensory integration: the redundant target effect (RTE), which refers to the fact that responses to multisensory inputs are substantially faster than to unisensory stimuli. In a speeded detection task, human epileptic patients (N = 3) responded to unisensory (auditory or visual) and multisensory (audiovisual) stimuli with a button press, while electrocorticography was recorded over auditory and motor regions. Visual stimulation significantly modulated auditory activity via phase reset in the delta and theta bands. During the period between stimulation and subsequent motor response, transient synchronization between auditory and motor regions was observed. Phase synchrony to multisensory inputs was faster than to unisensory stimulation. This sensorimotor phase alignment correlated with behavior such that stronger synchrony was associated with faster responses, linking the commonly observed RTE with phase alignment across a sensorimotor network.

[1]  W. H. Dobelle,et al.  The topography and variability of the primary visual cortex in man. , 1974, Journal of neurosurgery.

[2]  Jeff Miller,et al.  Divided attention: Evidence for coactivation with redundant signals , 1982, Cognitive Psychology.

[3]  Olivier Bertrand,et al.  Scalp Current Density Mapping: Value and Estimation from Potential Data , 1987, IEEE Transactions on Biomedical Engineering.

[4]  P. Chauvel,et al.  Localization of the primary auditory area in man. , 1991, Brain : a journal of neurology.

[5]  A. Galaburda,et al.  Topographical variation of the human primary cortices: implications for neuroimaging, brain mapping, and neurobiology. , 1993, Cerebral cortex.

[6]  S. Bressler,et al.  Episodic multiregional cortical coherence at multiple frequencies during visual task performance , 1993, Nature.

[7]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[8]  J. Pernier,et al.  Stimulus Specificity of Phase-Locked and Non-Phase-Locked 40 Hz Visual Responses in Human , 1996, The Journal of Neuroscience.

[9]  D. Contreras,et al.  Synchronization of fast (30-40 Hz) spontaneous oscillations in intrathalamic and thalamocortical networks , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  E. Schröger,et al.  Speeded responses to audiovisual signal changes result from bimodal integration. , 1998, Psychophysiology.

[11]  R. Lesser,et al.  Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. I. Alpha and beta event-related desynchronization. , 1998, Brain : a journal of neurology.

[12]  Jürgen Kurths,et al.  Detection of n:m Phase Locking from Noisy Data: Application to Magnetoencephalography , 1998 .

[13]  B. Stein Neural mechanisms for synthesizing sensory information and producing adaptive behaviors , 1998, Experimental Brain Research.

[14]  R. Lesser,et al.  Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. II. Event-related synchronization in the gamma band. , 1998, Brain : a journal of neurology.

[15]  G. Ojemann,et al.  Increased gamma-range activity in human sensorimotor cortex during performance of visuomotor tasks , 1999, Clinical Neurophysiology.

[16]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[17]  J. E. Hind,et al.  Auditory cortex on the human posterior superior temporal gyrus , 2000, The Journal of comparative neurology.

[18]  John J. Foxe,et al.  Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. , 2000, Brain research. Cognitive brain research.

[19]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[20]  W. Singer,et al.  Dynamic predictions: Oscillations and synchrony in top–down processing , 2001, Nature Reviews Neuroscience.

[21]  G. V. Simpson,et al.  Flow of activation from V1 to frontal cortex in humans , 2001, Experimental Brain Research.

[22]  J. Martinerie,et al.  The brainweb: Phase synchronization and large-scale integration , 2001, Nature Reviews Neuroscience.

[23]  John J. Foxe,et al.  The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. , 2002, Brain research. Cognitive brain research.

[24]  John J. Foxe,et al.  Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. , 2002, Brain research. Cognitive brain research.

[25]  T. Sejnowski,et al.  Dynamic Brain Sources of Visual Evoked Responses , 2002, Science.

[26]  S A Hillyard,et al.  An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. , 2002, Brain research. Cognitive brain research.

[27]  John J. Foxe,et al.  Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. , 2002, Journal of neurophysiology.

[28]  R W Guillery,et al.  The role of the thalamus in the flow of information to the cortex. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[29]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[30]  Hiroshi Shibasaki,et al.  Distinct cortical areas for motor preparation and execution in human identified by Bereitschaftspotential recording and ECoG-EMG coherence analysis , 2003, Clinical Neurophysiology.

[31]  R. Reale,et al.  Functional connections between auditory cortex on Heschl's gyrus and on the lateral superior temporal gyrus in humans. , 2003, Journal of neurophysiology.

[32]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[33]  Ankoor S. Shah,et al.  Neural dynamics and the fundamental mechanisms of event-related brain potentials. , 2004, Cerebral cortex.

[34]  Blaise Yvert,et al.  Localization of human supratemporal auditory areas from intracerebral auditory evoked potentials using distributed source models , 2005, NeuroImage.

[35]  P. Fries A mechanism for cognitive dynamics: neuronal communication through neuronal coherence , 2005, Trends in Cognitive Sciences.

[36]  M. Berger,et al.  High gamma activity in response to deviant auditory stimuli recorded directly from human cortex. , 2005, Journal of neurophysiology.

[37]  Ankoor S. Shah,et al.  An oscillatory hierarchy controlling neuronal excitability and stimulus processing in the auditory cortex. , 2005, Journal of neurophysiology.

[38]  T. Stanford,et al.  Evaluating the Operations Underlying Multisensory Integration in the Cat Superior Colliculus , 2005, The Journal of Neuroscience.

[39]  John J. Foxe,et al.  Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. , 2005, Cerebral cortex.

[40]  Marty G. Woldorff,et al.  Selective Attention and Multisensory Integration: Multiple Phases of Effects on the Evoked Brain Activity , 2005, Journal of Cognitive Neuroscience.

[41]  T. Womelsdorf,et al.  Neuronal coherence during selective attentional processing and sensory–motor integration , 2006, Journal of Physiology-Paris.

[42]  John J. Foxe,et al.  Multisensory processing and oscillatory activity: analyzing non-linear electrophysiological measures in humans and simians , 2007, Experimental Brain Research.

[43]  John J. Foxe,et al.  Audio-visual multisensory integration in superior parietal lobule revealed by human intracranial recordings. , 2006, Journal of neurophysiology.

[44]  John J. Foxe,et al.  Oscillatory beta activity predicts response speed during a multisensory audiovisual reaction time task: a high-density electrical mapping study. , 2005, Cerebral cortex.

[45]  E. Miller,et al.  Top-Down Versus Bottom-Up Control of Attention in the Prefrontal and Posterior Parietal Cortices , 2007, Science.

[46]  W. Singer,et al.  Modulation of Neuronal Interactions Through Neuronal Synchronization , 2007, Science.

[47]  Patrick Chauvel,et al.  Evidence of functional connectivity between auditory cortical areas revealed by amplitude modulation sound processing. , 2007, Cerebral cortex.

[48]  Jean-Philippe Thiran,et al.  Multisensory interactions within human primary cortices revealed by BOLD dynamics. , 2007, Cerebral cortex.

[49]  O. Bertrand,et al.  Effects of Selective Attention on the Electrophysiological Representation of Concurrent Sounds in the Human Auditory Cortex , 2007, The Journal of Neuroscience.

[50]  J. Duhamel,et al.  Multisensory Integration in the Ventral Intraparietal Area of the Macaque Monkey , 2007, The Journal of Neuroscience.

[51]  L. Merabet,et al.  Occipital Transcranial Magnetic Stimulation Has Opposing Effects on Visual and Auditory Stimulus Detection: Implications for Multisensory Interactions , 2007, The Journal of Neuroscience.

[52]  C. Schroeder,et al.  Neuronal Oscillations and Multisensory Interaction in Primary Auditory Cortex , 2007, Neuron.

[53]  T. Sejnowski,et al.  Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion , 2007, The Journal of Neuroscience.

[54]  Xenophon Papademetris,et al.  More accurate Talairach coordinates for neuroimaging using non-linear registration , 2008, NeuroImage.

[55]  G. Karmos,et al.  Entrainment of Neuronal Oscillations as a Mechanism of Attentional Selection , 2008, Science.

[56]  Pejman Sehatpour,et al.  A human intracranial study of long-range oscillatory coherence across a frontal–occipital–hippocampal brain network during visual object processing , 2008, Proceedings of the National Academy of Sciences.

[57]  N. Logothetis,et al.  Visual modulation of neurons in auditory cortex. , 2008, Cerebral cortex.

[58]  Sidney S. Simon,et al.  Merging of the Senses , 2008, Front. Neurosci..

[59]  John J. Foxe,et al.  Spatial attention modulates initial afferent activity in human primary visual cortex. , 2008, Cerebral cortex.

[60]  Andreas Schulze-Bonhage,et al.  Movement related activity in the high gamma range of the human EEG , 2008, NeuroImage.

[61]  O. Bertrand,et al.  Visual Activation and Audiovisual Interactions in the Auditory Cortex during Speech Perception: Intracranial Recordings in Humans , 2008, The Journal of Neuroscience.

[62]  John J. Foxe,et al.  Changes in effective connectivity of human superior parietal lobule under multisensory and unisensory stimulation , 2008, The European journal of neuroscience.

[63]  D. Mathalon,et al.  Event-related EEG time-frequency analysis: an overview of measures and an analysis of early gamma band phase locking in schizophrenia. , 2008, Schizophrenia bulletin.

[64]  Philipp Berens,et al.  CircStat: AMATLABToolbox for Circular Statistics , 2009, Journal of Statistical Software.

[65]  Erik Edwards,et al.  Comparison of time-frequency responses and the event-related potential to auditory speech stimuli in human cortex. , 2009, Journal of neurophysiology.

[66]  E. Fetz,et al.  Decoupling the Cortical Power Spectrum Reveals Real-Time Representation of Individual Finger Movements in Humans , 2009, The Journal of Neuroscience.

[67]  R. VanRullen,et al.  The Phase of Ongoing EEG Oscillations Predicts Visual Perception , 2009, The Journal of Neuroscience.

[68]  R. Desimone,et al.  High-Frequency, Long-Range Coupling Between Prefrontal and Visual Cortex During Attention , 2009, Science.

[69]  C. Schroeder,et al.  The Leading Sense: Supramodal Control of Neurophysiological Context by Attention , 2009, Neuron.

[70]  Benjamin A Rowland,et al.  The Differing Impact of Multisensory and Unisensory Integration on Behavior , 2009, The Journal of Neuroscience.

[71]  N. Crone,et al.  Intracranial mapping of auditory perception: Event-related responses and electrocortical stimulation , 2009, Clinical Neurophysiology.

[72]  Juan R. Vidal,et al.  Category-Specific Visual Responses: An Intracranial Study Comparing Gamma, Beta, Alpha, and ERP Response Selectivity , 2010, Front. Hum. Neurosci..

[73]  B. Hangya,et al.  Phase Entrainment of Human Delta Oscillations Can Mediate the Effects of Expectation on Reaction Speed , 2010, The Journal of Neuroscience.

[74]  J. Palva,et al.  Neuronal synchrony reveals working memory networks and predicts individual memory capacity , 2010, Proceedings of the National Academy of Sciences.

[75]  F. Lin,et al.  Onset timing of cross‐sensory activations and multisensory interactions in auditory and visual sensory cortices , 2010, The European journal of neuroscience.

[76]  J. Theeuwes,et al.  Attention and the multiple stages of multisensory integration: A review of audiovisual studies. , 2010, Acta psychologica.

[77]  John J. Foxe,et al.  The development of audiovisual multisensory integration across childhood and early adolescence: a high-density electrical mapping study. , 2011, Cerebral cortex.

[78]  R. VanRullen,et al.  This Is the Rhythm of Your Eyes: The Phase of Ongoing Electroencephalogram Oscillations Modulates Saccadic Reaction Time , 2011, The Journal of Neuroscience.

[79]  John J. Foxe,et al.  Oscillatory Sensory Selection Mechanisms during Intersensory Attention to Rhythmic Auditory and Visual Inputs: A Human Electrocorticographic Investigation , 2011, The Journal of Neuroscience.

[80]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[81]  Marieke K. van Vugt,et al.  Spatially distributed patterns of oscillatory coupling between high-frequency amplitudes and low-frequency phases in human iEEG , 2011, NeuroImage.

[82]  John J. Foxe,et al.  Common or Redundant Neural Circuits for Duration Processing across Audition and Touch , 2011, The Journal of Neuroscience.

[83]  Andreas K. Engel,et al.  Oscillatory Synchronization in Large-Scale Cortical Networks Predicts Perception , 2011, Neuron.

[84]  John J. Foxe,et al.  Ready, Set, Reset: Stimulus-Locked Periodicity in Behavioral Performance Demonstrates the Consequences of Cross-Sensory Phase Reset , 2011, The Journal of Neuroscience.

[85]  S. Debener,et al.  Cross-Modal Phase Reset Predicts Auditory Task Performance in Humans , 2011, The Journal of Neuroscience.

[86]  David M. Groppe,et al.  Mass univariate analysis of event-related brain potentials/fields I: a critical tutorial review. , 2011, Psychophysiology.

[87]  Eric L. Denovellis,et al.  Synchronous Oscillatory Neural Ensembles for Rules in the Prefrontal Cortex , 2012, Neuron.

[88]  Thomas U. Otto,et al.  Noise and Correlations in Parallel Perceptual Decision Making , 2011, Current Biology.

[89]  Christoph Kayser,et al.  A Precluding But Not Ensuring Role of Entrained Low-Frequency Oscillations for Auditory Perception , 2012, The Journal of Neuroscience.

[90]  M. Kahana,et al.  Phase–Amplitude Coupling in Human Electrocorticography Is Spatially Distributed and Phase Diverse , 2012, The Journal of Neuroscience.

[91]  Nick F. Ramsey,et al.  Human Motor Cortical Activity Is Selectively Phase-Entrained on Underlying Rhythms , 2012, PLoS Comput. Biol..

[92]  Björn Herrmann,et al.  A Precluding Role of Low-Frequency Oscillations for Auditory Perception in a Continuous Processing Mode , 2012, The Journal of Neuroscience.

[93]  Gregor M. Hörzer,et al.  Theta coupling between V4 and prefrontal cortex predicts visual short-term memory performance , 2012, Nature Neuroscience.

[94]  J. Gross,et al.  Sounds Reset Rhythms of Visual Cortex and Corresponding Human Visual Perception , 2012, Current Biology.

[95]  Michael J. Jutras,et al.  Oscillatory activity in the monkey hippocampus during visual exploration and memory formation , 2013, Proceedings of the National Academy of Sciences.

[96]  Y. Saalmann,et al.  Rhythmic Sampling within and between Objects despite Sustained Attention at a Cued Location , 2013, Current Biology.

[97]  John J. Foxe,et al.  The development of multisensory integration in high-functioning autism: high-density electrical mapping and psychophysical measures reveal impairments in the processing of audiovisual inputs. , 2013, Cerebral cortex.

[98]  Manuel R. Mercier,et al.  Cortical cross-frequency coupling predicts perceptual outcomes , 2013, NeuroImage.

[99]  Manuel R. Mercier,et al.  Mapping phonemic processing zones along human perisylvian cortex: an electro-corticographic investigation , 2013, Brain Structure and Function.

[100]  Manuel R. Mercier,et al.  Auditory-driven phase reset in visual cortex: Human electrocorticography reveals mechanisms of early multisensory integration , 2013, NeuroImage.

[101]  Johanna Ruescher,et al.  Somatotopic mapping of natural upper- and lower-extremity movements and speech production with high gamma electrocorticography , 2013, NeuroImage.

[102]  M. Kahana,et al.  Synchronous and Asynchronous Theta and Gamma Activity during Episodic Memory Formation , 2013, The Journal of Neuroscience.

[103]  John J. Foxe,et al.  Propagating Neocortical Gamma Bursts Are Coordinated by Traveling Alpha Waves , 2013, The Journal of Neuroscience.

[104]  Gabriele Arnulfo,et al.  Phase and amplitude correlations in resting-state activity in human stereotactical EEG recordings , 2015, NeuroImage.

[105]  John J. Foxe,et al.  Oscillatory Recruitment of Bilateral Visual Cortex during Spatial Attention to Competing Rhythmic Inputs , 2015, The Journal of Neuroscience.

[106]  H. Kennedy,et al.  Visual Areas Exert Feedforward and Feedback Influences through Distinct Frequency Channels , 2014, Neuron.