Coupling between Theta Oscillations and Cognitive Control Network during Cross-Modal Visual and Auditory Attention: Supramodal vs Modality-Specific Mechanisms

Cortical theta band oscillations (4–8 Hz) in EEG signals have been shown to be important for a variety of different cognitive control operations in visual attention paradigms. However the synchronization source of these signals as defined by fMRI BOLD activity and the extent to which theta oscillations play a role in multimodal attention remains unknown. Here we investigated the extent to which cross-modal visual and auditory attention impacts theta oscillations. Using a simultaneous EEG-fMRI paradigm, healthy human participants performed an attentional vigilance task with six cross-modal conditions using naturalistic stimuli. To assess supramodal mechanisms, modulation of theta oscillation amplitude for attention to either visual or auditory stimuli was correlated with BOLD activity by conjunction analysis. Negative correlation was localized to cortical regions associated with the default mode network and positively with ventral premotor areas. Modality-associated attention to visual stimuli was marked by a positive correlation of theta and BOLD activity in fronto-parietal area that was not observed in the auditory condition. A positive correlation of theta and BOLD activity was observed in auditory cortex, while a negative correlation of theta and BOLD activity was observed in visual cortex during auditory attention. The data support a supramodal interaction of theta activity with of DMN function, and modality-associated processes within fronto-parietal networks related to top-down theta related cognitive control in cross-modal visual attention. On the other hand, in sensory cortices there are opposing effects of theta activity during cross-modal auditory attention.

[1]  René J. Huster,et al.  Auditory Event-Related Response in Visual Cortex Modulates Subsequent Visual Responses in Humans , 2011, The Journal of Neuroscience.

[2]  John J. Foxe,et al.  Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. , 2004, Cerebral cortex.

[3]  R. Desimone.  Visual attention mediated by biased competition in extrastriate visual cortex. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[4]  Eugenio Rodriguez,et al.  Neural synchrony and the development of cortical networks , 2010, Trends in Cognitive Sciences.

[5]  M. Frank,et al.  Frontal theta as a mechanism for cognitive control , 2014, Trends in Cognitive Sciences.

[6]  H. Cui,et al.  Spatio-temporal measures of electrophysiological correlates for behavioral multisensory enhancement during visual, auditory and somatosensory stimulation: A behavioral and ERP study , 2013, Neuroscience Bulletin.

[7]  G. Buzsáki,et al.  Neuronal Oscillations in Cortical Networks , 2004, Science.

[8]  Rami K. Niazy,et al.  Removal of FMRI environment artifacts from EEG data using optimal basis sets , 2005, NeuroImage.

[9]  W. Penfield,et al.  THE BRAIN'S RECORD OF AUDITORY AND VISUAL EXPERIENCE. A FINAL SUMMARY AND DISCUSSION. , 1963, Brain : a journal of neurology.

[10]  EEG signatures of auditory activity correlate with simultaneously recorded fMRI responses in humans , 2010, NeuroImage.

[11]  T. Stanford,et al.  Multisensory integration: current issues from the perspective of the single neuron , 2008, Nature Reviews Neuroscience.

[12]  L. Mo,et al.  Multisensory Competition Is Modulated by Sensory Pathway Interactions with Fronto-Sensorimotor and Default-Mode Network Regions , 2015, The Journal of Neuroscience.

[13]  Robert Oostenveld,et al.  Trial-by-trial coupling between EEG and BOLD identifies networks related to alpha and theta EEG power increases during working memory maintenance , 2009, NeuroImage.

[14]  Scott T. Grafton,et al.  Response to Comment on "Wandering Minds: The Default Network and Stimulus-Independent Thought" , 2007, Science.

[15]  Stefan Everling,et al.  A long-range fronto-parietal 5- to 10-Hz network predicts "top-down" controlled guidance in a task-switch paradigm. , 2014, Cerebral cortex.

[16]  M. Brass,et al.  The role of the frontal cortex in task preparation. , 2002, Cerebral cortex.

[17]  Deborah A Barany,et al.  Feature Interactions Enable Decoding of Sensorimotor Transformations for Goal-Directed Movement , 2014, The Journal of Neuroscience.

[18]  Mingzhou Ding,et al.  Coupling between visual alpha oscillations and default mode activity , 2013, NeuroImage.

[19]  Kensuke Kawai,et al.  Dissociated Roles of the Inferior Frontal Gyrus and Superior Temporal Sulcus in Audiovisual Processing: Top-Down and Bottom-Up Mismatch Detection , 2015, PloS one.

[20]  Leslie G. Ungerleider,et al.  Mechanisms of visual attention in the human cortex. , 2000, Annual review of neuroscience.

[21]  B. Stein,et al.  Interactions among converging sensory inputs in the superior colliculus. , 1983, Science.

[22]  Michael X. Cohen,et al.  Midfrontal conflict-related theta-band power reflects neural oscillations that predict behavior. , 2013, Journal of neurophysiology.

[23]  M. Corbetta,et al.  Spatial neglect and attention networks. , 2011, Annual review of neuroscience.

[24]  S. Yantis,et al.  Control of Attention Shifts between Vision and Audition in Human Cortex , 2004, The Journal of Neuroscience.

[25]  M. Raichle,et al.  Searching for a baseline: Functional imaging and the resting human brain , 2001, Nature Reviews Neuroscience.

[26]  P. Fries.  A mechanism for cognitive dynamics: neuronal communication through neuronal coherence , 2005, Trends in Cognitive Sciences.

[27]  K. Bäuml,et al.  The Relationship between Brain Oscillations and BOLD Signal during Memory Formation: A Combined EEG–fMRI Study , 2011, The Journal of Neuroscience.

[28]  W. Singer.  Cortical dynamics revisited , 2013, Trends in Cognitive Sciences.

[29]  Andrew Meade,et al.  Detecting Regular Sound Changes in Linguistics as Events of Concerted Evolution , 2015, Current Biology.

[30]  O. Hikosaka,et al.  Perceptual Learning, Motor Learning and Automaticity Switching from Automatic to Controlled Behavior: Cortico-basal Ganglia Mechanisms , 2022 .

[31]  M. Posner,et al.  The attention system of the human brain: 20 years after. , 2012, Annual review of neuroscience.

[32]  Marcia Grabowecky,et al.  Object-based auditory facilitation of visual search for pictures and words with frequent and rare targets. , 2011, Acta psychologica.

[33]  Jon Driver,et al.  Cross-Modal Interactions between Audition, Touch, and Vision in Endogenous Spatial Attention: ERP Evidence on Preparatory States and Sensory Modulations , 2002, Journal of Cognitive Neuroscience.

[34]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[35]  György Buzsáki,et al.  Neural Syntax: Cell Assemblies, Synapsembles, and Readers , 2010, Neuron.

[36]  Byoung-Kyong Min,et al.  Task-related modulation of anterior theta and posterior alpha EEG reflects top-down preparation , 2010, BMC Neuroscience.

[37]  J. G. Snodgrass,et al.  A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity. , 1980, Journal of experimental psychology. Human learning and memory.

[38]  Leslie G. Ungerleider,et al.  Neuroimaging Studies of Attention: From Modulation of Sensory Processing to Top-Down Control , 2003, The Journal of Neuroscience.

[39]  S. Bressler,et al.  Large-scale brain networks in cognition: emerging methods and principles , 2010, Trends in Cognitive Sciences.

[40]  Justin L. Vincent,et al.  Distinct brain networks for adaptive and stable task control in humans , 2007, Proceedings of the National Academy of Sciences.

[41]  Charles Spence.  Crossmodal attention , 1998, Scholarpedia.

[42]  Joerg F. Hipp,et al.  BOLD fMRI Correlation Reflects Frequency-Specific Neuronal Correlation , 2015, Current Biology.

[43]  Robert Turner,et al.  A Method for Removing Imaging Artifact from Continuous EEG Recorded during Functional MRI , 2000, NeuroImage.

[44]  Viola S. Störmer,et al.  Cross-Modal Spatial Cueing of Attention Influences Visual Perception , 2012 .

[45]  John J. Foxe,et al.  Crossmodal binding through neural coherence: implications for multisensory processing , 2008, Trends in Neurosciences.

[46]  L. Hu,et al.  Dynamic characteristics of multisensory facilitation and inhibition , 2012, Cognitive Neurodynamics.

[47]  T. Hendler,et al.  Never Resting Brain: Simultaneous Representation of Two Alpha Related Processes in Humans , 2008, PloS one.

[48]  A. Engel,et al.  Single-trial EEG–fMRI reveals the dynamics of cognitive function , 2006, Trends in Cognitive Sciences.