Selective Attention Gates the Interactive Crossmodal Coupling between Perceptual Systems

Sensory cortical systems often activate in parallel, even when stimulation is experienced through a single sensory modality [1-3]. Co-activations may reflect the interactive coupling between information-linked cortical systems or merely parallel but independent sensory processing. We report causal evidence consistent with the hypothesis that human somatosensory cortex (S1), which co-activates with auditory cortex during the processing of vibrations and textures [4-9], interactively couples to cortical systems that support auditory perception. In a series of behavioral experiments, we used transcranial magnetic stimulation (TMS) to probe interactions between the somatosensory and auditory perceptual systems as we manipulated attention state. Acute TMS over S1 impairs auditory frequency perception when subjects simultaneously attend to auditory and tactile frequency, but not when attention is directed to audition alone. Auditory frequency perception is unaffected by TMS over visual cortex, thus confirming the privileged interactions between the somatosensory and auditory systems in temporal frequency processing [10-13]. Our results provide a key demonstration that selective attention can modulate the functional properties of cortical systems thought to support specific sensory modalities. The gating of crossmodal coupling by selective attention may critically support multisensory interactions and feature-specific perception.

[1]  G. Deco,et al.  Multisensory contributions to the perception of vibrotactile events , 2009, Behavioural Brain Research.

[2]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[3]  Reza Shadmehr,et al.  TMS Perturbs Saccade Trajectories and Unmasks an Internal Feedback Controller for Saccades , 2011, The Journal of Neuroscience.

[4]  Georg v. Békésy,et al.  Sensations on the Skin Similar to Directional Hearing, Beats, and Harmonics of the Ear , 1957 .

[5]  J. F. Dammann,et al.  Temporal Frequency Channels Are Linked across Audition and Touch , 2009, Current Biology.

[6]  Ranulfo Romo,et al.  A Neural Parametric Code for Storing Information of More than One Sensory Modality in Working Memory , 2016, Neuron.

[7]  Sven Bestmann,et al.  Annals of the New York Academy of Sciences Combined Neurostimulation and Neuroimaging in Cognitive Neuroscience: Past, Present, and Future , 2022 .

[8]  Dora E Angelaki,et al.  Dissecting neural circuits for multisensory integration and crossmodal processing , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[9]  L. Busse,et al.  The spread of attention across modalities and space in a multisensory object. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[10]  P. Haggard,et al.  Transcranial magnetic stimulation over human secondary somatosensory cortex disrupts perception of pain intensity , 2013, Cortex.

[11]  Jeffrey M. Yau,et al.  Separate Mechanisms for Audio-Tactile Pitch and Loudness Interactions , 2010, Front. Psychology.

[12]  John J. Foxe,et al.  Multisensory contributions to low-level, ‘unisensory’ processing , 2005, Current Opinion in Neurobiology.

[13]  Katsuyuki Sakai,et al.  Task-specific signal transmission from prefrontal cortex in visual selective attention , 2009, Nature Neuroscience.

[14]  S. Rossi,et al.  Safety, ethical considerations, and application guidelines for the use of transcranial magnetic stimulation in clinical practice and research , 2009, Clinical Neurophysiology.

[15]  Yong-Di Zhou,et al.  Cooperative processing in primary somatosensory cortex and posterior parietal cortex during tactile working memory , 2015, The European journal of neuroscience.

[16]  Viola S. Störmer,et al.  Cross-modal cueing of attention alters appearance and early cortical processing of visual stimuli , 2009, Proceedings of the National Academy of Sciences.

[17]  Alexis Pérez-Bellido,et al.  Auditory Frequency Representations in Human Somatosensory Cortex , 2018, Cerebral cortex.

[18]  T. Sejnowski,et al.  Correlated neuronal activity and the flow of neural information , 2001, Nature Reviews Neuroscience.

[19]  Nicholas P. Holmes,et al.  Involvement of human primary somatosensory cortex in vibrotactile detection depends on task demand , 2016, NeuroImage.

[20]  Louis D Braida,et al.  Integration of auditory and vibrotactile stimuli: effects of frequency. , 2010, The Journal of the Acoustical Society of America.

[21]  P. Haggard,et al.  Viewing the body prepares the brain for touch: effects of TMS over somatosensory cortex , 2005, The European journal of neuroscience.

[22]  Riitta Hari,et al.  Touch activates human auditory cortex , 2006, NeuroImage.

[23]  John J. Foxe,et al.  Multisensory Representation of Frequency across Audition and Touch: High Density Electrical Mapping Reveals Early Sensory-Perceptual Coupling , 2012, The Journal of Neuroscience.

[24]  P. Fries A mechanism for cognitive dynamics: neuronal communication through neuronal coherence , 2005, Trends in Cognitive Sciences.

[25]  D. Senkowski,et al.  The multifaceted interplay between attention and multisensory integration , 2010, Trends in Cognitive Sciences.

[26]  M Seyal,et al.  Suppression of cutaneous perception by magnetic pulse stimulation of the human brain. , 1992, Electroencephalography and clinical neurophysiology.

[27]  Justin A. Harris,et al.  Transient Storage of a Tactile Memory Trace in Primary Somatosensory Cortex , 2002, The Journal of Neuroscience.

[28]  J. Andrew Pruszynski,et al.  BOLD Responses to Tactile Stimuli in Visual and Auditory Cortex Depend on the Frequency Content of Stimulation , 2012, Journal of Cognitive Neuroscience.

[29]  Ankoor S. Shah,et al.  Auditory Cortical Neurons Respond to Somatosensory Stimulation , 2003, The Journal of Neuroscience.

[30]  Tony Ro,et al.  A neural link between feeling and hearing. , 2013, Cerebral cortex.

[31]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[32]  Peter Lakatos,et al.  Dynamics of Active Sensing and perceptual selection , 2010, Current Opinion in Neurobiology.

[33]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[34]  Pablo Celnik,et al.  Feeling Better , 2014, Psychological science.

[35]  Timothy S Miles,et al.  Magnetic stimulation of motor and somatosensory cortices suppresses perception of ulnar nerve stimuli. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[36]  J. Driver,et al.  Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments , 2008, Neuron.

[37]  Istvan Ulbert,et al.  Sources of Somatosensory Input to the Caudal Belt Areas of Auditory Cortex , 2007, Perception.

[38]  G. Buzsáki,et al.  Neuronal Oscillations in Cortical Networks , 2004, Science.

[39]  M. Seyal,et al.  Suppression of spatial localization of a cutaneous stimulus following transcranial magnetic pulse stimulation of the sensorimotor cortex. , 1997, Electroencephalography and clinical neurophysiology.

[40]  N. Logothetis,et al.  Integration of Touch and Sound in Auditory Cortex , 2005, Neuron.

[41]  John J. Foxe,et al.  Crossmodal binding through neural coherence: implications for multisensory processing , 2008, Trends in Neurosciences.

[42]  John J. Foxe,et al.  Object‐based attention is multisensory: co‐activation of an object's representations in ignored sensory modalities , 2007, The European journal of neuroscience.

[43]  S. Cramer,et al.  Systematic assessment of training-induced changes in corticospinal output to hand using frameless stereotaxic transcranial magnetic stimulation , 2007, Nature Protocols.

[44]  C. Spence,et al.  Audiotactile interactions in temporal perception , 2011, Psychonomic bulletin & review.

[45]  John J. Foxe,et al.  Dual mechanisms for the cross-sensory spread of attention: how much do learned associations matter? , 2010, Cerebral cortex.

[46]  Steven A. Hillyard,et al.  Neural Substrates of Perceptual Enhancement by Cross-Modal Spatial Attention , 2003, Journal of Cognitive Neuroscience.

[47]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[48]  J. Kaiser,et al.  Human gamma-frequency oscillations associated with attention and memory , 2007, Trends in Neurosciences.

[49]  R. Andersen,et al.  Intentional maps in posterior parietal cortex. , 2002, Annual review of neuroscience.

[50]  Conrad V. Kufta,et al.  Attenuation in detection of somatosensory stimuli by transcranial magnetic stimulation. , 1991, Electroencephalography and clinical neurophysiology.

[51]  P. Roelfsema,et al.  The Distributed Nature of Working Memory , 2017, Trends in Cognitive Sciences.

[52]  P. Barone,et al.  Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey , 2005, The European journal of neuroscience.

[53]  Timothy D. Hanks,et al.  Perceptual Decision Making in Rodents, Monkeys, and Humans , 2017, Neuron.

[54]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[55]  Lexi E. Crommett,et al.  Auditory adaptation improves tactile frequency perception. , 2017, Journal of neurophysiology.

[56]  John J. Foxe,et al.  Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. , 2002, Journal of neurophysiology.

[57]  Yoko Hoshi,et al.  Co-activation of the secondary somatosensory and auditory cortices facilitates frequency discrimination of vibrotactile stimuli , 2007, Neuroscience.

[58]  Nadia Bolognini,et al.  Proprioceptive Alignment of Visual and Somatosensory Maps in the Posterior Parietal Cortex , 2007, Current Biology.