Intermodal Auditory, Visual, and Tactile Attention Modulates Early Stages of Neural Processing

We used event-related potentials (ERPs) and gamma band oscillatory responses (GBRs) to examine whether intermodal attention operates early in the auditory, visual, and tactile modalities. To control for the effects of spatial attention, we spatially coregistered all stimuli and varied the attended modality across counterbalanced blocks in an intermodal selection task. In each block, participants selectively responded to either auditory, visual, or vibrotactile stimuli from the stream of intermodal events. Auditory and visual ERPs were modulated at the latencies of early cortical processing, but attention manifested later for tactile ERPs. For ERPs, auditory processing was modulated at the latency of the Na (29 msec), which indexes early cortical or thalamocortical processing and the subsequent P1 (90 msec) ERP components. Visual processing was modulated at the latency of the early phase of the C1 (62–72 msec) thought to be generated in the primary visual cortex and the subsequent P1 and N1 (176 msec). Tactile processing was modulated at the latency of the N160 (165 msec) likely generated in the secondary association cortex. Intermodal attention enhanced early sensory GBRs for all three modalities: auditory (onset 57 msec), visual (onset 47 msec), and tactile (onset 27 msec). Together, these results suggest that intermodal attention enhances neural processing relatively early in the sensory stream independent from differential effects of spatial and intramodal selective attention.

[1]  F. Perrin,et al.  Sequential mapping favours the hypothesis of distinct generators for Na and Pa middle latency auditory evoked potentials. , 1988, Electroencephalography and clinical neurophysiology.

[2]  G. Mangun,et al.  ERP and fMRI measures of visual spatial selective attention , 1998, Human brain mapping.

[3]  D Robertson,et al.  Differential enhancement of early and late components of the cerebral somatosensory evoked potentials during forced‐paced cognitive tasks in man , 1977, The Journal of physiology.

[4]  W. Sannita.  Stimulus-specific oscillatory responses of the brain: a time/frequency-related coding process , 2000, Clinical Neurophysiology.

[5]  Christoph S. Herrmann,et al.  Time-frequency analysis of target detection reveals an early interface between bottom-up and top-down processes in the gamma-band , 2006, NeuroImage.

[6]  Antigona Martínez,et al.  Source analysis of event-related cortical activity during visuo-spatial attention. , 2003, Cerebral cortex.

[7]  W G Sannita,et al.  Magnetically recorded oscillatory responses to luminance stimulation in man. , 1997, Electroencephalography and clinical neurophysiology.

[8]  H Hämäläinen,et al.  Human somatosensory evoked potentials to mechanical pulses and vibration: contributions of SI and SII somatosensory cortices to P50 and P100 components. , 1990, Electroencephalography and clinical neurophysiology.

[9]  J M Badier,et al.  Evoked potentials recorded from the auditory cortex in man: evaluation and topography of the middle latency components. , 1994, Electroencephalography and clinical neurophysiology.

[10]  S. Hillyard,et al.  Spatial Selective Attention Affects Early Extrastriate But Not Striate Components of the Visual Evoked Potential , 1996, Journal of Cognitive Neuroscience.

[11]  D. Barth,et al.  Cellular mechanisms of thalamically evoked gamma oscillations in auditory cortex. , 2001, Journal of neurophysiology.

[12]  T. Ogden,et al.  The oscillatory waves of the primate electroretinogram. , 1973, Vision research.

[13]  W. Freeman,et al.  Correlations between unit firing and EEG in the rat olfactory system , 1990, Brain Research.

[14]  Seppo P. Ahlfors,et al.  Biasing the brain’s attentional set: I. Cue driven deployments of intersensory selective attention , 2005, Experimental Brain Research.

[15]  T. Sejnowski,et al.  Dynamic Brain Sources of Visual Evoked Responses , 2002, Science.

[16]  S. Makeig,et al.  A 40-Hz auditory potential recorded from the human scalp. , 1981, Proceedings of the National Academy of Sciences of the United States of America.

[17]  J. Reynolds,et al.  Exogenous attentional selection of transparent superimposed surfaces modulates early event-related potentials , 2005, Vision Research.

[18]  W G Sannita,et al.  Phase-locked oscillatory approximately 15- to 30-Hz response to transient visual contrast stimulation: neuromagnetic evidence for cortical origin in humans. , 2003, NeuroImage.

[19]  Werner Lutzenberger,et al.  Reciprocal modulation of neuromagnetic induced gamma activity by attention in the human visual and auditory cortex , 2004, NeuroImage.

[20]  Ankoor S. Shah,et al.  An oscillatory hierarchy controlling neuronal excitability and stimulus processing in the auditory cortex. , 2005, Journal of neurophysiology.

[21]  John J. Foxe,et al.  Spatial attention modulates initial afferent activity in human primary visual cortex. , 2008, Cerebral cortex.

[22]  L Narici,et al.  Phase-locked oscillatory ∼15- to 30-hz response to transient visual contrast stimulation: neuromagnetic evidence for cortical origin in humans , 2003, NeuroImage.

[23]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[24]  G. V. Simpson,et al.  Flow of activation from V1 to frontal cortex in humans , 2001, Experimental Brain Research.

[25]  K. Reinikainen,et al.  Selective attention enhances the auditory 40-Hz transient response in humans , 1993, Nature.

[26]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[27]  Robert T. Knight,et al.  Prefrontal cortex gating of auditory transmission in humans , 1989, Brain Research.

[28]  Simon Hanslmayr,et al.  The best of both worlds: phase-reset of human EEG alpha activity and additive power contribute to ERP generation. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[29]  S. Whittaker,et al.  Origin of wavelets in the visual evoked potential. , 1983, Electroencephalography and clinical neurophysiology.

[30]  István Ulbert,et al.  Attention and arousal related modulation of spontaneous gamma-activity in the auditory cortex of the cat. , 2004, Brain research. Cognitive brain research.

[31]  F. Bloom,et al.  Modulation of early sensory processing in human auditory cortex during auditory selective attention. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[32]  M. Eimer,et al.  Modulations of early somatosensory ERP components by transient and sustained spatial attention , 2003, Experimental Brain Research.

[33]  John J. Foxe,et al.  Determinants and mechanisms of attentional modulation of neural processing. , 2001, Frontiers in bioscience : a journal and virtual library.

[34]  R. Oostenveld,et al.  Tactile Spatial Attention Enhances Gamma-Band Activity in Somatosensory Cortex and Reduces Low-Frequency Activity in Parieto-Occipital Areas , 2006, The Journal of Neuroscience.

[35]  Gregory V. Simpson,et al.  Biasing the brain’s attentional set: II. Effects of selective intersensory attentional deployments on subsequent sensory processing , 2005, Experimental Brain Research.

[36]  C. Schroeder,et al.  Intermodal selective attention in monkeys. I: distribution and timing of effects across visual areas. , 2000, Cerebral cortex.

[37]  Lars Kai Hansen,et al.  Proprioceptive evoked gamma oscillations , 2007, Brain Research.

[38]  Marzia Del Zotto,et al.  Inter-individual differences in the polarity of early visual responses and attention effects , 2007, Neuroscience Letters.

[39]  F. Lin,et al.  Onset timing of cross‐sensory activations and multisensory interactions in auditory and visual sensory cortices , 2010, The European journal of neuroscience.

[40]  C. Herrmann,et al.  Prestimulus EEG alpha activity reflects prestimulus top-down processing , 2007, Neuroscience Letters.

[41]  S. Hillyard,et al.  Delayed Striate Cortical Activation during Spatial Attention , 2002, Neuron.

[42]  K. Alho,et al.  Intermodal selective attention: evidence for processing in tonotopic auditory fields. , 1993, Psychophysiology.

[43]  T. Sejnowski,et al.  Electroencephalographic Brain Dynamics Following Manually Responded Visual Targets , 2004, PLoS biology.

[44]  F. Rösler,et al.  Crossmodal and intermodal attention modulate event-related brain potentials to tactile and auditory stimuli , 2002, Experimental Brain Research.

[45]  E. Schröger,et al.  ERP effects of intermodal attention and cross-modal links in spatial attention. , 1998, Psychophysiology.

[46]  Durk Talsma,et al.  Nonspatial intermodal selective attention is mediated by sensory brain areas: Evidence from event-related potentials , 2001 .

[47]  Jean Vroomen,et al.  The spatial constraint in intersensory pairing: no role in temporal ventriloquism. , 2006, Journal of experimental psychology. Human perception and performance.

[48]  F. Mauguière,et al.  Somatosensory responses during selective spatial attention: The N120‐to‐N140 trasition , 1995 .

[49]  D. Barth,et al.  Focal stimulation of the thalamic reticular nucleus induces focal gamma waves in cortex. , 1998, Journal of neurophysiology.

[50]  M. Berger,et al.  High Gamma Power Is Phase-Locked to Theta Oscillations in Human Neocortex , 2006, Science.

[51]  K. Alho,et al.  Processing of auditory stimuli during auditory and visual attention as revealed by event-related potentials. , 1994, Psychophysiology.

[52]  C. Schroeder,et al.  Intermodal selective attention in monkeys. II: physiological mechanisms of modulation. , 2000, Cerebral cortex.

[53]  Durk Talsma,et al.  Intermodal spatial attention differs between vision and audition: An event-related potential analysis , 2002 .

[54]  Claude Alain,et al.  Middle latency auditory evoked potentials to tones of different frequency , 1995, Hearing Research.

[55]  B R Rosen,et al.  Modulation of auditory and visual cortex by selective attention is modality-dependent. , 1996, Neuroreport.

[56]  S. Hillyard,et al.  Event-related brain potentials in the study of visual selective attention. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[57]  Martin Eimer,et al.  Crossmodal links in spatial attention between vision, audition, and touch: evidence from event-related brain potentials , 2001, Neuropsychologia.

[58]  Herrmann Christoph,et al.  Gamma amplitudes are coupled to theta phase in human EEG during visual perception , 2010 .

[59]  L. Kalaydjieva,et al.  Congenital cataracts facial dysmorphism neuropathy syndrome, a novel complex genetic disease in Balkan gypsies: Clinical and electrophysiological observations , 1999, Annals of neurology.

[60]  P. Michie,et al.  The effects of spatial selective attention on the somatosensory event-related potential. , 1987, Psychophysiology.

[61]  W. Klimesch,et al.  Event-related phase reorganization may explain evoked neural dynamics , 2007, Neuroscience & Biobehavioral Reviews.

[62]  S Makeig,et al.  Human auditory evoked gamma-band magnetic fields. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[63]  Donald O. Walter,et al.  Mass action in the nervous system , 1975 .