Cross-modal orienting of visual attention

This article reviews a series of experiments that combined behavioral and electrophysiological recording techniques to explore the hypothesis that salient sounds attract attention automatically and facilitate the processing of visual stimuli at the sound's location. This cross-modal capture of visual attention was found to occur even when the attracting sound was irrelevant to the ongoing task and was non-predictive of subsequent events. A slow positive component in the event-related potential (ERP) that was localized to the visual cortex was found to be closely coupled with the orienting of visual attention to a sound's location. This neural sign of visual cortex activation was predictive of enhanced perceptual processing and was paralleled by a desynchronization (blocking) of the ongoing occipital alpha rhythm. Further research is needed to determine the nature of the relationship between the slow positive ERP evoked by the sound and the alpha desynchronization and to understand how these electrophysiological processes contribute to improved visual-perceptual processing.

[1]  G. R Mangun,et al.  Shifting visual attention in space: an electrophysiological analysis using high spatial resolution mapping , 2000, Clinical Neurophysiology.

[2]  J. Vroomen,et al.  Electrophysiological evidence for speech-specific audiovisual integration , 2014, Neuropsychologia.

[3]  C. Miniussi,et al.  The Functional Importance of Rhythmic Activity in the Brain , 2012, Current Biology.

[4]  John J. Foxe,et al.  Increases in alpha oscillatory power reflect an active retinotopic mechanism for distracter suppression during sustained visuospatial attention. , 2006, Journal of neurophysiology.

[5]  G. V. Simpson,et al.  Anticipatory Biasing of Visuospatial Attention Indexed by Retinotopically Specific α-Bank Electroencephalography Increases over Occipital Cortex , 2000, The Journal of Neuroscience.

[6]  Viola S. Störmer,et al.  Sounds Activate Visual Cortex and Improve Visual Discrimination , 2014, The Journal of Neuroscience.

[7]  D. Bavelier,et al.  Components of visual prior entry , 2003, Cognitive Psychology.

[8]  Roshan Cools,et al.  Region-specific modulations in oscillatory alpha activity serve to facilitate processing in the visual and auditory modalities , 2014, NeuroImage.

[9]  J. Schwartz,et al.  A possible neurophysiological correlate of audiovisual binding and unbinding in speech perception , 2014, Front. Psychol..

[10]  J. Schoffelen,et al.  Dissociated α-band modulations in the dorsal and ventral visual pathways in visuospatial attention and perception. , 2014, Cerebral cortex.

[11]  C. Spence,et al.  Visual Prior Entry , 2001, Psychological science.

[12]  Viola S. Störmer,et al.  Cross-Modal Spatial Cueing of Attention Influences Visual Perception , 2012 .

[13]  Robert Sekuler,et al.  Attention-modulated Alpha-band Oscillations Protect against Intrusion of Irrelevant Information , 2013, Journal of Cognitive Neuroscience.

[14]  Antígona Martínez,et al.  Salient, Irrelevant Sounds Reflexively Induce Alpha Rhythm Desynchronization in Parallel with Slow Potential Shifts in Visual Cortex , 2016, Journal of Cognitive Neuroscience.

[15]  Simon Hanslmayr,et al.  Prestimulus oscillations predict visual perception performance between and within subjects , 2007, NeuroImage.

[16]  André Dufour,et al.  Importance of attentional mechanisms in audiovisual links , 1999, Experimental Brain Research.

[17]  K. Schneider,et al.  Attention biases decisions but does not alter appearance. , 2008, Journal of vision.

[18]  William Prinzmetal,et al.  Involuntary Attention and Brightness Contrast , 2022 .

[19]  C. Spence,et al.  The Handbook of Multisensory Processing , 2004 .

[20]  W. James,et al.  The Principles of Psychology. , 1983 .

[21]  O. Andreassen,et al.  Mice Deficient in Cellular Glutathione Peroxidase Show Increased Vulnerability to Malonate, 3-Nitropropionic Acid, and 1-Methyl-4-Phenyl-1,2,5,6-Tetrahydropyridine , 2000, The Journal of Neuroscience.

[22]  T. Sejnowski,et al.  Early Cross-Modal Interactions in Auditory and Visual Cortex Underlie a Sound-Induced Visual Illusion , 2007, The Journal of Neuroscience.

[23]  Viola S. Störmer,et al.  Tracking the voluntary control of auditory spatial attention with event-related brain potentials. , 2009, Psychophysiology.

[24]  C. Spence,et al.  Crossmodal Space and Crossmodal Attention , 2004 .

[25]  Steven L. Miller,et al.  Neural Processes Involved in Directing Attention , 1989, Journal of Cognitive Neuroscience.

[26]  M. Carrasco,et al.  Attention alters appearance , 2004, Nature Neuroscience.

[27]  N. Bolognini,et al.  Enhancement of visual perception by crossmodal visuo-auditory interaction , 2002, Experimental Brain Research.

[28]  S Shimojo,et al.  Orienting a spatial attention--its reflexive, compensatory, and voluntary mechanisms. , 1996, Brain research. Cognitive brain research.

[29]  Ole Jensen,et al.  Alpha Oscillations Correlate with the Successful Inhibition of Unattended Stimuli , 2011, Journal of Cognitive Neuroscience.

[30]  S. Shimojo,et al.  Illusions: What you see is what you hear , 2000, Nature.

[31]  Jon Driver,et al.  Crossmodal Spatial Attention: Evidence from Human Performance , 2004 .

[32]  S. Hillyard,et al.  Intra-modal and cross-modal spatial attention to auditory and visual stimuli. An event-related brain potential study. , 1999, Brain research. Cognitive brain research.

[33]  Á. Pascual-Leone,et al.  α-Band Electroencephalographic Activity over Occipital Cortex Indexes Visuospatial Attention Bias and Predicts Visual Target Detection , 2006, The Journal of Neuroscience.

[34]  T. Ergenoğlu,et al.  Alpha rhythm of the EEG modulates visual detection performance in humans. , 2004, Brain research. Cognitive brain research.

[35]  Martin Eimer,et al.  Temporal dynamics of lateralized ERP components elicited during endogenous attentional shifts to relevant tactile events. , 2002, Psychophysiology.

[36]  Micah M. Murray,et al.  The Neural Bases of Multisensory Processes , 2011 .

[37]  E. Schröger,et al.  ERP effects of intermodal attention and cross-modal links in spatial attention. , 1998, Psychophysiology.

[38]  C. Spence,et al.  Crossmodal attentional capture in an unspeeded simultaneity judgement task , 2008 .

[39]  O. Hikosaka,et al.  Visual Motion Sensation Yielded by Non-visually Driven Attention , 1997, Vision Research.

[40]  W. Klimesch.  Alpha-band oscillations, attention, and controlled access to stored information , 2012, Trends in Cognitive Sciences.

[41]  J. Driver,et al.  Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments , 2008, Neuron.

[42]  John J. McDonald,et al.  Isolating event-related potential components associated with voluntary control of visuo-spatial attention , 2008, Brain Research.

[43]  S. Hillyard,et al.  Involuntary orienting to sound improves visual perception , 2000, Nature.

[44]  Viola S. Störmer,et al.  Cross-modal cueing of attention alters appearance and early cortical processing of visual stimuli , 2009, Proceedings of the National Academy of Sciences.

[45]  S. Hillyard,et al.  Neural Basis of the Ventriloquist Illusion , 2007, Current Biology.

[46]  M. Gazzaniga,et al.  Combined spatial and temporal imaging of brain activity during visual selective attention in humans , 1994, Nature.

[47]  John J. McDonald,et al.  Control mechanisms mediating shifts of attention in auditory and visual space: a spatio-temporal ERP analysis , 2005, Experimental Brain Research.

[48]  S. Hillyard,et al.  Neural basis of auditory-induced shifts in visual time-order perception , 2005, Nature Neuroscience.

[49]  Ole Jensen,et al.  Frontal Eye Fields Control Attentional Modulation of Alpha and Gamma Oscillations in Contralateral Occipitoparietal Cortex , 2015, The Journal of Neuroscience.

[50]  Jessica J. Green,et al.  The role of temporal predictability in the anticipatory biasing of sensory cortex during visuospatial shifts of attention. , 2010, Psychophysiology.

[51]  Simon Hanslmayr,et al.  The role of alpha oscillations in temporal attention , 2011, Brain Research Reviews.

[52]  K. Nakayama,et al.  Sustained and transient components of focal visual attention , 1989, Vision Research.

[53]  Viola S. Störmer,et al.  Salient Sounds Activate Human Visual Cortex Automatically , 2013, The Journal of Neuroscience.

[54]  John J. Foxe,et al.  The Role of Alpha-Band Brain Oscillations as a Sensory Suppression Mechanism during Selective Attention , 2011, Front. Psychology.

[55]  Zhe Qu,et al.  Earliest stages of visual cortical processing are not modified by attentional load , 2014, Human brain mapping.

[56]  O. Jensen,et al.  Shaping Functional Architecture by Oscillatory Alpha Activity: Gating by Inhibition , 2010, Front. Hum. Neurosci..

[57]  Viola S. Störmer,et al.  Involuntary Cross-Modal Spatial Attention Influences Visual Perception , 2014 .

[58]  O. Jensen,et al.  Asymmetric Amplitude Modulations of Brain Oscillations Generate Slow Evoked Responses , 2008, The Journal of Neuroscience.

[59]  S. Luck,et al.  The Oxford handbook of event-related potential components , 2011 .

[60]  Y. Yen,et al.  Deactivation of Sensory-Specific Cortex by Cross-Modal Stimuli , 2002, Journal of Cognitive Neuroscience.

[61]  W. Medendorp,et al.  Modulations in oscillatory activity with amplitude asymmetry can produce cognitively relevant event-related responses , 2009, Proceedings of the National Academy of Sciences.

[62]  Claudia Freigang,et al.  Position of acoustic stimulus modulates visual &agr; activity , 2014, Neuroreport.

[63]  J. Schoffelen,et al.  Prestimulus Oscillatory Activity in the Alpha Band Predicts Visual Discrimination Ability , 2008, The Journal of Neuroscience.

[64]  Steven A. Hillyard,et al.  Neural Substrates of Perceptual Enhancement by Cross-Modal Spatial Attention , 2003, Journal of Cognitive Neuroscience.