The temporal reliability of sound modulates visual detection: An event-related potential study

Utilizing the high temporal resolution of event-related potentials (ERPs), we examined the effects of temporal reliability of sounds on visual detection. Significantly faster reaction times to visual target stimuli were observed when reliable temporal information was provided by a task-irrelevant auditory stimulus. Three main ERP components related to the effects of auditory temporal reliability were found: the first at 180-240 ms over a wide central area, the second at 300-400 ms over an anterior area, and the third at 300-380 ms over bilateral temporal areas. Our results support the hypothesis that temporal reliability affects visual detection and indicate that auditory facilitation of visual detection is partly due to spread of attention and thus results from implicit temporal linking of auditory and visual information at a relatively late processing stage.

[1]  Sarah E Donohue,et al.  The Cross-Modal Spread of Attention Reveals Differential Constraints for the Temporal and Spatial Linking of Visual and Auditory Stimulus Events , 2011, The Journal of Neuroscience.

[2]  M. Giard,et al.  Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study , 1999, Journal of Cognitive Neuroscience.

[3]  C. Price,et al.  The role of the posterior superior temporal sulcus in audiovisual processing. , 2008, Cerebral cortex.

[4]  N. Bruneau,et al.  Cross-modal processing of auditory–visual stimuli in a no-task paradigm: A topographic event-related potential study , 2008, Clinical Neurophysiology.

[5]  Marty G. Woldorff,et al.  Selective Attention and Multisensory Integration: Multiple Phases of Effects on the Evoked Brain Activity , 2005, Journal of Cognitive Neuroscience.

[6]  B. Stein,et al.  Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  M. Woldorff,et al.  Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? , 2006, Cerebral cortex.

[8]  Michael T. Lippert,et al.  Improvement of visual contrast detection by a simultaneous sound , 2007, Brain Research.

[9]  Isabelle Peretz,et al.  Steady-state evoked potentials as an index of multisensory temporal binding , 2012, NeuroImage.

[10]  R. Näätänen,et al.  Early selective-attention effect on evoked potential reinterpreted. , 1978, Acta psychologica.

[11]  S. Hillyard,et al.  Involuntary orienting to sound improves visual perception , 2000, Nature.

[12]  Mikko Sams,et al.  Synchrony of audio–visual speech stimuli modulates left superior temporal sulcus , 2010, Neuroreport.

[13]  J. Qiu,et al.  The effect of visual reliability on auditory–visual integration: an event-related potential study , 2007, Neuroreport.

[14]  John J. Foxe,et al.  Dual mechanisms for the cross-sensory spread of attention: how much do learned associations matter? , 2010, Cerebral cortex.

[15]  H. Semlitsch,et al.  A solution for reliable and valid reduction of ocular artifacts, applied to the P300 ERP. , 1986, Psychophysiology.

[16]  S. Hillyard,et al.  Endogenous brain potentials associated with selective auditory attention. , 1980, Electroencephalography and clinical neurophysiology.

[17]  E. Schröger,et al.  Speeded responses to audiovisual signal changes result from bimodal integration. , 1998, Psychophysiology.

[18]  Xiaoyu Tang,et al.  Effects of Auditory Stimuli in the Horizontal Plane on Audiovisual Integration: An Event-Related Potential Study , 2013, PloS one.

[19]  C. Spence,et al.  Multisensory Integration: Maintaining the Perception of Synchrony , 2003, Current Biology.

[20]  N. Bolognini,et al.  Enhancement of visual perception by crossmodal visuo-auditory interaction , 2002, Experimental Brain Research.

[21]  S A Hillyard,et al.  An analysis of audio-visual crossmodal integration by means of event-related potential (ERP) recordings. , 2002, Brain research. Cognitive brain research.

[22]  K. Crowley,et al.  A review of the evidence for P2 being an independent component process: age, sleep and modality , 2004, Clinical Neurophysiology.

[23]  John J. Foxe,et al.  Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. , 2002, Brain research. Cognitive brain research.

[24]  L. Busse,et al.  The spread of attention across modalities and space in a multisensory object. , 2005, Proceedings of the National Academy of Sciences of the United States of America.