Cue–target onset asynchrony modulates interaction between exogenous attention and audiovisual integration

Previous studies have shown that exogenous attention decreases audiovisual integration (AVI); however, whether the interaction between exogenous attention and AVI is influenced by cue–target onset asynchrony (CTOA) remains unclear. To clarify this matter, twenty participants were recruited to perform an auditory/visual discrimination task, and they were instructed to respond to the target stimuli as rapidly and accurately as possible. The analysis of the mean response times showed an effective cueing effect under all cued conditions and significant response facilitation for all audiovisual stimuli. A further comparison of the differences between the probability of audiovisual cumulative distributive functions (CDFs) and race model CDFs showed that the AVI latency was shortened under the cued condition relative to that under the no-cue condition, and there was a significant break point when the CTOA was 200 ms, with a decrease in the AVI upon going from 100 to 200 ms and an increase upon going from 200 to 400 ms. These results indicated different mechanisms for the interaction between exogenous attention and the AVI under the shorter and longer CTOA conditions and further suggested that there may be a temporal window in which the AVI effect is mainly affected by exogenous attention, but the interaction might be interfered with by endogenous attention when exceeding the temporal window.

[1]  Jinglong Wu,et al.  Audiovisual Integration Delayed by Stimulus Onset Asynchrony Between Auditory and Visual Stimuli in Older Adults , 2017, Perception.

[2]  J. Navarra,et al.  Assessing automaticity in audiovisual speech integration: evidence from the speeded classification task , 2004, Cognition.

[3]  A. Diederich,et al.  Multisensory Interaction in Saccadic Reaction Time: A Time-Window-of-Integration Model , 2004, Journal of Cognitive Neuroscience.

[4]  Y. Tsal,et al.  Perceptual load as a major determinant of the locus of selection in visual attention , 1994, Perception & psychophysics.

[5]  B. Stein,et al.  The Merging of the Senses , 1993 .

[6]  R. Rafal,et al.  Competition between endogenous and exogenous orienting of visual attention. , 2005, Journal of experimental psychology. General.

[7]  M. Posner,et al.  Components of visual orienting , 1984 .

[8]  Jan Theeuwes,et al.  Endogenous and exogenous attention shifts are mediated by the same large-scale neural network , 2004, NeuroImage.

[9]  Justin L. Vincent,et al.  Spontaneous neuronal activity distinguishes human dorsal and ventral attention systems. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[10]  W. Schoene,et al.  Human Cerebral Malaria: A Pathological Study , 1987, Journal of neuropathology and experimental neurology.

[11]  M. Posner,et al.  The attention system of the human brain: 20 years after. , 2012, Annual review of neuroscience.

[12]  Paul J. Laurienti,et al.  Modality-specific selective attention attenuates multisensory integration , 2007, Experimental Brain Research.

[13]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[14]  D. Senkowski,et al.  The multifaceted interplay between attention and multisensory integration , 2010, Trends in Cognitive Sciences.

[15]  T. Stanford,et al.  Multisensory integration: current issues from the perspective of the single neuron , 2008, Nature Reviews Neuroscience.

[16]  C. Spence.  Crossmodal correspondences: A tutorial review , 2011, Attention, perception & psychophysics.

[17]  B. Stein,et al.  Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  S. van der Stigchel,et al.  Exogenous spatial attention decreases audiovisual integration , 2014, Attention, Perception, & Psychophysics.

[19]  J. Meyer-Lohmann,et al.  Recurrent inhibition of individual Ia inhibitory interneurones and disinhibition of their target α-motoneurones during muscle stretches , 1975, Experimental Brain Research.

[20]  Stefan Treue,et al.  Temporal dynamics of neuronal modulation during exogenous and endogenous shifts of visual attention in macaque area MT , 2008, Proceedings of the National Academy of Sciences.

[21]  T A Mondor,et al.  Effect of same- and different-modality spatial cues on auditory and visual target identification. , 1998, Journal of experimental psychology. Human perception and performance.

[22]  C. Spence,et al.  Attracting attention to the illusory location of a sound: reflexive crossmodal orienting and ventriloquism , 2000, Neuroreport.

[23]  B. Stein.  The new handbook of multisensory processes , 2012 .

[24]  I. Ohzawa,et al.  The effects of contrast on visual orientation and spatial frequency discrimination: a comparison of single cells and behavior. , 1987, Journal of neurophysiology.

[25]  M. Posner,et al.  The attention system of the human brain. , 1990, Annual review of neuroscience.

[26]  Jeff Miller,et al.  Timecourse of coactivation in bimodal divided attention , 1986, Perception & psychophysics.

[27]  A. Henik,et al.  Phasic alertness can modulate executive control by enhancing global processing of visual stimuli , 2011, Cognition.

[28]  David A. Bridwell,et al.  Interactions between endogenous and exogenous attention during vigilance , 2009, Attention, perception & psychophysics.

[29]  TalsmaDurk,et al.  Selective Attention and Multisensory Integration: Multiple Phases of Effects on the Evoked Brain Activity , 2005 .

[30]  Thomas U. Otto,et al.  Principles of Multisensory Behavior , 2013, The Journal of Neuroscience.

[31]  J. Theeuwes,et al.  Programming of endogenous and exogenous saccades: evidence for a competitive integration model. , 2002, Journal of experimental psychology. Human perception and performance.

[32]  Bettina Forster,et al.  Neural correlates of endogenous attention, exogenous attention and inhibition of return in touch , 2014, The European journal of neuroscience.

[33]  David Alais,et al.  Separate attentional resources for vision and audition , 2006, Proceedings of the Royal Society B: Biological Sciences.

[34]  Charles Spence,et al.  Multisensory warning signals: when spatial correspondence matters , 2009, Experimental Brain Research.

[35]  C. Spence.  Crossmodal spatial attention , 2010, Annals of the New York Academy of Sciences.

[36]  M. Wallace,et al.  Enhanced multisensory integration in older adults , 2006, Neurobiology of Aging.

[37]  S. Hillyard,et al.  Neural basis of auditory-induced shifts in visual time-order perception , 2005, Nature Neuroscience.

[38]  P. Tibbetts.  :Cognitive Neuroscience: The Biology of the Mind , 2009 .

[39]  C Decaestecker,et al.  Characterization of Astroglial Versus Oligodendroglial Phenotypes in Glioblastomas by Means of Quantitative Morphonuclear Variables Generated by Computer-assisted Microscopy , 1998, Journal of neuropathology and experimental neurology.

[40]  C Spence,et al.  On the relative contributions of multisensory integration and crossmodal exogenous spatial attention to multisensory response enhancement. , 2015, Acta psychologica.

[41]  Dingguo Gao,et al.  Interaction between endogenous and exogenous orienting in crossmodal attention. , 2012, Scandinavian journal of psychology.

[42]  Jinglong Wu,et al.  The interactions of multisensory integration with endogenous and exogenous attention , 2016, Neuroscience & Biobehavioral Reviews.

[43]  M. Gazzaniga,et al.  Cognitive Neuroscience: The Biology of the Mind , 1998 .

[44]  M. Woldorff,et al.  Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? , 2006, Cerebral cortex.

[45]  Attention to endogenous and exogenous cues affects auditory localization , 2013, Experimental Brain Research.

[46]  S. Hillyard,et al.  Involuntary orienting to sound improves visual perception , 2000, Nature.

[47]  P. Thompson,et al.  Human speed perception is contrast dependent , 1992, Vision Research.

[48]  D. M. Parker,et al.  Evoked potentials and reaction times to the offset and contrast reversal of sinusoidal gratings , 1982, Vision Research.

[49]  A. Diederich,et al.  Assessing age-related multisensory enhancement with the time-window-of-integration model , 2008, Neuropsychologia.

[50]  G. Crombez,et al.  Valid Cues for Auditory or Somatosensory Targets Affect Their Perception: A Signal Detection Approach , 2013, Perception.

[51]  Marty G. Woldorff,et al.  Selective Attention and Multisensory Integration: Multiple Phases of Effects on the Evoked Brain Activity , 2005, Journal of Cognitive Neuroscience.

[52]  C. Spence,et al.  Visually Induced Inhibition of Return Affects the Integration of Auditory and Visual Information , 2017, Perception.

[53]  Daniel Senkowski,et al.  Intermodal attention affects the processing of the temporal alignment of audiovisual stimuli , 2009, Experimental Brain Research.

[54]  D. Burr,et al.  Vision and Audition Do Not Share Attentional Resources in Sustained Tasks , 2011, Front. Psychology.

[55]  Jon Driver,et al.  Covert Spatial Orienting in Audition: Exogenous and Endogenous Mechanisms , 1994 .

[56]  Lindsey L. Glickfeld,et al.  Mouse Primary Visual Cortex Is Used to Detect Both Orientation and Contrast Changes , 2013, The Journal of Neuroscience.

[57]  Paolo Bartolomeo,et al.  The Attention Systems of the Human Brain , 2014 .

[58]  Jeff Miller,et al.  Divided attention: Evidence for coactivation with redundant signals , 1982, Cognitive Psychology.

[59]  S. Yantis.  3 Goal-Directed and Stimulus-Driven Determinants of Attentional Control , 2000 .