The Attentional Window Modulates Capture by Audiovisual Events

Visual search is markedly improved when a target color change is synchronized with a spatially non-informative auditory signal. This “pip and pop” effect is an automatic process as even a distractor captures attention when accompanied by a tone. Previous studies investigating visual attention have indicated that automatic capture is susceptible to the size of the attentional window. The present study investigated whether the pip and pop effect is modulated by the extent to which participants divide their attention across the visual field We show that participants were better in detecting a synchronized audiovisual event when they divided their attention across the visual field relative to a condition in which they focused their attention. We argue that audiovisual capture is reduced under focused conditions relative to distributed settings.

[1]  D. Senkowski,et al.  The multifaceted interplay between attention and multisensory integration , 2010, Trends in Cognitive Sciences.

[2]  Jan Theeuwes,et al.  No capture outside the attentional window , 2010, Vision Research.

[3]  S. Yantis,et al.  Abrupt visual onsets and selective attention: voluntary versus automatic allocation. , 1990, Journal of experimental psychology. Human perception and performance.

[4]  Albert Costa,et al.  The size of an attentional window affects working memory guidance , 2010, Attention, perception & psychophysics.

[5]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[6]  J. Theeuwes Endogenous and Exogenous Control of Visual Selection , 1994, Perception.

[7]  Charles Spence,et al.  Multisensory cues capture spatial attention regardless of perceptual load. , 2007, Journal of experimental psychology. Human perception and performance.

[8]  E. Van der Burg,et al.  Audiovisual events capture attention: evidence from temporal order judgments. , 2008, Journal of vision.

[9]  M. Carrasco,et al.  The eccentricity effect: Target eccentricity affects performance on conjunction searches , 1995, Perception & psychophysics.

[10]  P. Mamassian,et al.  Multisensory processing in review: from physiology to behaviour. , 2010, Seeing and perceiving.

[11]  Richard L. McKinley,et al.  Aurally Aided Visual Search under Virtual and Free-Field Listening Conditions , 1996, Hum. Factors.

[12]  L. Busse,et al.  The spread of attention across modalities and space in a multisensory object. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[13]  J. Theeuwes Top-down and bottom-up control of visual selection. , 2010, Acta psychologica.

[14]  L. Shams,et al.  Crossmodal influences on visual perception. , 2010, Physics of life reviews.

[15]  Jean Vroomen,et al.  Sound can improve visual search in developmental dyslexia , 2011, Experimental Brain Research.

[16]  Jan Theeuwes,et al.  The size of an attentional window modulates attentional capture by color singletons , 2007, Psychonomic bulletin & review.

[17]  J. Theeuwes Stimulus-driven capture and attentional set: selective search for color and visual abrupt onsets. , 1994, Journal of experimental psychology. Human perception and performance.

[18]  J. C. Johnston,et al.  On the locus of visual selection: evidence from focused attention tasks. , 1990, Journal of experimental psychology. Human perception and performance.

[19]  Jan Theeuwes,et al.  Efficient Visual Search from Synchronized Auditory Signals Requires Transient Audiovisual Events , 2010, PloS one.

[20]  Jan Theeuwes,et al.  Early multisensory interactions affect the competition among multiple visual objects , 2011, NeuroImage.

[21]  J. Driver Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading , 1996, Nature.

[22]  J. Driver,et al.  Audiovisual links in endogenous covert spatial attention. , 1996, Journal of experimental psychology. Human perception and performance.

[23]  J. Theeuwes Exogenous and endogenous control of attention: The effect of visual onsets and offsets , 1991, Perception & psychophysics.

[24]  J. Vroomen,et al.  Sound enhances visual perception: cross-modal effects of auditory organization on vision. , 2000, Journal of experimental psychology. Human perception and performance.

[25]  Jan Theeuwes,et al.  Audiovisual semantic interference and attention: evidence from the attentional blink paradigm. , 2010, Acta psychologica.

[26]  J. Theeuwes Perceptual selectivity for color and form , 1992, Perception & psychophysics.

[27]  J. Theeuwes,et al.  Poke and pop: Tactile–visual synchrony increases visual saliency , 2009, Neuroscience Letters.

[28]  S. Yantis,et al.  Abrupt visual onsets and selective attention: evidence from visual search. , 1984, Journal of experimental psychology. Human perception and performance.

[29]  David Alais,et al.  Multisensory Congruency as a Mechanism for Attentional Control over Perceptual Selection , 2009, The Journal of Neuroscience.

[30]  R. Campbell,et al.  Audiovisual Integration of Speech Falters under High Attention Demands , 2005, Current Biology.

[31]  C. Olivers,et al.  Bleeping you out of the blink: Sound saves vision from oblivion , 2008, Brain Research.

[32]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[33]  Martin Eimer,et al.  Multisensory enhancement of attentional capture in visual search , 2011, Psychonomic bulletin & review.

[34]  Salvador Soto-Faraco,et al.  Attention to touch weakens audiovisual speech integration , 2007, Experimental Brain Research.

[35]  C. Spence Audiovisual multisensory integration , 2007 .

[36]  Jan Theeuwes,et al.  Pip and pop: nonspatial auditory signals improve spatial visual search. , 2008, Journal of experimental psychology. Human perception and performance.

[37]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[38]  M. Woldorff,et al.  Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration? , 2006, Cerebral cortex.

[39]  L. Pessoa,et al.  Decoding near-threshold perception of fear from distributed single-trial brain activation. , 2006, Cerebral cortex.

[40]  Shin'ya Nishida,et al.  Visual search for a target changing in synchrony with an auditory signal , 2006, Proceedings of the Royal Society B: Biological Sciences.

[41]  C. Spence,et al.  Auditory, tactile, and multisensory cues facilitate search for dynamic visual stimuli , 2010, Attention, perception & psychophysics.