Multisensory enhancement of attentional capture in visual search

Multisensory integration increases the salience of sensory events and, therefore, possibly also their ability to capture attention in visual search. This was investigated in two experiments where spatially uninformative color change cues preceded visual search arrays with color-defined targets. Tones were presented synchronously with these cues on half of all trials. Spatial-cuing effects indicative of cue-triggered capture of attention were larger on tone-present than on tone-absent trials, demonstrating multisensory enhancements of attentional capture. Larger capture effects for audiovisual events were found when cues were color singletons, and also when they appeared among heterogeneous color distractors. Tone-induced increases of attentional capture were independent of color-specific top-down task sets, suggesting that this multisensory effect is a stimulus-driven bottom-up phenomenon.

[1]  S. Yantis.  Stimulus-driven attentional capture and attentional control settings. , 1993, Journal of experimental psychology. Human perception and performance.

[2]  Juan Lupiáñez,et al.  The three attentional networks: On their independence and interactions , 2004, Brain and Cognition.

[3]  B. Stein,et al.  Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  Michael T. Lippert,et al.  Improvement of visual contrast detection by a simultaneous sound , 2007, Brain Research.

[5]  Theeuwes,et al.  Running Head : Pip and Pop Pip and pop : Non-spatial auditory signals improve spatial visual search , 2007 .

[6]  J. Theeuwes.  Top-down and bottom-up control of visual selection. , 2010, Acta psychologica.

[7]  Dominique Lamy,et al.  Effects of task relevance and stimulus-driven salience in feature-search mode. , 2004, Journal of experimental psychology. Human perception and performance.

[8]  J. C. Johnston,et al.  Involuntary covert orienting is contingent on attentional control settings. , 1992, Journal of experimental psychology. Human perception and performance.

[9]  Martin Eimer,et al.  Top-down search strategies determine attentional capture in visual search: Behavioral and electrophysiological evidence , 2010, Attention, perception & psychophysics.

[10]  B. Stein,et al.  Enhancement of Perceived Visual Intensity by Auditory Stimuli: A Psychophysical Analysis , 1996, Journal of Cognitive Neuroscience.

[11]  Martin Eimer,et al.  The Roles of Feature-Specific Task Set and Bottom-Up Salience in Attentional Capture : An ERP Study , 2009 .

[12]  J. Theeuwes.  Cross-dimensional perceptual selectivity , 1991, Perception & psychophysics.

[13]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[14]  de Gelder.  Sound Enhances Visual Perception: Cross-Modal Effects of Auditory Organization on Vision , 2001 .

[15]  M. Eimer,et al.  Tactile enhancement of auditory detection and perceived loudness , 2007, Brain Research.

[16]  H. Egeth,et al.  Overriding stimulus-driven attentional capture , 1994, Perception & psychophysics.

[17]  Charles Spence,et al.  Multisensory cues capture spatial attention regardless of perceptual load. , 2007, Journal of experimental psychology. Human perception and performance.

[18]  M. Giard,et al.  Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study , 1999, Journal of Cognitive Neuroscience.