On audiovisual spatial synergy: The fragility of the phenomenon

Recent literature has highlighted the importance and ubiquity of cross-modal links in spatial attention, whereby shifts in attention in one modality often induce corresponding shifts in other modalities. We attempted to provide further evidence for the case of audiovisual links during sustained endogenous attention by addressing several potential methodological confounds in previous demonstrations. However, we failed repeatedly to reproduce the phenomenon of spatial synergies between auditory and visual attention, found by Driver and Spence (1994) and frequently cited to support the automatic nature of cross-modal attention links. We discuss the results in light of recent evidence about cross-modal spatial links during sustained attention and support the idea that such links can weaken or even disappear under certain circumstances, such as during periods of sustained attention. The implication is that individuals can select inputs from different modalities from different locations more easily than previously had been thought.

[1]  F. Rösler,et al.  Crossmodal and intermodal attention modulate event-related brain potentials to tactile and auditory stimuli , 2002, Experimental Brain Research.

[2]  C. Spence,et al.  Speech Shadowing While Driving , 2003, Psychological science.

[3]  H. Buchtel,et al.  Spatial attentional shifts: Further evidence for the role of polysensory mechanisms using visual and tactile stimuli , 1989, Neuropsychologia.

[4]  I. Radermacher,et al.  Functional anatomy of intrinsic alertness: evidencefor a fronto-parietal-thalamic-brainstem network in theright hemisphere , 1999, Neuropsychologia.

[5]  Martin Eimer,et al.  Crossmodal links in spatial attention are mediated by supramodal control processes: evidence from event-related potentials. , 2002, Psychophysiology.

[6]  Natasha Merat,et al.  Crossmodal links between audition and touch in covert endogenous spatial attention , 2003, Perception & psychophysics.

[7]  C. Spence,et al.  Crossmodal Space and Crossmodal Attention , 2004 .

[8]  Christopher D. Wickens,et al.  The Structure of Attentional Resources , 1980 .

[9]  George Sperling,et al.  The information available in brief visual presentations. , 1960 .

[10]  C. Spence,et al.  The Handbook of Multisensory Processing , 2004 .

[11]  C. Spence,et al.  Exogenous spatial cuing studies of human crossmodal attention and multisensory integration , 2004 .

[12]  J. Driver,et al.  Audiovisual links in endogenous covert spatial attention. , 1996, Journal of experimental psychology. Human perception and performance.

[13]  Jon Driver,et al.  Cross-Modal Interactions between Audition, Touch, and Vision in Endogenous Spatial Attention: ERP Evidence on Preparatory States and Sensory Modulations , 2002, Journal of Cognitive Neuroscience.

[14]  C. Spence,et al.  Attention and the crossmodal construction of space , 1998, Trends in Cognitive Sciences.

[15]  J Driver,et al.  Cross-modal selective attention: On the difficulty of ignoring sounds at the locus of visual attention , 2000, Perception & psychophysics.

[16]  D. Reisberg,et al.  Eye position and the control of auditory attention. , 1981, Journal of experimental psychology. Human perception and performance.

[17]  S. Hillyard,et al.  Intra-modal and cross-modal spatial attention to auditory and visual stimuli. An event-related brain potential study. , 1999, Brain research. Cognitive brain research.

[18]  H. Buchtel,et al.  Spatial attentional shifts: Implications for the role of polysensory mechanisms , 1988, Neuropsychologia.

[19]  J Driver,et al.  An event-related brain potential study of cross-modal links in spatial attention between vision and touch. , 2000, Psychophysiology.

[20]  D. Schiano,et al.  On listening where we look: The fragility of a phenomenon , 1989, Perception & psychophysics.

[21]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[22]  John Duncan,et al.  Restricted attentional capacity within but not between sensory modalities , 1997, Nature.

[23]  Martin Eimer,et al.  Can attention be directed to opposite locations in different modalities? An ERP study , 1999, Clinical Neurophysiology.

[24]  Charles Spence,et al.  Spatial synergies between auditory and visual attention. , 1994 .

[25]  M. Eimer.  ERP modulations indicate the selective processing of visual stimuli as a result of transient and sustained spatial attention. , 1996, Psychophysiology.

[26]  P F Seitz,et al.  The use of visible speech cues for improving auditory detection of spoken sentences. , 2000, The Journal of the Acoustical Society of America.

[27]  C. Spence,et al.  Crossmodal links between vision and touch in covert endogenous spatial attention. , 2000, Journal of experimental psychology. Human perception and performance.

[28]  Jon Driver,et al.  Crossmodal Spatial Attention: Evidence from Human Performance , 2004 .

[29]  D. Reisberg,et al.  Looking where you listen: visual cues and auditory attention. , 1978, Acta psychologica.

[30]  H. Pashler.  The Psychology of Attention , 1997 .

[31]  Daniel Gopher,et al.  Eye-movement patterns in selective listening tasks of focused attention , 1973 .

[32]  L. M. Ward,et al.  On asymmetries in cross-modal spatial attention orienting , 2000, Perception & psychophysics.

[33]  Gordon D. A. Brown.  A frequency count of 190,000 words in theLondon-Lund Corpus of English Conversation , 1984 .

[34]  M. Farah,et al.  Parietal lobe mechanisms of spatial attention: Modality-specific or supramodal? , 1989, Neuropsychologia.

[35]  J. Driver.  Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading , 1996, Nature.

[36]  J. Braun.  Vision and attention: the role of training , 1998, Nature.

[37]  K. Grant,et al.  Measures of auditory-visual integration in nonsense syllables and sentences. , 1998, The Journal of the Acoustical Society of America.

[38]  J. Driver,et al.  Audiovisual links in exogenous covert spatial orienting , 1997, Perception & psychophysics.

[39]  C. Spence,et al.  A crossmodal attentional blink between vision and touch , 2002, Psychonomic bulletin & review.

[40]  D. C. Howell.  Statistical Methods for Psychology , 1987 .

[41]  W. H. Sumby,et al.  Visual contribution to speech intelligibility in noise , 1954 .