The spatial resolution of crossmodal attention: Implications for the design of multimodal interfaces

Previous research on crossmodal attentional orienting has reported speeded reaction times (RT) when the stimuli from the different modalities are in the same spatial location and slowed RTs when the stimuli are presented in very different locations (e.g., opposite sides of the body). However, little is known about what occurs for spatial interactions between these two extremes. We systematically varied the separation between cues and targets to quantify the spatial distribution of crossmodal attention. The orthogonal cueing paradigm [Spence et al. 1998] was used. Visual targets presented above or below the forearm were preceded by either vibrotactile cues presented on the forearm, auditory cues presented below the forearm, or visual cues presented on the forearm. The presentation of both unimodal and crossmodal cues led to a roughly monotonic increase in RT as a function of the cue-target separation. Unimodal visual cueing resulted in an attentional focus that was significantly narrower than that produced by crossmodal cues: the distribution of visual attention for visual cues had roughly half of the lateral extent of that produced by tactile cueing and roughly one fourth of the lateral extent as that produced by auditory cueing. This occurred when both seven (Experiment 1) and three (Experiment 2) cue locations were used suggesting that the effects are not primarily due to differences in the ability to localize the cues. These findings suggest that the location of tactile and auditory warning signals does not have to be controlled as precisely as the location of visual warning signals to facilitate a response to the critical visual event.

[1]  C. Spence,et al.  Visuo-tactile links in covert exogenous spatial attention remap across changes in unseen hand posture , 2002, Perception & psychophysics.

[2]  C. Spence,et al.  The differential effect of vibrotactile and auditory cues on visual spatial attention , 2006, Ergonomics.

[3]  H Colonius,et al.  A two-stage model for visual-auditory interaction in saccadic latencies , 2001, Perception & psychophysics.

[4]  C. Spence,et al.  Cross-modal links in spatial attention. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[5]  Hans Colonius,et al.  Visual-tactile spatial interaction in saccade generation , 2003, Experimental Brain Research.

[6]  J M Groh,et al.  Saccades to somatosensory targets. II. motor convergence in primate superior colliculus. , 1996, Journal of neurophysiology.

[7]  Christopher D. Wickens,et al.  The Structure of Attentional Resources , 1980 .

[8]  Hans Colonius,et al.  Modeling spatial effects in visualtactile saccadic reaction time , 2007, Perception & psychophysics.

[9]  J. Driver,et al.  Audiovisual links in endogenous covert spatial attention. , 1996, Journal of experimental psychology. Human perception and performance.

[10]  G. Shulman,et al.  Moving attention through visual space. , 1979, Journal of experimental psychology. Human perception and performance.

[11]  Jon Driver,et al.  Cross-modal links in attention between audition, vision, and touch: Implications for interface design , 1997 .

[12]  S. Charles,et al.  10 - Crossmodal Attentional Capture: A Controversy Resolved? , 2001 .

[13]  G. Chastain,et al.  Analog versus discrete shifts of attention across the visual field , 1992, Psychological research.

[14]  C. Spence,et al.  Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision , 1998, Perception & psychophysics.

[15]  F. Hawkins Human factors in aviation. , 1979, Journal of psychosomatic research.

[16]  C. Spence,et al.  Crossmodal links between vision and touch in covert endogenous spatial attention. , 2000, Journal of experimental psychology. Human perception and performance.

[17]  David C. Nagel,et al.  Human factors in aviation , 1988 .

[18]  Rupert Ah Tactile situation awareness system: proprioceptive prostheses for sensory deficiencies. , 2000 .

[19]  Hong Z. Tan,et al.  An Eyetracker Study of the Haptic Cuing of Visual Attention , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[20]  Thomas K. Ferris,et al.  The Implications of Crossmodal Links in Attention for the Design of Multimodal Interfaces: A Driving Simulation Study , 2006 .

[21]  A H Rupert An instrumentation solution for reducing spatial disorientation mishaps. , 2000, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[22]  A. Rupert Tactile situation awareness system: proprioceptive prostheses for sensory deficiencies. , 2000, Aviation, space, and environmental medicine.

[23]  C. Spence,et al.  Assessing the effectiveness of various auditory cues in capturing a driver's visual attention. , 2005, Journal of experimental psychology. Applied.

[24]  J Edworthy,et al.  Improving Auditory Warning Design: Relationship between Warning Sound Parameters and Perceived Urgency , 1991, Human factors.

[25]  Hong Z. Tan,et al.  Using spatial vibrotactile cues to direct visual attention in driving scenes , 2005 .

[26]  G. Shulman,et al.  Spatial determinants of the distribution of attention , 1985, Perception & psychophysics.

[27]  M. Farah,et al.  Parietal lobe mechanisms of spatial attention: Modality-specific or supramodal? , 1989, Neuropsychologia.

[28]  Ryan M. Traylor,et al.  A Haptic Back Display for Attentional and Directional Cueing , 2003 .

[29]  B. Stein,et al.  The Merging of the Senses , 1993 .

[30]  M. Eimer,et al.  Spatial tuning of tactile attention modulates visual processing within hemifields: an ERP investigation of crossmodal attention , 2005, Experimental Brain Research.

[31]  Judy Edworthy,et al.  Warning design : a research prospective , 1996 .

[32]  H J Müller,et al.  Movement versus focusing of visual attention , 1989, Perception & psychophysics.