Audiotactile interactions in near and far space

In this study we investigated audiotactile spatial interactions in the region behind the head. In experiment 1, participants made unspeeded temporal order judgments (TOJs) regarding pairs of auditory and tactile stimuli presented at varying stimulus onset asynchronies (SOAs) using the method of constant stimuli. Electrocutaneous stimuli were presented to the left or right earlobe while auditory stimuli were presented from just behind the participant’s head on either the same or opposite side. Participants responded significantly more accurately when the stimuli were presented from different sides rather than from the same side. In experiment 2, we used a distractor interference task to show that speeded left/right discrimination responses to electrocutaneous targets were also modulated by the spatial congruency of auditory distractors presented behind the head. Performance was worse (i.e. response latencies were slower and error rates higher) when the auditory distractors were presented on the opposite side to the electrocutaneous target than when they were presented on the same side. This crossmodal distractor interference effect was larger when white noise distractors were presented from close to the head (20 cm) than when they were presented far from the head (70 cm). By contrast, pure tone distractors elicited a smaller crossmodal distractor interference effect overall, and showed no modulation as a function of distance. Taken together, these results suggest that the spatial modulation of audiotactile interactions occurs predominantly for complex auditory stimuli (for example, white noise) originating from the region close to the back of the head.

[1]  M. Eimer,et al.  Tactile Enhancement of Perceived Loudness , 2004 .

[2]  A Farnè,et al.  Auditory Peripersonal Space in Humans: a Case of Auditory-Tactile Extinction , 2001, Neurocase.

[3]  Elisabetta Ladavas amp Farne,et al.  Neuropsychological evidence for multimodal representations of space near specific body parts , 2004 .

[4]  F. Rösler,et al.  Crossmodal and intermodal attention modulate event-related brain potentials to tactile and auditory stimuli , 2002, Experimental Brain Research.

[5]  Robert E. Schlegel,et al.  Tactile Stimulation of the Human Head for Information Display , 1994 .

[6]  R. Baddeley,et al.  Multisensory temporal order judgments: When two locations are better than one , 2003, Perception & psychophysics.

[7]  C. Wickens.  Engineering psychology and human performance, 2nd ed. , 1992 .

[8]  Jon Driver,et al.  Cross-modal links in attention between audition, vision, and touch: Implications for interface design , 1997 .

[9]  Alessandro Farnè,et al.  Auditory peripersonal space in humans. , 2002, Journal of cognitive neuroscience.

[10]  C. Gross,et al.  A neuronal representation of the location of nearby sounds , 1999, Nature.

[11]  B. Moore.  An introduction to the psychology of hearing, 3rd ed. , 1989 .

[12]  C. Spence,et al.  Crossmodal Space and Crossmodal Attention , 2004 .

[13]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[14]  Frank P. McKenna,et al.  Integrating multiple information sources: using redundancy in the design of warnings , 1995 .

[15]  Tickle sensation induced by hearing a sound(Summary of Awarded Presentation at the 23rd Annual Meeting) , 2005 .

[16]  Peter Ning,et al.  Electrocutaneous stimulation III. The perception of temporal order , 1982, Perception & psychophysics.

[17]  F. M. Wadley.  Probit Analysis: a Statistical Treatment of the Sigmoid Response Curve , 1952 .

[18]  Cari E. Sherrick,et al.  Temporal Ordering of Events in Haptic Space , 1970 .

[19]  C. Spence,et al.  Assessing the effectiveness of various auditory cues in capturing a driver's visual attention. , 2005, Journal of experimental psychology. Applied.

[20]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[21]  C. Spence,et al.  Spatial constraints on visual-tactile cross-modal distractor congruency effects , 2004, Cognitive, affective & behavioral neuroscience.

[22]  C. Spence,et al.  Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision , 1998, Perception & psychophysics.

[23]  Natasha Merat,et al.  Crossmodal links between audition and touch in covert endogenous spatial attention , 2003, Perception & psychophysics.

[24]  C. Spence,et al.  Audiovisual temporal order judgments , 2003, Experimental Brain Research.

[25]  Brigitte Röder,et al.  Multisensory processing in the redundant-target effect: A behavioral and event-related potential study , 2005, Perception & psychophysics.

[26]  B. Moore.  An Introduction to the Psychology of Hearing , 1977 .

[27]  C. Spence,et al.  Investigating the effect of a transparent barrier on the crossmodal congruency effect , 2005, Experimental Brain Research.

[28]  M S Graziano,et al.  A System of Multimodal Areas in the Primate Brain , 2001, Neuron.

[29]  C. Spence,et al.  Audiotactile temporal order judgments. , 2005, Acta psychologica.

[30]  Durand R. Begault,et al.  Sensitivity to haptic-audio asynchrony , 2003, ICMI '03.

[31]  Jean Vroomen,et al.  The role of spatial disparity and hemifields in audio-visual temporal order judgments , 2005, Experimental Brain Research.

[32]  C. Spence,et al.  Multisensory prior entry. , 2001, Journal of experimental psychology. General.

[33]  Charles Spence,et al.  Multisensory temporal order judgments: the role of hemispheric redundancy. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[34]  John J. Foxe,et al.  Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. , 2005, Cerebral cortex.

[35]  Bruce Bridgeman,et al.  Space-independent modality-driven attentional capture in auditory, tactile and visual systems , 2004, Experimental Brain Research.

[36]  James T. Townsend,et al.  The Stochastic Modeling of Elementary Psychological Processes , 1983 .