Vibrotactile–Auditory Interactions are Post-Perceptual

Vibrotactile stimuli can elicit compelling auditory sensations, even when sound energy levels are minimal and undetectable. It has previously been shown that subjects judge auditory tones embedded in white noise to be louder when they are accompanied by a vibrotactile stimulus of the same frequency. A first experiment replicated this result at four different levels of auditory stimulation (no tone, tone at detection threshold, tone at 5 dB above threshold, and tone at 10 dB above threshold). The presence of a vibrotactile stimulus induced an increase in the perceived loudness of auditory tones at three of the four values in this range. In two further experiments, a 2-interval forced-choice procedure was used to assess the nature of this crossmodal interaction. Subjects were biased when vibrotaction was applied in one interval, but applying vibrotaction in both intervals produced performance comparable to conditions without vibrotactile stimuli. This demonstrates that vibrotaction is sometimes ignored when judging the presence of an auditory tone. Hence the interaction between vibrotaction and audition does not appear to occur at an early perceptual level.

[1]  Ankoor S. Shah,et al.  Auditory Cortical Neurons Respond to Somatosensory Stimulation , 2003, The Journal of Neuroscience.

[2]  Daniel Smilek,et al.  Five plus two equals yellow , 2000, Nature.

[3]  Lawrence E Marks,et al.  Brighter noise: Sensory enhancement of perceived loudness by concurrent visual stimulation , 2004, Cognitive, affective & behavioral neuroscience.

[4]  John J. Foxe,et al.  Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. , 2002, Journal of neurophysiology.

[5]  G A Gescheider,et al.  Effects of simultaneous auditory stimulation on the detection of tactile stimuli. , 1969, Journal of experimental psychology.

[6]  Geoffrey M. Boynton,et al.  Individual Differences among Grapheme-Color Synesthetes: Brain-Behavior Correlations , 2005, Neuron.

[7]  Riitta Hari,et al.  Touch activates human auditory cortex , 2006, NeuroImage.

[8]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[9]  W. Singer,et al.  Neuronal Correlates of Colour-Graphemic Synaesthesia: Afmri Study , 2006, Cortex.

[10]  Lawrence E Marks,et al.  Cross-modal enhancement of perceived brightness: Sensory interaction versus response bias , 2003, Perception & psychophysics.

[11]  Christopher T. Lovelace,et al.  An irrelevant light enhances auditory detection in humans: a psychophysical analysis of multisensory integration in stimulus detection. , 2003, Brain research. Cognitive brain research.

[12]  John J. Foxe,et al.  Multisensory auditory-somatosensory interactions in early cortical processing revealed by high-density electrical mapping. , 2000, Brain research. Cognitive brain research.

[13]  R. Schlauch,et al.  Intensity resolution and loudness in broadband noise. , 1995, The Journal of the Acoustical Society of America.

[14]  W F Rosenberger,et al.  A sequential design for psychophysical experiments: an application to estimating timing of sensory events. , 1997, Statistics in medicine.

[15]  G A Gescheider,et al.  Cross-modality masking for touch and hearing. , 1967, Journal of experimental psychology.

[16]  G. Fechner Elemente der Psychophysik , 1998 .

[17]  W Jesteadt,et al.  Intensity discrimination in the presence of random-frequency, multicomponent maskers and broadband noise. , 1996, The Journal of the Acoustical Society of America.

[18]  Edward M. Hubbard,et al.  Neurocognitive Mechanisms of Synesthesia , 2005, Neuron.

[19]  FRANCIS GALTON,et al.  Visualised Numerals , 1880, Nature.

[20]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[21]  Riitta Hari,et al.  Hands help hearing: facilitatory audiotactile interaction at low sound-intensity levels. , 2004, The Journal of the Acoustical Society of America.