Sound enhances touch perception

Certain sounds, such as fingernails screeching down a chalkboard, have a strong association with somatosensory percepts. In order to assess the influences of audition on somatosensory perception, three experiments measured how task-irrelevant auditory stimuli alter detection rates for near-threshold somatosensory stimuli. In Experiment 1, we showed that a simultaneous auditory stimulus increases sensitivity, but not response biases, to the detection of an electrical cutaneous stimulus delivered to the hand. Experiment 2 demonstrated that this enhancement of somatosensory perception is spatially specific—only monaural sounds on the same side increased detection. Experiment 3 revealed that the effects of audition on touch are also frequency dependent—only sounds with the same frequency as the vibrotactile frequency enhanced tactile detection. These results indicate that auditory information influences touch perception in highly systematic ways and suggest that similar coding mechanisms may underlie the processing of information from these different sensory modalities.

[1]  John J. Foxe,et al.  Multisensory contributions to low-level, ‘unisensory’ processing , 2005, Current Opinion in Neurobiology.

[2]  I. Nelken,et al.  Physiological and Anatomical Evidence for Multisensory Interactions in Auditory Cortex , 2006, Cerebral cortex.

[3]  C. Spence,et al.  Audiotactile interactions in roughness perception , 2002, Experimental Brain Research.

[4]  Jon Driver,et al.  Crossmodal attention , 1998, Current Opinion in Neurobiology.

[5]  R. Blake,et al.  Psychoacoustics of a chilling sound , 1986, Perception & psychophysics.

[6]  Tony Ro,et al.  Visually induced feelings of touch , 2006, Brain Research.

[7]  H. Kennedy,et al.  Anatomical Evidence of Multimodal Integration in Primate Striate Cortex , 2002, The Journal of Neuroscience.

[8]  Irvin Rock,et al.  Adaptation to contradictory information from vision and touch , 1965 .

[9]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[10]  Charles Spence.  Crossmodal attention , 1998, Scholarpedia.

[11]  P. Bertelson.  Chapter 14 Ventriloquism: A case of crossmodal perceptual grouping , 1999 .

[12]  S. Tipper,et al.  Vision influences tactile perception without proprioceptive orienting , 1998, Neuroreport.

[13]  Tony Ro,et al.  Visual Enhancing of Tactile Perception in the Posterior Parietal Cortex , 2004, Journal of Cognitive Neuroscience.

[14]  C. Spence,et al.  The effect of sound intensity on the audiotactile crossmodal dynamic capture effect , 2009, Experimental Brain Research.

[15]  John J. Foxe,et al.  Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. , 2002, Journal of neurophysiology.

[16]  de Gelder.  Sound Enhances Visual Perception: Cross-Modal Effects of Auditory Organization on Vision , 2001 .

[17]  Yoko Hoshi,et al.  Co-activation of the secondary somatosensory and auditory cortices facilitates frequency discrimination of vibrotactile stimuli , 2007, Neuroscience.

[18]  V. Jousmäki,et al.  Parchment-skin illusion: sound-biased touch , 1998, Current Biology.

[19]  C. Schroeder,et al.  Somatosensory input to auditory association cortex in the macaque monkey. , 2001, Journal of neurophysiology.

[20]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[21]  E. Macaluso,et al.  Multisensory spatial interactions: a window onto functional integration in the human brain , 2005, Trends in Neurosciences.

[22]  M. Bassolino,et al.  PSYCHOLOGICAL SCIENCE Research Article Extended Multisensory Space in Blind Cane Users , 2022 .

[23]  J. Driver,et al.  Audiovisual links in exogenous covert spatial orienting , 1997, Perception & psychophysics.

[24]  Tony Ro,et al.  Neural Substrates of Sound–Touch Synesthesia after a Thalamic Lesion , 2008, The Journal of Neuroscience.

[25]  M. Eimer,et al.  Tactile enhancement of auditory detection and perceived loudness , 2007, Brain Research.

[26]  G. Aschersleben,et al.  Automatic visual bias of perceived auditory location , 1998 .

[27]  S. Tipper,et al.  Vision influences tactile perception at body sites that cannot be viewed directly , 2001, Experimental Brain Research.

[28]  Kathleen S Rockland,et al.  Multisensory convergence in calcarine visual areas in macaque monkey. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[29]  G. Recanzone.  Rapidly induced auditory plasticity: the ventriloquism aftereffect. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[30]  P. Haggard,et al.  Noninformative vision improves the spatial resolution of touch in humans , 2001, Current Biology.

[31]  Riitta Hari,et al.  Touch activates human auditory cortex , 2006, NeuroImage.

[32]  Heinrich H. Bülthoff,et al.  Touch can change visual slant perception , 2000, Nature Neuroscience.

[33]  Brigitte Röder,et al.  Hearing Cheats Touch, but Less in Congenitally Blind Than in Sighted Individuals , 2004, Psychological science.

[34]  I ROCK,et al.  Vision and Touch: An Experimentally Created Conflict between the Two Senses , 1964, Science.

[35]  Alessandro Farnè,et al.  Auditory peripersonal space in humans. , 2002, Journal of cognitive neuroscience.

[36]  C. Spence,et al.  Visual Capture of Touch: Out-of-the-Body Experiences With Rubber Gloves , 2000, Psychological science.

[37]  B. Stein,et al.  The Merging of the Senses , 1993 .

[38]  Henry Kennedy,et al.  Long-distance feedback projections to area V1: Implications for multisensory integration, spatial awareness, and visual consciousness , 2004, Cognitive, affective & behavioral neuroscience.

[39]  G A Gescheider,et al.  Effects of simultaneous auditory stimulation on the detection of tactile stimuli. , 1969, Journal of experimental psychology.

[40]  V. Wedeen,et al.  Feeling sounds after a thalamic lesion , 2007, Annals of neurology.

[41]  T. Bachmann,et al.  Cognitive contributions to the perception of spatial and temporal events (Advances in Psychology, Vol. 129) , 1999 .

[42]  J. Driver,et al.  Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments , 2008, Neuron.

[43]  Micah M. Murray,et al.  Auditory–somatosensory multisensory interactions in front and rear space , 2007, Neuropsychologia.

[44]  Charles Spence,et al.  Adaptation to audiotactile asynchrony , 2007, Neuroscience Letters.

[45]  Rolf-Detlef Treede,et al.  Spatial resolution of fMRI in the human parasylvian cortex: Comparison of somatosensory and auditory activation , 2005, NeuroImage.

[46]  C. Spence,et al.  Attention and the crossmodal construction of space , 1998, Trends in Cognitive Sciences.

[47]  C. Spence,et al.  Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision , 1998, Perception & psychophysics.