Selective effects of auditory stimuli on tactile roughness perception

We report two psychophysical experiments designed to investigate the effects of non touch-produced sounds on the tactile perception of roughness and length. Previous studies have demonstrated that the tactile roughness perception of object surfaces is modified by sounds elicited by rubbing the surfaces. In this study, we examined the crossmodal effects of non touch-produced sounds such as white noise (Experiment 1) and pure tones (Experiment 2). Participants touched abrasive paper, synchronizing their touch with changes in the intensity of sounds or with the onset of beeps (control condition), and judged the tactile roughness or length of the stimuli, using the magnitude estimation method. Although the white noise (complex sound) significantly decreased the slope of the roughness estimation function, it did not affect that of the length estimation function. Pure tones had no effect on roughness or length perception. The results revealed that complex sounds selectively affected tactile roughness perception, even when they were seemingly irrelevant to the exploration of the surfaces. We suggest that the processing of complex sounds may be related to the processing of tactile roughness, whereas it is independent of tactile length processing.

[1]  Veikko Jousmäki,et al.  Evidence of vibrotactile input to human auditory cortex , 2006, NeuroImage.

[2]  G. Aschersleben,et al.  Automatic visual bias of perceived auditory location , 1998 .

[3]  B. Moore.  An introduction to the psychology of hearing, 3rd ed. , 1989 .

[4]  G. Gescheider,et al.  Stimulus context and absolute magnitude estimation: A study of individual differences , 1991, Perception & psychophysics.

[5]  S. Lederman.  Auditory Texture Perception , 1979, Perception.

[6]  John J. Foxe,et al.  Auditory-somatosensory multisensory processing in auditory association cortex: an fMRI study. , 2002, Journal of neurophysiology.

[7]  R. Turner,et al.  Form and motion coherence activate independent, but not dorsal/ventral segregated, networks in the human brain , 2000, Current Biology.

[8]  C. Spence,et al.  Auditory contributions to multisensory product perception , 2006 .

[9]  Janet M. Weisenberger,et al.  Multisensory roughness perception of virtual surfaces: effects of correlated cues , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[10]  M. Ernst,et al.  Feeling what you hear: auditory signals can modulate tactile tap perception , 2005, Experimental Brain Research.

[11]  Susan J. Lederman,et al.  Integrating multimodal information about surface texture via a probe: relative contributions of haptic and touch-produced sound sources , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[12]  Cristiana Cavina-Pratesi,et al.  Redundant target effect and intersensory facilitation from visual-tactile interactions in simple reaction time , 2002, Experimental Brain Research.

[13]  C. Spence,et al.  Multisensory perception: Beyond modularity and convergence , 2000, Current Biology.

[14]  E. Terhardt.  On the perception of periodic sound fluctuations (roughness) , 1974 .

[15]  John Cohen.  The World of Touch , 1952, Nature.

[16]  P. Roland,et al.  Shape and roughness activate different somatosensory areas in the human brain. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Hermann Ackermann,et al.  Spatial auditory attention is modulated by tactile priming , 2005, Experimental Brain Research.

[18]  John J. Foxe,et al.  Grabbing your ear: rapid auditory-somatosensory multisensory interactions in low-level sensory cortices are not constrained by stimulus alignment. , 2005, Cerebral cortex.

[19]  Stephen A. Brewster,et al.  The Effective Combination of Haptic and Auditory Textural Information , 2000, Haptic Human-Computer Interaction.

[20]  M. Eimer,et al.  Tactile enhancement of auditory detection and perceived loudness , 2007, Brain Research.

[21]  B. Stein,et al.  Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. , 1986, Journal of neurophysiology.

[22]  Charles Spence,et al.  Audiotactile multisensory interactions in human information processing , 2006 .

[23]  Riitta Hari,et al.  Activation of the human posterior parietal and temporoparietal cortices during audiotactile interaction , 2003, NeuroImage.

[24]  V. Jousmäki,et al.  Parchment-skin illusion: sound-biased touch , 1998, Current Biology.

[25]  S. Lederman.  Tactile roughness of grooved surfaces: The touching process and effects of macro- and microsurface structure , 1974 .

[26]  E. Owens,et al.  An Introduction to the Psychology of Hearing , 1997 .

[27]  C. K. Peck,et al.  Spatial disparity affects visual-auditory interactions in human sensorimotor processing , 1998, Experimental Brain Research.

[28]  Brigitte Röder,et al.  Hearing Cheats Touch, but Less in Congenitally Blind Than in Sighted Individuals , 2004, Psychological science.

[29]  C. Spence,et al.  Audiotactile interactions in roughness perception , 2002, Experimental Brain Research.

[30]  Durand R. Begault,et al.  Sensitivity to haptic-audio asynchrony , 2003, ICMI '03.

[31]  M. Heller.  Visual and tactual texture perception: Intersensory cooperation , 1982, Perception & psychophysics.

[32]  Seung-Chan Kim,et al.  The Effect of Sound on Haptic Perception , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[33]  C. Spence,et al.  Tactile “capture” of audition , 2002, Perception & psychophysics.

[34]  Kenji Ozawa,et al.  Cross-Modality Between Haptic and Auditory Roughness with a Force Feedback Device , 2006, J. Robotics Mechatronics.

[35]  N. Logothetis,et al.  Integration of Touch and Sound in Auditory Cortex , 2005, Neuron.

[36]  Michael J Brammer,et al.  Crossmodal identification , 1998, Trends in Cognitive Sciences.

[37]  Charles Spence,et al.  Audiotactile interactions in near and far space , 2005, Experimental Brain Research.