Vibrotactile Display of Music on the Human Back

We present an experiment designed to reveal characteristics of a tactile display that presents vibrations representing music to the back of the body. Based on the model human cochlea, a sensory substitution system aimed at translating music into vibrations, we are investigating the use of larger contactor sizes (over 10mm in diameter) as an effective device for the detection of signals originating from music. Using the method of limits, we measured ability to discriminate the frequency of vibrotactile stimuli across a wide range of frequencies common to western classical harmonic music. Vibrotactile stimuli were presented to artificially deafened participants using a large contactor applied to the back. Between 65 Hz (C2) and 1047 Hz (C6), frequency difference limens (FDL) were consistently less than 1/3 of an octave and as small as 200 cents. These findings suggest that vibrotactile information can be used to support the experience of music even in the absence of sound, and that voice coils are effective in presenting some characteristics of sound as vibrations.

[1]  T. Yoshioka,et al.  Neural mechanisms of tactual form and texture perception. , 1992, Annual review of neuroscience.

[2]  Robert H. Gault,et al.  Progress in experiments on tactual interpretation of oral speech. , 1924 .

[3]  Michiel M. Spapé,et al.  Distilling the underlying dimensions of tactile melodies , 2003 .

[4]  J. Zwislocki.  Theory of Temporal Auditory Summation , 1960 .

[5]  Deborah I. Fels,et al.  Modelling Perceptual Elements of Music in a Vibrotactile Display for Deaf Users: A Field Study , 2009, 2009 Second International Conferences on Advances in Computer-Human Interactions.

[6]  S. J. Bolanowski,et al.  Some characteristics of tactile channels , 2004, Behavioural Brain Research.

[7]  Deborah I. Fels,et al.  Towards a model human cochlea: sensory substitution for crossmodal audio-tactile displays , 2008, Graphics Interface.

[8]  Riitta Hari,et al.  Touch activates human auditory cortex , 2006, NeuroImage.

[9]  Marcelo M. Wanderley,et al.  Vibrotactile Feedback in Digital Musical Instruments , 2006, NIME.

[10]  H Levitt.  Recurrent Issues Underlying the Development of Tactile Sensory Aids , 1988, Ear and hearing.

[11]  Ross Kirk,et al.  TACTILE FEEDBACK IN THE CONTROL OF A PHYSICAL MODELLING MUSIC SYNTHESISER , 2002 .

[12]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[13]  A. Watson.  Probability summation over time , 1979, Vision Research.

[14]  G. D. Goff.  Differential discrimination of frequency of cutaneous mechanical vibration. , 1967, Journal of experimental psychology.

[15]  Deborah I. Fels,et al.  Designing a model human cochlea: issues and challenges in crossmodal audio-haptic displays , 2008, HAS '08.

[16]  Stephen A. Zahorian,et al.  Vibrotactile frequency for encoding a speech parameter , 1976 .

[17]  Helena Pongrac,et al.  Vibrotactile perception: examining the coding of vibrations and the just noticeable difference under various conditions , 2007, Multimedia Systems.

[18]  S J Bolanowski,et al.  Vibrotactile frequency for encoding a speech parameter. , 1977, The Journal of the Acoustical Society of America.

[19]  M. Rowe,et al.  Vibrotactile frequency discrimination in human hairy skin. , 2006, Journal of neurophysiology.