A Systematic Approach to Musical vibrotactile feedback

This paper presents a new approach to the integration of vibrotactile feedback into digital musical instrument designs. A design strategy for musical vibrotactile systems is developed that considers actuator placement, vibration synthesis, and a mapping from audio to vibrotactile feedback parameters utilizing neurophysiological studies. Stimulation takes both physiology and actuator technology into account to maximize sensation. Vibrations are created using perceptual sound features of the audio feedback to drive a vibration synthesizer, producing vibrotactile feedback that is tailored specifically for cutaneous display. This framework simplifies integration of vibrotactile feedback into instrument designs, avoiding the need to explicitly specify vibration stimulus parameters.

[1]  S. Bolanowski,et al.  Four channels mediate the mechanical aspects of touch. , 1988, The Journal of the Acoustical Society of America.

[2]  J Sundberg.  Chest wall vibrations in singers. , 1983, Journal of speech and hearing research.

[3]  M. Sile O'Modhrain,et al.  Musical Muscle Memory and the Haptic Display of Performance Nuance , 1996, ICMC.

[4]  Marcelo M. Wanderley,et al.  Gestural control of sound synthesis , 2004, Proceedings of the IEEE.

[5]  J.B.F. van Erp,et al.  Guidelines for the use of vibro-tactile displays in human computer interaction , 2002 .

[6]  Mine Dogantan-Dack,et al.  The body behind music: precedents and prospects , 2006 .

[7]  Xavier Rodet,et al.  On the Choice of Transducer Technologies for Specific Musical Functions , 2000, ICMC.

[8]  Miller Puckette,et al.  Real-time audio analysis tools for Pd and MSP , 1998, ICMC.

[9]  P E Patterson,et al.  Design and evaluation of a sensory feedback system that provides grasping pressure in a myoelectric hand. , 1992, Journal of rehabilitation research and development.

[10]  Dong-Soo Kwon,et al.  Perceptual and biomechanical frequency response of human skin: implication for design of tactile displays , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[11]  Todd Winkler,et al.  Making Motion Musical: Gesture Mapping Strategies for Interactive Computer Music , 1995, ICMC.

[12]  M. Hollins,et al.  Vibrotactile adaptation enhances frequency discrimination. , 1994, The Journal of the Acoustical Society of America.

[13]  Angela Chang,et al.  Dimensional Design; Explorations of the Auditory and Haptic Correlate for the Mobile Device , 2005 .

[14]  S. Gandevia,et al.  Cutaneous receptors contribute to kinesthesia at the index finger, elbow, and knee. , 2005, Journal of neurophysiology.

[15]  Chris Chafe,et al.  Playing by feel: incorporating haptic feedback into computer-based musical instruments , 2001 .

[16]  Edward F. Kelly,et al.  Frequency-domain measurement of vibrotactile driving responses in first-order afferent populations , 1996, Experimental Brain Research.

[17]  G A Gescheider,et al.  The effects of a surround on vibrotactile thresholds. , 1978, Sensory processes.

[18]  Zack Settel,et al.  Nonobvious roles for electronics in performance enhancement , 1993, ICMC.

[19]  .. Wanderley.  Typology of Tactile Sounds and their Synthesis in Gesture-Driven Computer Music Performance , 2000 .

[20]  S J Bensmaïa,et al.  Complex tactile waveform discrimination. , 2000, The Journal of the Acoustical Society of America.

[21]  Tristan Jehan,et al.  An Audio-Driven Perceptually Meaningful Timbre Synthesizer , 2001, ICMC.

[22]  Chris Chafe.  Tactile Audio Feedback , 1993, ICMC.

[23]  Ma Conway,et al.  Handbook of perception and cognition , 1996 .

[24]  Eric Gunther,et al.  Skinscape: A Tool for Composition in the Tactile Modality , 2001 .

[25]  M. Rowe,et al.  Perceived pitch of vibrotactile stimuli: effects of vibration amplitude, and implications for vibration frequency coding. , 1990, The Journal of physiology.

[26]  M. Hollins,et al.  A ratio code for vibrotactile pitch. , 1998, Somatosensory & motor research.

[27]  Jun Rekimoto,et al.  Ambient touch: designing tactile interfaces for handheld devices , 2002, UIST '02.

[28]  R. T. Verrillo,et al.  Vibration Sensation in Humans , 1992 .

[29]  Allison M. Okamura,et al.  Vibration feedback models for virtual environments , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[30]  Lorna M. Brown,et al.  Non-visual information display using tactons , 2004, CHI EA '04.

[31]  P L Brooks,et al.  Evaluation of a tactile vocoder for work recognition. , 1983, The Journal of the Acoustical Society of America.

[32]  Justin A. Harris,et al.  The Topography of Tactile Learning in Humans , 2001, The Journal of Neuroscience.

[33]  Eugene Coyle,et al.  Prior Subspace Analysis for Drum Transcription , 2003 .

[34]  Dan Trueman,et al.  Physicality and Feedback: A Focus on the Body in the Performance of Electronic Music , 2001, ICMC.

[35]  Hong Z. Tan,et al.  Information transmission with a multi-finger tactual display , 1997, Scandinavian audiology. Supplementum.

[36]  W. M. Rabinowitz,et al.  Information transmission with a multifinger tactual display , 1999, Perception & psychophysics.

[37]  N. Collins.  Algorithmic Composition Methods for Breakbeat Science , 2001 .

[38]  Timothy D. Lee,et al.  Motor Control and Learning: A Behavioral Emphasis , 1982 .

[39]  Marcelo M. Wanderley,et al.  Vibrotactile Feedback in Digital Musical Instruments , 2006, NIME.

[40]  C J Vierck,et al.  A critical band filter in touch , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[41]  Lorna M. Brown,et al.  A first investigation into the effectiveness of Tactons , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[42]  M. Ezawa.  Rhythm perception equipment for skin vibratory stimulation , 1988, IEEE Engineering in Medicine and Biology Magazine.