Typology of Tactile Sounds and their Synthesis in Gesture-Driven Computer Music Performance

In this paper we outline the fundamentals for a tactile feedback system to be used in conjunction with openair computer music performance devices. Some underlying physiological and perceptual mechanisms of haptics are examined, some currently available open-air controllers are reviewed, and previous technologies and experiments regarding haptic/tactile feedback are surveyed. Our VR/TX system is proposed as a solution for adding tactile feedback to open-air controllers; experiments show that the VR/TX vibrotactile stimulators provide invaluable perceptually-significant tactile feedback when used in conjunction with an open-air music controller. A typology of tactile sound events is also described, as well as the notion of a tactile simulation event (TSE).

[1]  George A. Gescheider,et al.  Some Comparisons between Touch and Hearing , 1970 .

[2]  S J Lederman,et al.  Exploring environments by hand or foot: time-based heuristics for encoding distance in movement space. , 1987, Journal of experimental psychology. Learning, memory, and cognition.

[3]  Claude Cadoz,et al.  Instrumental Gestures and Musical Composition , 1988, ICMC.

[4]  Sylvie Gibet,et al.  Instrumental Gesture Modeling by Identification with Time-varying Mechanical Models , 1988, ICMC.

[5]  Claude Cadoz,et al.  Capture, Representation and "Composition" of the Instrumental Gesture , 1990, ICMC.

[6]  Claude Cadoz,et al.  Modular Feedback Keyboard , 1990, ICMC.

[7]  Ove Franzén,et al.  Information Processing in the Somatosensory System , 1991 .

[8]  Claude Cadoz.  Le geste canal de communication homme / machine. Models for gestual interactions. , 1992 .

[9]  Chris Chafe.  Tactile Audio Feedback , 1993, ICMC.

[10]  Bert Bongers,et al.  The use of active tactile and force feedback in timbre controlling electronic instruments , 1994, International Conference on Mathematics and Computing.

[11]  Shuji Hashimoto,et al.  Gesture Analysis Using 3D Acceleration Sensor for Music Control , 1995, ICMC.

[12]  Vincent Hayward,et al.  Performance Measures for Haptic Interfaces , 1996 .

[13]  Lonny L. Chu.  Haptic Feedback in Computer Music Performance , 1996 .

[14]  Marcelo M. Wanderley,et al.  Instrumental Gestural Mapping Strategies as Expressivity Determinants in Computer Music Performance , 1997 .

[15]  David Wessel,et al.  Communication of Musical Gesture using the AES/EBU Digital Audio Standard , 1998, ICMC.