Multi-point vibrotactile feedback for an expressive musical interface

This paper describes the design of a hardware/software system for rendering multi-point, localized vibrotactile feedback in a multi-touch musical interface. A prototype was developed, based on the Madrona Labs Soundplane, which was chosen for it provides easy access to multi-touch data, including force, and its easily expandable layered construction. The proposed solution makes use of several piezo actuator discs, densely arranged in a honeycomb pattern on a thin PCB layer. Based on off-the-shelf components, custom amplifying and routing electronics were designed to drive each piezo element with standard audio signals. Features, as well as electronic and mechanical issues of the current prototype are discussed.

[1]  S. Bolanowski,et al.  Four channels mediate the mechanical aspects of touch. , 1988, The Journal of the Acoustical Society of America.

[2]  Teemu Tuomas Ahmaniemi,et al.  Gesture Controlled Virtual Instrument with Dynamic Vibrotactile Feedback , 2010, NIME.

[3]  Peter F. Driessen,et al.  A Force-Sensitive Surface for Intimate Control , 2009, NIME.

[4]  Claude Cadoz,et al.  A Modular Feedback Keyboard Design , 1990 .

[5]  Erik V. Jansson,et al.  On Vibration Sensation and Finger Touch in Stringed Instrument Playing , 1992 .

[6]  Edgar Berdahl,et al.  Advancements in Actuated Musical Instruments , 2011, Organised Sound.

[7]  Caroline Palmer,et al.  Tactile feedback and timing accuracy in piano performance , 2008, Experimental Brain Research.

[8]  Stefano Papetti,et al.  Vibrotactile sensitivity in active finger pressing , 2015, 2015 IEEE World Haptics Conference (WHC).

[9]  R. T. Verrillo,et al.  Vibration Sensation in Humans , 1992 .

[10]  Charles Nichols.  The vBow: development of a virtual violin bow haptic human-computer interface , 2002 .

[11]  Marcelo M. Wanderley,et al.  A Systematic Approach to Musical vibrotactile feedback , 2007, ICMC.

[12]  Federico Avanzini,et al.  Perception of Interactive Vibrotactile Cues on the Acoustic Grand and Upright Piano , 2014, ICMC.

[13]  M. Sile O'Modhrain,et al.  A Framework for the Evaluation of Digital Musical Instruments , 2011, Computer Music Journal.

[14]  Suranga Nanayakkara,et al.  Palm-area sensitivity to vibrotactile stimuli above 1~kHz , 2012, NIME.

[15]  S S Hsiao,et al.  Detection of vibration transmitted through an object grasped in the hand. , 1999, Journal of neurophysiology.

[16]  Marcelo M. Wanderley,et al.  Vibrotactile Feedback in Digital Musical Instruments , 2006, NIME.

[17]  Lauren Hayes,et al.  Vibrotactile Feedback-Assisted Performance , 2011, NIME.

[18]  J. Kelso,et al.  Binding of movement, sound and touch: multimodal coordination dynamics , 2006, Experimental Brain Research.

[19]  Ellen Yi-Luen Do,et al.  PianoTouch: A wearable haptic piano instruction system for passive learning of piano skills , 2008, 2008 12th IEEE International Symposium on Wearable Computers.

[20]  Marcelo M. Wanderley,et al.  Examining the Effects of Embedded Vibrotactile Feedback on the Feel of a Digital Musical Instrument , 2011, NIME.

[21]  Stefania Serafin,et al.  Influence of Attack Parameters on the Playability of a Virtual Bowed String Instrument , 2000, ICMC.

[22]  Chris Chafe.  Tactile Audio Feedback , 1993, ICMC.

[23]  Federico Fontana,et al.  AN EXPLORATION ON THE INFLUENCE OF VIBROTACTILE CUES DURING DIGITAL PIANO PLAYING , 2011 .

[24]  M. Sile O'Modhrain,et al.  Cutaneous Grooves: Composing for the Sense of Touch , 2002 .