MusicJacket—Combining Motion Capture and Vibrotactile Feedback to Teach Violin Bowing

We describe MusicJacket, which is a wearable system to support the teaching of good posture and bowing technique to novice violin players. The system uses an inertial motion capture system to track the following in real time: 1) whether the player is holding the violin correctly and 2) the player's bowing action and whether it deviates from a target trajectory. We provide the musicians with vibrotactile feedback about their bowing and posture using vibration motors that are positioned on their arms and torso. We describe a user study with novice violin players that compared a group who was trained using vibrotactile feedback with a control group who only received conventional teaching. We found that vibrotactile feedback is effective at improving novices' straight bowing technique and that half of these subjects continued to show improved bowing technique even when they no longer received vibrotactile feedback. None of the control subjects who received the same number of training sessions using conventional teaching techniques showed a comparable improvement.

[1]  Janet van der Linden,et al.  Towards a real-time system for teaching novices correct violin bowing technique , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[2]  Marcelo M. Wanderley,et al.  Vibrotactile Feedback in Digital Musical Instruments , 2006, NIME.

[3]  E A BILODEAU,et al.  Some effects of introducing and withdrawing knowledge of results early and late in practice. , 1959, Journal of experimental psychology.

[4]  Kamiar Aminian,et al.  Capturing human motion using body‐fixed sensors: outdoor measurement and clinical applications , 2004, Comput. Animat. Virtual Worlds.

[5]  Simon Holland,et al.  Feeling the beat where it counts: fostering multi-limb rhythm skills with the haptic drum kit , 2010, TEI '10.

[6]  Lukas Jaeger,et al.  Learning to Play the Violin: Motor Control by Freezing, Not Freeing Degrees of Freedom , 2009, Journal of motor behavior.

[7]  Yvonne Rogers,et al.  Low-fi skin vision: a case study in rapid prototyping a sensory substitution system , 2009, BCS HCI.

[8]  Masatoshi Ishikawa,et al.  Augmenting spatial awareness with Haptic Radar , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[9]  Erwin Schoonderwaldt,et al.  Good vibrations: Guiding body movements with vibrotactile feedback , 2009 .

[10]  Jan O. Borchers,et al.  Tactile motion instructions for physical activities , 2009, CHI.

[11]  AminianKamiar,et al.  Capturing human motion using body-fixed sensors: outdoor measurement and clinical applications , 2004 .

[12]  Norman I. Badler,et al.  Virtual Training via Vibrotactile Arrays , 2008, PRESENCE: Teleoperators and Virtual Environments.

[13]  Victor Lazzarini.  Erratum: New Digital Musical Instruments: Control and Interaction Beyond the Keyboard , 2008, Computer Music Journal.

[14]  Bee Ong,et al.  SONIFICATION OF BOWING FEATURES FOR STRING INSTRUMENT TRAINING , 2008 .

[15]  Gaetano Borriello,et al.  Guest Editors' Introduction: Pervasive Computing in Sports Technologies , 2005, IEEE Pervasive Comput..

[16]  Abdulmotaleb El-Saddik,et al.  Haptic Virtual Rehabilitation Exercises for Poststroke Diagnosis , 2008, IEEE Transactions on Instrumentation and Measurement.

[17]  Erwin Schoonderwaldt.  Mechanics and acoustics of violin bowing : Freedom, constraints and control in performance , 2009 .

[18]  Graham Grindlay,et al.  Haptic Guidance Benefits Musical Motor Learning , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[19]  Cynthia Breazeal,et al.  TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning , 2007, IEEE Transactions on Robotics.