Buzzing to play: lessons learned from an in the wild study of real-time vibrotactile feedback

Vibrotactile feedback offers much potential for facilitating and accelerating how people learn sensory-motor skills that typically take hundreds of hours to learn, such as learning to play a musical instrument, skiing or swimming. However, there is little evidence of this benefit materializing outside of research lab settings. We describe the findings of an in-the-wild study that explored how to integrate vibrotactile feedback into a real-world teaching setting. The focus of the study was on exploring how children of different ages, learning to play the violin, can use real-time vibrotactile feedback. Many of the findings were unexpected, showing how students and their teachers appropriated the technology in creative ways. We present some 'lessons learned' that are also applicable to other training settings, emphasizing the need to understand how vibrotactile feedback can switch between being foregrounded and backgrounded depending on the demands of the task, the teacher's role in making it work and when feedback is most relevant and useful. Finally, we discuss how vibrotactile feedback can provide a new language for talking about the skill being learned that may also play an instrumental role in enhancing learning.

[1]  Erwin Schoonderwaldt Mechanics and acoustics of violin bowing : Freedom, constraints and control in performance , 2009 .

[2]  Tillman Weyde,et al.  3d augmented mirror: a multimodal interface for string instrument learning and teaching with gesture support , 2007, ICMI '07.

[3]  Abdulmotaleb El-Saddik,et al.  Haptic Virtual Rehabilitation Exercises for Poststroke Diagnosis , 2008, IEEE Transactions on Instrumentation and Measurement.

[4]  Graham Charles Grindlay The impact of haptic guidance on musical motor learning , 2007 .

[5]  Martin Pielot,et al.  Tactile Wayfinder: Comparison of Tactile Waypoint Navigation with Commercial Pedestrian Navigation Systems , 2010, Pervasive.

[6]  Janet van der Linden,et al.  Towards a real-time system for teaching novices correct violin bowing technique , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[7]  John Zimmerman,et al.  User experience over time: an initial framework , 2009, CHI.

[8]  Stephen A. Brewster,et al.  Crosstrainer: testing the use of multimodal interfaces in situ , 2010, CHI.

[9]  Simon Holland,et al.  Feeling the beat where it counts: fostering multi-limb rhythm skills with the haptic drum kit , 2010, TEI '10.

[10]  Lukas Jaeger,et al.  Learning to Play the Violin: Motor Control by Freezing, Not Freeing Degrees of Freedom , 2009, Journal of motor behavior.

[11]  Kay M. Stanney,et al.  Deriving haptic design guidelines from human physiological, psychophysical, and neurological foundations , 2004, IEEE Computer Graphics and Applications.

[12]  Thomas Hermann,et al.  Augmented Haptics - An Interactive Feedback System for Musicians , 2009, HAID.

[13]  Yvonne Rogers,et al.  Why It's Worth the Hassle: The Value of In-Situ Studies When Designing Ubicomp , 2007, UbiComp.

[14]  Jan O. Borchers,et al.  Tactile motion instructions for physical activities , 2009, CHI.

[15]  Ellen Yi-Luen Do,et al.  Mobile music touch: mobile tactile stimulation for passive learning , 2010, CHI.

[16]  Cynthia Breazeal,et al.  TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning , 2007, IEEE Transactions on Robotics.

[17]  Norman I. Badler,et al.  Virtual Training via Vibrotactile Arrays , 2008, PRESENCE: Teleoperators and Virtual Environments.

[18]  Michael Scott,et al.  Effect of cognitive load on tactor location identification in zero-g , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[19]  Francis Jambon,et al.  User experience evaluation in the wild , 2009, CHI Extended Abstracts.

[20]  Erwin Schoonderwaldt,et al.  MusicJacket—Combining Motion Capture and Vibrotactile Feedback to Teach Violin Bowing , 2011, IEEE Transactions on Instrumentation and Measurement.