Effects of multi-modal guidance for the acquisition of sight reading skills: A case study with simple drum sequences

We introduce a learning system for the sight reading skill of simple drum sequences. Sight reading is a cognitive-motor skill that requires reading of music symbols and actions of multiple limbs for playing the music. The system provides knowledge of results (KR) pertaining to the learner's performance by color-coding music symbols, and guides the learner by indicating the corresponding action for a given music symbol using additional auditory or vibrotactile cues. To evaluate the effects of KR and guidance cues, three learning methods were experimentally compared: KR only, KR with auditory cues, and KR with vibrotactile cues. The task was to play random 16-note-long drum sequence displayed on a screen. Thirty university students learned the task using one of the learning methods in a between-subjects design. The experimental results did not show statistically significant differences between the methods in terms of task accuracy and completion time. This suggests that KR can be dominant for learning the task and the role of guidance cues can be subsidiary.

[1]  Richard A. Schmidt,et al.  Frequent Augmented Feedback Can Degrade Learning: Evidence and Interpretations , 1991 .

[2]  Richard A. Magill,et al.  Motor Learning. Concepts and Applications , 1998 .

[3]  Simon Holland,et al.  Feeling the beat where it counts: fostering multi-limb rhythm skills with the haptic drum kit , 2010, TEI '10.

[4]  Marcia Kilchenman O'Malley,et al.  Progressive haptic and visual guidance for training in a virtual dynamic task , 2010, 2010 IEEE Haptics Symposium.

[5]  A. Baddeley.  Human Memory: Theory and Practice, Revised Edition , 1990 .

[6]  Yvonne Rogers,et al.  Buzzing to play: lessons learned from an in the wild study of real-time vibrotactile feedback , 2011, CHI.

[7]  Marcia Kilchenman O'Malley,et al.  The Task-Dependent Efficacy of Shared-Control Haptic Guidance Paradigms , 2012, IEEE Transactions on Haptics.

[8]  Graham Grindlay,et al.  Haptic Guidance Benefits Musical Motor Learning , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[9]  D. Reinkensmeyer,et al.  Review of control strategies for robotic movement training after neurologic injury , 2009, Journal of NeuroEngineering and Rehabilitation.

[10]  Mark R. Cutkosky,et al.  Haptic gait retraining for knee osteoarthritis treatment , 2010, 2010 IEEE Haptics Symposium.

[11]  Norman I. Badler,et al.  Virtual Training via Vibrotactile Arrays , 2008, PRESENCE: Teleoperators and Virtual Environments.

[12]  Jan O. Borchers,et al.  Tactile motion instructions for physical activities , 2009, CHI.

[13]  Katherine J. Kuchenbecker,et al.  Lessons in using vibrotactile feedback to guide fast arm motions , 2011, 2011 IEEE World Haptics Conference.

[14]  Ellen Yi-Luen Do,et al.  Mobile music touch: mobile tactile stimulation for passive learning , 2010, CHI.

[15]  Cynthia Breazeal,et al.  TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning , 2007, IEEE Transactions on Robotics.

[16]  Seungmoon Choi,et al.  Effects of haptic guidance and disturbance on motor learning: Potential advantage of haptic disturbance , 2010, 2010 IEEE Haptics Symposium.

[17]  E. Lechelt.  Temporal numerosity discrimination: intermodal comparisons revisited. , 1975, British journal of psychology.

[18]  E Bizzi,et al.  Augmented Feedback Presented in a Virtual Environment Accelerates Learning of a Difficult Motor Task. , 1997, Journal of motor behavior.

[19]  Reinhard Kopiez,et al.  Towards a general model of skills involved in sight reading music , 2006 .

[20]  In Lee,et al.  Guidance methods for bimanual timing tasks , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[21]  R. Schmidt,et al.  Reduced frequency of knowledge of results enhances motor skill learning. , 1990 .

[22]  H. Gudmundsdottir,et al.  Advances in music-reading research , 2010 .

[23]  Seungmoon Choi,et al.  Perceptual space of amplitude-modulated vibrotactile stimuli , 2011, 2011 IEEE World Haptics Conference.

[24]  C. E. Chapman,et al.  Perception of vibrotactile stimuli during motor activity in human subjects , 2004, Experimental Brain Research.

[25]  Frank Tendick,et al.  Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[26]  Hideyuki Ando,et al.  Pace-sync shoes: intuitive walking-pace guidance based on cyclic vibro-tactile stimulation for the foot , 2009, Virtual Reality.