Mobile Music Touch: The effect of primary tasks on passively learning piano sequences

The Mobile Music Touch (MMT) system allows users to learn to reproduce piano note sequences while performing other tasks. The system consists of a mobile Bluetooth-enabled computing device and a fingerless glove with embedded vibrators corresponding to each finger and thumb. Melodies to be learned are played over the user's headphones repeatedly. As each note is played, the finger corresponding to the appropriate piano key is stimulated. Past experiments have shown that users could learn simple note sequences even though they were performing a reading comprehension test. Here, we investigate different primary tasks to determine which, if any, interfere with the Passive Haptic Learning (PHL) effect. In a 12 participant within-subject user study, no overall difference was observed in the number of passive sessions required to learn a random note sequence when users viewed a film, played a memory game, or followed a walking path as their primary task. However, individual differences in scores suggest that the type of primary task may have a greater or lesser effect for a given user.

[1]  Ferdinando A. Mussa-Ivaldi,et al.  Robot-assisted adaptive training: custom force fields for teaching movement patterns , 2004, IEEE Transactions on Biomedical Engineering.

[2]  Blake Hannaford,et al.  Virtual Training for a Manual Assembly Task , 2001 .

[3]  Xing-Dong Yang,et al.  Validating the Performance of Haptic Motor Skill Training , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[4]  Frank Tendick,et al.  Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[5]  Craig Edwin Lewiston,et al.  MaGKeyS : a haptic guidance keyboard system for facilitating sensorimotor training and rehabilitation , 2009 .

[6]  Graham Grindlay,et al.  Haptic Guidance Benefits Musical Motor Learning , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[7]  Thenkurussi Kesavadas,et al.  Motor skill training assistance using haptic attributes , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[8]  Graham Charles Grindlay The impact of haptic guidance on musical motor learning , 2007 .

[9]  Ellen Yi-Luen Do,et al.  Mobile music touch: mobile tactile stimulation for passive learning , 2010, CHI.

[10]  H. E. Krugman,et al.  PASSIVE LEARNING FROM TELEVISION , 1970 .

[11]  John Kenneth Salisbury,et al.  Haptic Feedback Enhances Force Skill Learning , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[12]  Thomas R. Tretter,et al.  A comparison of learning with haptic and visual modalities. , 2005 .