Accelerating Skill Acquisition of Two-Handed Drumming using Pneumatic Artificial Muscles

While computers excel at augmenting user's cognitive abilities, only recently we started utilizing their full potential to enhance our physical abilities. More and more wearable force-feedback devices have been developed based on exoskeletons, electrical muscle stimulation (EMS) or pneumatic actuators. The latter, pneumatic-based artificial muscles, are of particular interest since they strike an interesting balance: lighter than exoskeletons and more precise than EMS. However, the promise of using artificial muscles to actually support skill acquisition and training users is still lacking empirical validation. In this paper, we unveil how pneumatic artificial muscles impact skill acquisition, using two-handed drumming as an example use case. To understand this, we conducted a user study comparing participants' drumming performance after training with the audio or with our artificial-muscle setup. Our haptic system is comprised of four pneumatic muscles and is capable of actuating the user's forearm to drum accurately up to 80 bpm. We show that pneumatic muscles improve participants' correct recall of drumming patterns significantly when compared to auditory training.

[1]  J. Krakauer,et al.  Consolidation of motor memory , 2006, Trends in Neurosciences.

[2]  Pedro Lopes,et al.  Adding Force Feedback to Mixed Reality Experiences and Games using Electrical Muscle Stimulation , 2018, CHI.

[3]  Gary E. McPherson,et al.  Commitment and Practice: Key Ingredients for Achievement During the Early Stages of Learning a Musical Instrument* , 2000 .

[4]  Frank Tendick,et al.  Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[5]  Bertrand Tondu,et al.  Modelling of the McKibben artificial muscle: A review , 2012 .

[6]  Yasuhisa Hasegawa,et al.  Five-fingered assistive hand with mechanical compliance of human finger , 2008, 2008 IEEE International Conference on Robotics and Automation.

[7]  D. Reinkensmeyer,et al.  The effect of haptic guidance, aging, and initial skill level on motor learning of a steering task , 2009, Experimental Brain Research.

[8]  Tatsuyuki Ohtsuki,et al.  Tapping performance and underlying wrist muscle activity of non-drummers, drummers, and the world's fastest drummer , 2009, Neuroscience Letters.

[9]  Simon Holland,et al.  Feeling the beat where it counts: fostering multi-limb rhythm skills with the haptic drum kit , 2010, TEI '10.

[10]  Peter Wolf,et al.  The role of skill level and motor task characteristics on the effectiveness of robotic training: first results , 2015, 2015 IEEE International Conference on Rehabilitation Robotics (ICORR).

[11]  Jun Rekimoto,et al.  MoveMe: 3D haptic support for a musical instrument , 2015, Advances in Computer Entertainment.

[12]  Pedro Lopes,et al.  Muscle-propelled force feedback: bringing force feedback to mobile devices , 2013, CHI.

[13]  D. C. Shapiro,et al.  Summary knowledge of results for skill acquisition: support for the guidance hypothesis. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[14]  R. Schmidt,et al.  Knowledge of results and motor learning: a review and critical reappraisal. , 1984, Psychological bulletin.

[15]  Tatsuyuki Ohtsuki,et al.  Wrist muscle activity during rapid unimanual tapping with a drumstick in drummers and nondrummers. , 2009, Motor control.

[16]  Pedro Lopes,et al.  Affordance++: Allowing Objects to Communicate Dynamic Use , 2015, CHI.

[17]  Toshio Tsuji,et al.  VR Training System of Step Timing for Baseball Batter Using Force Stimulus , 2018, AsiaHaptics.

[18]  Toshio Tsuji,et al.  Development of a pneumatic artificial muscle driven by low pressure and its application to the unplugged powered suit , 2017, Adv. Robotics.

[19]  François Champoux,et al.  Musicians react faster and are better multisensory integrators , 2017, Brain and Cognition.

[20]  Aaron M. Dollar,et al.  Biomechanical considerations in the design of lower limb exoskeletons , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[21]  Toshio Tsuji,et al.  Soft Wearable Augmented Walking Suit With Pneumatic Gel Muscles and Stance Phase Detection System to Assist Gait , 2018, IEEE Robotics and Automation Letters.

[22]  Yuichi Kurita,et al.  Unplugged Powered Suit for Superhuman Tennis , 2018, 2018 12th France-Japan and 10th Europe-Asia Congress on Mechatronics.

[23]  Shingo Oda,et al.  Tapping Speed Asymmetry in Drummers for Single-Hand Tapping with a Stick , 2006, Perceptual and motor skills.

[24]  A. Gorgey.  Robotic exoskeletons: The current pros and cons , 2018, World journal of orthopedics.

[25]  Hideki Koike,et al.  Soft Exoskeleton Glove Enabling Force Feedback for Human-Like Finger Posture Control with 20 Degrees of Freedom , 2019, 2019 IEEE World Haptics Conference (WHC).

[26]  John Kenneth Salisbury,et al.  Haptic Feedback Enhances Force Skill Learning , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[27]  George Lawrence Stone,et al.  Stick Control: For the Snare Drummer , 2009 .

[28]  Yifei Zhang,et al.  Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR , 2016, CHI.

[29]  M. Guadagnoli,et al.  Challenge Point: A Framework for Conceptualizing the Effects of Various Practice Conditions in Motor Learning , 2004, Journal of motor behavior.

[30]  Pedro Lopes,et al.  Immense Power in a Tiny Package: Wearables Based on Electrical Muscle Stimulation , 2017, IEEE Pervasive Computing.

[31]  Kai Kunze,et al.  Artificial Motion Guidance: an Intuitive Device based on Pneumatic Gel Muscle (PGM) , 2018, UIST.

[32]  H. Kazerooni,et al.  Biomechanical design of the Berkeley lower extremity exoskeleton (BLEEX) , 2006, IEEE/ASME Transactions on Mechatronics.

[33]  Toshio Tsuji,et al.  ForceHand Glove: A Wearable Force-Feedback Glove With Pneumatic Artificial Muscles (PAMs) , 2018, IEEE Robotics and Automation Letters.

[34]  Swagata Das,et al.  Muscleblazer: Force-Feedback Suit for Immersive Experience , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[35]  Pedro Lopes,et al.  Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation , 2017, CHI.

[36]  Jody L. Jensen,et al.  Effectiveness of Auditory and Visual Sensory Feedback for Children When Learning a Continuous Motor Task , 2009, Perceptual and motor skills.

[37]  Dirk Lefeber,et al.  Pneumatic artificial muscles: Actuators for robotics and automation , 2002 .

[38]  Seungmoon Choi,et al.  Effects of haptic guidance and disturbance on motor learning: Potential advantage of haptic disturbance , 2010, 2010 IEEE Haptics Symposium.

[39]  Yuichi Kurita,et al.  Gait Evaluation on Parkinson’s Disease Patients Using Spontaneous Stimulus Induced by UPS-PD , 2019, 2019 IEEE/SICE International Symposium on System Integration (SII).

[40]  Thomas P. Rohrer.  The science and psychology of music performance: creative strategies for teaching and learning , 2004 .

[41]  Stijn Verwulgen,et al.  Vibrotactile feedback as a tool to improve motor learning and sports performance: a systematic review , 2017, BMJ Open Sport & Exercise Medicine.

[42]  Masataka Yamamoto,et al.  Development of New Soft Wearable Balance Exercise Device Using Pneumatic Gel Muscles , 2019, Applied Sciences.

[43]  Jun Rekimoto,et al.  PossessedHand: techniques for controlling human hands using electrical muscles stimuli , 2011, CHI.