Naviarm: Augmenting the Learning of Motor Skills using a Backpack-type Robotic Arm System

We present a wearable haptic assistance robotic system for augmented motor learning called Naviarm. This system comprises two robotic arms that are mounted on a user's body and are used to transfer one person's motion to another offline. Naviarm pre-records the arm motion trajectories of an expert via the mounted robotic arms and then plays back these recorded trajectories to share the expert's body motion with a beginner. The Naviarm system is an ungrounded system and provides mobility for the user to conduct a variety of motions. In this paper, we focus on the temporal aspect of motor skill and use a mime performance as a case study learning task. We verified the system effectiveness for motor learning using the conducted experiments. The results suggest that the proposed system has benefits for learning sequential skills.

[1]  Cynthia Breazeal,et al.  TIKL: Development of a Wearable Vibrotactile Feedback Suit for Improved Human Motor Learning , 2007, IEEE Transactions on Robotics.

[2]  Michitaka Hirose,et al.  Wearable Display System for Handing Down Intangible Cultural Heritage , 2011, HCI.

[3]  David J. Reinkensmeyer,et al.  Haptic Guidance Can Enhance Motor Learning of a Steering Task , 2008, Journal of motor behavior.

[4]  Xing-Dong Yang,et al.  Validating the Performance of Haptic Motor Skill Training , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[5]  Motonobu Ishii,et al.  Effect of Metaphorical Verbal Instruction on Modeling of Sequential Dance Skills by Young Children , 2002, Perceptual and motor skills.

[6]  Hiroo Iwata,et al.  Development of a non-grounded haptic interface using the gyro effect , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[7]  Frank Tendick,et al.  Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[8]  Hongsong Li,et al.  OutsideMe: Augmenting Dancer's External Self-Image by Using A Mixed Reality System , 2015, CHI Extended Abstracts.

[9]  Kuniyasu Imanaka,et al.  Effect of Manual Guidance on Acquiring a New Bimanual Coordination Pattern , 2003, Research quarterly for exercise and sport.

[10]  Pedro Lopes,et al.  Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation , 2017, CHI.

[11]  Jun Rekimoto,et al.  Around me: a system with an escort robot providing a sports player's self-images , 2014, AH.

[12]  E. Hebert,et al.  The influence of self-talk on the performance of skilled female tennis players , 1999 .

[13]  Michitaka Hirose,et al.  HapticGEAR: the development of a wearable force display system for immersive projection displays , 2001, Proceedings IEEE Virtual Reality 2001.

[14]  Antonio Frisoli,et al.  Motor learning skill experiments using haptic interface capabilities , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[15]  Seungmoon Choi,et al.  Effects of haptic guidance and disturbance on motor learning: Potential advantage of haptic disturbance , 2010, 2010 IEEE Haptics Symposium.

[16]  M. Sile O'Modhrain,et al.  The Virtual Teacher , 1999 .

[17]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[18]  Jun Rekimoto,et al.  MoveMe: 3D haptic support for a musical instrument , 2015, Advances in Computer Entertainment.

[19]  Graham Grindlay,et al.  Haptic Guidance Benefits Musical Motor Learning , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[20]  P. Wiseman.  The Virtual Teacher , 1998 .

[21]  Makoto Sato,et al.  Wearable 6-DoF wrist haptic device "SPIDAR-W" , 2015, SIGGRAPH Asia Haptic Media And Contents Design.

[22]  Keita Higuchi,et al.  Flying sports assistant: external visual imagery representation for sports training , 2011, AH '11.

[23]  Tatsuo Nakajima,et al.  HapticSerpent: A Wearable Haptic Feedback Robot for VR , 2018, CHI Extended Abstracts.

[24]  Jun Kinugawa,et al.  Dance Teaching by a Robot: Combining Cognitive and Physical Human–Robot Interaction for Supporting the Skill Learning Process , 2017, IEEE Robotics and Automation Letters.

[25]  Haruhisa Kawasaki,et al.  A fine motor skill training system using multi-fingered haptic interface robot , 2015, Int. J. Hum. Comput. Stud..

[26]  Kai Kunze,et al.  MetaArms: Body Remapping Using Feet-Controlled Artificial Arms , 2018, UIST.

[27]  Geehyuk Lee,et al.  Thor's Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force , 2018, CHI.

[28]  Masahiko Inami,et al.  Fusion: full body surrogacy for collaborative communication , 2018, SIGGRAPH Emerging Technologies.

[29]  John Kenneth Salisbury,et al.  Haptic Feedback Enhances Force Skill Learning , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[30]  Robert Bogue,et al.  Robotic exoskeletons: a review of recent progress , 2015, Ind. Robot.