EMG-based teleoperation of a robot arm using low-dimensional representation

In robot teleoperation scenarios, the interface between the user and the robot is undoubtedly of high importance. In this paper, electromyographic (EMG) signals from muscles of the human upper limb are used as the control interface between the user and a remote robot arm. The proposed interface consists of surface EMG electrodes, placed at the user's skin at several locations on the arm, letting the user's upper limb free of bulky interface sensors or machinery usually found in conventional teleoperation systems. The motion of the human upper limb entails the activation of a large number of muscles (i.e. more than 30 muscles, not including finger movements). Moreover, the human arm has 7 degrees of freedom (DoFs) suggesting a wide variety of motions. Therefore, the mapping between these two high-dimensional data (i.e. the muscles activation and the motion of the human arm), is an extremely challenging issue. For this reason, a novel methodology is proposed here, where the mapping between the muscles activation and the motion of the user's arm is done in a low-dimensional space. Each of the high-dimensional input (muscle activation) and output (arm motion) vectors, is transformed into an individual low-dimensional space, where the mapping between the two low-dimensional vectors is then feasible. A state-space model is trained to map the low-dimensional representation of the muscles activation to the corresponding motion of the user's arm. After training, the state-space model can decode the human arm motion in real time with high accuracy, using only EMG recordings. The estimated motion is used to control a remote anthropomorphic robot arm. The accuracy of the proposed method is assessed through real-time experiments including motion in two-dimensional (2D) space.

[1]  K.J. Kyriakopoulos,et al.  Modeling, full identification and control of the mitsubishi PA-10 robot arm , 2007, 2007 IEEE/ASME international conference on advanced intelligent mechatronics.

[2]  Francesco Lacquaniti,et al.  Control of Fast-Reaching Movements by Muscle Synergy Combinations , 2006, The Journal of Neuroscience.

[3]  Panagiotis K. Artemiadis,et al.  Teleoperation of a robot manipulator using EMG signals and a position tracker , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Frank Chongwoo Park,et al.  Movement Primitives, Principal Component Analysis, and the Efficient Generation of Natural Motions , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[5]  F. Zajac Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. , 1989, Critical reviews in biomedical engineering.

[6]  J. Edward Jackson,et al.  A User's Guide to Principal Components: Jackson/User's Guide to Principal Components , 2004 .

[7]  Panagiotis K. Artemiadis,et al.  EMG-based teleoperation of a robot arm in planar catching movements using ARMAX model and trajectory monitoring techniques , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[8]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[9]  Hong Liu,et al.  Levenberg-Marquardt Based Neural Network Control for a Five-fingered Prosthetic Hand , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[10]  J. Edward Jackson,et al.  A User's Guide to Principal Components. , 1991 .

[11]  J. Cram,et al.  Introduction to Surface Electromyography , 1998 .

[12]  Katsunori Shimohara,et al.  EMG pattern analysis and classification by neural network , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.

[13]  Richard T. Johnson,et al.  Development of the Utah Artificial Arm , 1982, IEEE Transactions on Biomedical Engineering.

[14]  Toshio Tsuji,et al.  A human-assisting manipulator teleoperated by EMG signals and arm motions , 2003, IEEE Trans. Robotics Autom..

[15]  Tzyh Jong Tarn,et al.  Intelligent planning and control for telerobotic operations , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[16]  J. E. Jackson A User's Guide to Principal Components , 1991 .

[17]  Ian D. Walker,et al.  Myoelectric teleoperation of a complex robotic hand , 1996, IEEE Trans. Robotics Autom..

[18]  Patrick van der Smagt,et al.  Learning EMG control of a robotic hand: towards active prostheses , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[19]  Oussama Khatib,et al.  A Haptic Teleoperation Approach Based on Contact Force Control , 2006, Int. J. Robotics Res..

[20]  Masaru Uchiyama,et al.  Model-based space robot teleoperation of ETS-VII manipulator , 2004, IEEE Transactions on Robotics and Automation.