An Online sEMG Motion Classification Framework for Tele-operating the Robotic Hand

Seamless communication between human intended motions and robot actions is essential for Human-Robot Interaction (HRI). When tele-operating a robotic hand, it is a natural and effective way via surface electromyography (sEMG) signals. This paper proposes an online sEMG motion classification framework for tele-operating the robotic hand. The whole framework consists of offline training and online recognition phases. In the offline training phase, three features were selected from four candidates and Artificial Neural Network (ANN) won the election among three classifiers. Inthe online recognition phase, two-thresholds data segmentation and majority voting techniques were designed, and three subjects participated in online experiment to verify the feasibility of this framework. The online experimental results show that the average total accuracy is 73.56% and the average vote accuracy is 91.67%. The outcomes of this study have shown the promising potential of sEMG-based HRI.

[1]  Clément Gosselin,et al.  Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  Elisabeth André,et al.  EMG-based hand gesture recognition for realtime biosignal interfacing , 2008, IUI '08.

[3]  Kongqiao Wang,et al.  Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors , 2009, IUI.

[4]  Ho Chit Siu,et al.  Implementation of a Surface Electromyography-Based Upper Extremity Exoskeleton Controller Using Learning from Demonstration , 2018, Sensors.

[5]  Panagiotis K. Artemiadis,et al.  EMG-Based Control of a Robot Arm Using Low-Dimensional Embeddings , 2010, IEEE Transactions on Robotics.

[6]  Jun Morimoto,et al.  Learning assistive strategies for exoskeleton robots from user-robot physical interaction , 2017, Pattern Recognit. Lett..

[7]  Dario Farina,et al.  Multiday EMG-Based Classification of Hand Motions with Deep Learning Techniques , 2018, Sensors.

[8]  Keehoon Kim,et al.  Tele-operation system with reliable grasping force estimation to compensate for the time-varying sEMG feature , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Reza Langari,et al.  EMG and IMU based real-time HCI using dynamic hand gestures for a multiple-DoF robot arm , 2018, J. Intell. Fuzzy Syst..

[10]  Daniela Rus,et al.  Sharing the Load: Human-Robot Team Lifting Using Muscle Activity , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[11]  Louis Vuurpijl,et al.  An overview and comparison of voting methods for pattern recognition , 2002, Proceedings Eighth International Workshop on Frontiers in Handwriting Recognition.

[12]  M. Bergamasco,et al.  A New Gaze-BCI-Driven Control of an Upper Limb Exoskeleton for Rehabilitation in Real-World Tasks , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Keehoon Kim,et al.  A preliminary analysis of analysis window size and voting size with a time delay for a robust real-time sEMG pattern recognition , 2014, 2014 11th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[14]  Robert Riener,et al.  Enhancing patient freedom in rehabilitation robotics using gaze-based intention detection , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[15]  Mohan S. Kankanhalli,et al.  A multi-stream convolutional neural network for sEMG-based gesture recognition in muscle-computer interface , 2017, Pattern Recognit. Lett..

[16]  Farbod Fahimi,et al.  Online human training of a myoelectric prosthesis controller via actor-critic reinforcement learning , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[17]  Xun Chen,et al.  Feasibility Study of Advanced Neural Networks Applied to sEMG-Based Force Estimation , 2018, Sensors.

[18]  Manfredo Atzori,et al.  Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands , 2016, Front. Neurorobot..

[19]  Blair A. Lock,et al.  Determining the Optimal Window Length for Pattern Recognition-Based Myoelectric Control: Balancing the Competing Effects of Classification Error and Controller Delay , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  C Grozea,et al.  On the feasibility of using motor imagery EEG-based brain–computer interface in chronic tetraplegics for assistive robotic arm control: a clinical test and long-term post-trial follow-up , 2012, Spinal Cord.

[21]  Yijun Wang,et al.  Control of a 7-DOF Robotic Arm System With an SSVEP-Based BCI , 2018, Int. J. Neural Syst..