Mapping Three Electromyography Signals Generated by Human Elbow and Shoulder Movements to Two Degree of Freedom Upper-Limb Robot Control

This article sought to address issues related to human-robot cooperation tasks focusing especially on robotic operation using bio-signals. In particular, we propose to develop a control scheme for a robot arm based on electromyography (EMG) signal that allows a cooperative task between humans and robots that would enable teleoperations. A basic framework for achieving the task and conducting EMG signals analysis of the motion of upper limb muscles for mapping the hand motion is presented. The objective of this work is to investigate the application of a wearable EMG device to control a robot arm in real-time. Three EMG sensors are attached to the brachioradialis, biceps brachii, and anterior deltoid muscles as targeted muscles. Three motions were conducted by moving the arm about the elbow joint, shoulder joint, and a combination of the two joints giving a two degree of freedom. Five subjects were used for the experiments. The results indicated that the performance of the system had an overall accuracy varying from 50% to 100% for the three motions for all subjects. This study has further shown that upper-limb motion discrimination can be used to control the robotic manipulator arm with its simplicity and low computational cost.

[1]  Sonia Duprey,et al.  Kinematic models of the upper limb joints for multibody kinematics optimisation: An overview. , 2017, Journal of biomechanics.

[2]  Kojiro Matsushita,et al.  Preliminary research of surface electromyogram (sEMG) signal analysis for robotic arm control , 2020 .

[3]  Panagiotis K. Artemiadis,et al.  A Switching Regime Model for the EMG-Based Control of a Robot Arm , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Pornchai Phukpattaranont,et al.  Feature reduction and selection for EMG signal classification , 2012, Expert Syst. Appl..

[5]  Oluwarotimi Williams Samuel,et al.  Intelligent EMG Pattern Recognition Control Method for Upper-Limb Multifunctional Prostheses: Advances, Current Challenges, and Future Prospects , 2019, IEEE Access.

[6]  Olivier Gibaru,et al.  A Review on Electromyography Decoding and Pattern Recognition for Human-Machine Interaction , 2019, IEEE Access.

[7]  Nurhazimah Nazmi,et al.  A Review of Classification Techniques of EMG Signals during Isotonic and Isometric Contractions , 2016, Sensors.

[8]  Panagiotis K. Artemiadis,et al.  EMG-Based Control of a Robot Arm Using Low-Dimensional Embeddings , 2010, IEEE Transactions on Robotics.

[9]  Clément Gosselin,et al.  Intuitive Adaptive Orientation Control for Enhanced Human–Robot Interaction , 2019, IEEE Transactions on Robotics.

[10]  Toshio Tsuji,et al.  A human-assisting manipulator teleoperated by EMG signals and arm motions , 2003, IEEE Trans. Robotics Autom..

[11]  L. Benini,et al.  An sEMG-Based Human–Robot Interface for Robotic Hands Using Machine Learning and Synergies , 2018, IEEE Transactions on Components, Packaging and Manufacturing Technology.

[12]  Sadiq J. Abou-Loukh,et al.  Teleoperated robotic arm movement using electromyography signal with wearable Myo armband , 2020 .

[13]  Minoru Sasaki,et al.  24-Gaze-Point Calibration Method for Improving the Precision of AC-EOG Gaze Estimation , 2019, Sensors.

[14]  S. Okida,et al.  Robotic Arm Activation using Surface Electromyography with LABVIEW , 2016, IEEE Latin America Transactions.

[15]  Shuang Song,et al.  A Novel 6-D Tracking Method by Fusion of 5-D Magnetic Tracking and 3-D Inertial Sensing , 2018, IEEE Sensors Journal.

[16]  R. Suman,et al.  Industry 4.0 technologies and their applications in fighting COVID-19 pandemic , 2020, Diabetes & Metabolic Syndrome: Clinical Research & Reviews.

[17]  Lihui Wang,et al.  Human-robot collaborative assembly in cyber-physical production: Classification framework and implementation , 2017 .

[18]  Kamran Iqbal,et al.  Real-Time Task Discrimination for Myoelectric Control Employing Task-Specific Muscle Synergies , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Toshio Tsuji,et al.  EMG-based control of a multi-joint robot for operating a glovebox , 2014 .

[20]  Hsiu-Jen Liu,et al.  An Adaptive Upper-Arm EMG-Based Robot Control System , 2010 .

[21]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Angkoon Phinyomark,et al.  Feature Extraction and Selection for Myoelectric Control Based on Wearable EMG Sensors , 2018, Sensors.

[23]  Cuntai Guan,et al.  A review on EMG-based motor intention prediction of continuous human upper limb motion for human-robot collaboration , 2019, Biomed. Signal Process. Control..

[24]  Sachin Sharma,et al.  Movement control of robot in real time using EMG signal , 2012, 2012 2nd International Conference on Power, Control and Embedded Systems.

[25]  Youngjin Choi,et al.  Human shoulder motion extraction using EMG signals , 2014 .

[26]  Amar Ramdane-Cherif,et al.  Novel algorithm for conventional myocontrol of upper limbs prosthetics , 2020, Biomed. Signal Process. Control..

[27]  Reza Langari,et al.  EMG and IMU based real-time HCI using dynamic hand gestures for a multiple-DoF robot arm , 2018, J. Intell. Fuzzy Syst..

[28]  Lauren H Smith,et al.  A comparison of the real-time controllability of pattern recognition to conventional myoelectric control for discrete and simultaneous movements , 2012, Journal of NeuroEngineering and Rehabilitation.

[29]  Paolo Bifulco,et al.  Real-Time EMG Based Pattern Recognition Control for Hand Prostheses: A Review on Existing Methods, Challenges and Future Implementation , 2019, Sensors.

[30]  Panagiotis K. Artemiadis,et al.  An EMG-Based Robot Control Scheme Robust to Time-Varying EMG Signal Features , 2010, IEEE Transactions on Information Technology in Biomedicine.

[31]  André Crosnier,et al.  Collaborative manufacturing with physical human–robot interaction , 2016 .

[32]  Luca Benini,et al.  A Prosthetic Hand Body Area Controller Based on Efficient Pattern Recognition Control Strategies , 2017, Sensors.

[33]  Levi J. Hargrove,et al.  A Comparison of Surface and Intramuscular Myoelectric Signal Classification , 2007, IEEE Transactions on Biomedical Engineering.

[34]  P. C. Nugraha,et al.  Dynamic feature for an effective elbow-joint angle estimation based on electromyography signals , 2020 .

[35]  Kojiro Matsushita,et al.  Robot control systems using bio-potential signals , 2020 .

[36]  Francesco Leali,et al.  Survey on human–robot collaboration in industrial settings: Safety, intuitive interfaces and applications , 2018, Mechatronics.

[37]  Marco E. Benalcázar,et al.  Real-Time Hand Gesture Recognition Using Surface Electromyography and Machine Learning: A Systematic Literature Review , 2020, Sensors.

[38]  Norbert Krüger,et al.  Robot technology for future welfare: meeting upcoming societal challenges – an outlook with offset in the development in Scandinavia , 2019, Health and Technology.