A comparative study of motion detection with FMG and sEMG methods for assistive applications

Introduction While surface-electromyography (sEMG) has been widely used in limb motion detection for the control of exoskeleton, there is an increasing interest to use forcemyography (FMG) method to detect motion. In this paper, we review the applications of two types of motion detection methods. Their performances were experimentally compared in day-to-day classification of forearm motions. The objective is to select a detection method suitable for motion assistance on a daily basis. Methods Comparisons of motion detection with FMG and sEMG were carried out considering classification accuracy (CA), repeatability and training scheme. For both methods, classification of motions was achieved through feed-forward neural network. Repeatability was evaluated on the basis of change in CA between days and also training schemes. Results The experiments shows that day-to-day CA with FMG can reach 84.9%, compared with a CA of 77.8% with sEMG, when the classifiers were trained only on the first day. Moreover, the CA with FMG can reach to 86.5%, comparable to CA of 84.1% with sEMG, if classifiers were trained daily. Conclusions Results suggest that data recorded from FMG is more repeatable in day-to-day testing and therefore FMG-based methods can be more useful than sEMG-based methods for motion detection in applications where exoskeletons are used as needed on a daily basis.

[1]  Leonard O'Sullivan,et al.  Development and Testing of Full-Body Exoskeleton AXO-SUIT for Physical Assistance of the Elderly , 2018 .

[2]  Claudio Castellini,et al.  A Comparative Analysis of Three Non-Invasive Human-Machine Interfaces for the Disabled , 2014, Front. Neurorobot..

[3]  Dapeng Yang,et al.  Experimental Study of an EMG-Controlled 5-DOF Anthropomorphic Prosthetic Hand for Motion Restoration , 2014, J. Intell. Robotic Syst..

[4]  Chi-Woong Mun,et al.  Comparison of k-nearest neighbor, quadratic discriminant and linear discriminant analysis in classification of electromyogram signals based on the wrist-motion directions , 2011 .

[5]  Carlo Menon,et al.  Force Myography to Control Robotic Upper Extremity Prostheses: A Feasibility Study , 2016, Front. Bioeng. Biotechnol..

[6]  W. Craelius,et al.  Pressure signature of forearm as predictor of grip force. , 2008, Journal of rehabilitation research and development.

[7]  Yassine Bouteraa,et al.  Training of Hand Rehabilitation Using Low Cost Exoskeleton and Vision-Based Game Interface , 2019, Journal of Intelligent & Robotic Systems.

[8]  Qinghua Gao,et al.  A novel, co-located EMG-FMG-sensing wearable armband for hand gesture recognition , 2020 .

[9]  Abduladhem A. Ali,et al.  A k-nearest neighbor based algorithm for human arm movements recognition using EMG signals , 2010, 2010 1st International Conference on Energy, Power and Control (EPC-IQ).

[10]  Shaoping Bai,et al.  Payload estimation using forcemyography sensors for control of upper-body exoskeleton in load carrying assistance , 2019, Modeling, Identification and Control: A Norwegian Research Bulletin.

[11]  Slavka Viteckova,et al.  Wearable lower limb robotics: A review , 2013 .

[12]  Ray-Yau Wang,et al.  The Changes of Muscle Strength and Functional Activities During Aging in Male and Female Populations , 2014 .

[13]  Antonio Frisoli,et al.  An EMG-Controlled Robotic Hand Exoskeleton for Bilateral Rehabilitation , 2015, IEEE Transactions on Haptics.

[14]  Xu Zhang,et al.  Random Forest-Based Recognition of Isolated Sign Language Subwords Using Data from Accelerometers and Surface Electromyographic Sensors , 2016, Sensors.

[15]  Xinjun Sheng,et al.  Feasibility of Wrist-Worn, Real-Time Hand, and Surface Gesture Recognition via sEMG and IMU Sensing , 2018, IEEE Transactions on Industrial Informatics.

[16]  Carlo Menon,et al.  A preliminary investigation on the utility of temporal features of Force Myography in the two-class problem of grasp vs. no-grasp in the presence of upper-extremity movements , 2017, Biomedical engineering online.

[17]  Claudio Castellini,et al.  A wearable low-cost device based upon Force-Sensing Resistors to detect single-finger forces , 2014, 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics.

[18]  Carlo Menon,et al.  Performance of forearm FMG and sEMG for estimating elbow, forearm and wrist positions , 2017 .

[19]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[20]  Panagiotis K. Artemiadis,et al.  Learning human reach-to-grasp strategies: Towards EMG-based control of robotic arm-hand systems , 2012, 2012 IEEE International Conference on Robotics and Automation.

[21]  C. Menon,et al.  Ankle positions classification using force myography: An exploratory investigation , 2016, 2016 IEEE Healthcare Innovation Point-Of-Care Technologies Conference (HI-POCT).

[22]  Qin Zhang,et al.  EMG-based estimation of shoulder and elbow joint angles for intuitive myoelectric control , 2015, 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[23]  Dario Farina,et al.  Self-Correcting Pattern Recognition System of Surface EMG Signals for Upper Limb Prosthesis Control , 2014, IEEE Transactions on Biomedical Engineering.

[24]  Oishee Mazumder,et al.  Hand Gesture Recognition Based Omnidirectional Wheelchair Control Using IMU and EMG Sensors , 2018, J. Intell. Robotic Syst..

[25]  Yibin Li,et al.  A human-centered design optimization approach for robotic exoskeletons through biomechanical simulation , 2017, Robotics Auton. Syst..

[26]  Allan Joshua Veale,et al.  Towards compliant and wearable robotic orthoses: A review of current and emerging actuator technologies. , 2016, Medical engineering & physics.

[27]  Kazuo Kiguchi,et al.  EMG-based control for lower-limb power-assist exoskeletons , 2009, 2009 IEEE Workshop on Robotic Intelligence in Informationally Structured Space.

[28]  Shaoping Bai,et al.  Position Sensing and Control with FMG Sensors for Exoskeleton Physical Assistance , 2018 .

[29]  Carlo Menon,et al.  Exploration of Force Myography and surface Electromyography in hand gesture classification. , 2017, Medical engineering & physics.

[30]  Gautam P. Sadarangani,et al.  Force Myography for Monitoring Grasping in Individuals with Stroke with Mild to Moderate Upper-Extremity Impairments: A Preliminary Investigation in a Controlled Environment , 2017, Front. Bioeng. Biotechnol..

[31]  Sheng Quan Xie,et al.  Exoskeleton robots for upper-limb rehabilitation: state of the art and future prospects. , 2012, Medical engineering & physics.

[32]  Hsiu-Jen Liu,et al.  Upper-Limb EMG-Based Robot Motion Governing Using Empirical Mode Decomposition and Adaptive Neural Fuzzy Inference System , 2012, J. Intell. Robotic Syst..

[33]  Shaoping Bai,et al.  Intention Detection for Dexterous Human Arm Motion with FSR Sensor Bands , 2017, HRI.

[34]  Xinjun Sheng,et al.  User adaptation in long-term, open-loop myoelectric training: implications for EMG pattern recognition in prosthesis control , 2015, Journal of neural engineering.

[35]  Carlo Menon,et al.  Force Exertion Affects Grasp Classification Using Force Myography , 2018, IEEE Transactions on Human-Machine Systems.

[36]  Makoto Sasaki,et al.  Development of a 3DOF mobile exoskeleton robot for human upper-limb motion assist , 2008, Robotics Auton. Syst..

[37]  Heaton T. Jeff,et al.  Introduction to Neural Networks with Java , 2005 .

[38]  Xi Chen,et al.  Development of a sEMG-based torque estimation control strategy for a soft elbow exoskeleton , 2019, Robotics Auton. Syst..

[39]  Winnie Jensen,et al.  The effect of time on EMG classification of hand motions in able-bodied and transradial amputees. , 2018, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[40]  Marco Platzner,et al.  Fluctuating emg signals: Investigating long-term effects of pattern matching algorithms , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[41]  Carlo Menon,et al.  Study on the force myography sensors placement for robust hand force estimation , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[42]  Guang Yang,et al.  Control strategy of the lower-limb exoskeleton based on the EMG signals , 2014, 2014 IEEE International Conference on Robotics and Biomimetics (ROBIO 2014).

[43]  Hsiu-Jen Liu,et al.  Robot motion governing using upper limb EMG signal based on empirical mode decomposition , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[44]  Dapeng Yang,et al.  Combined Use of FSR Sensor Array and SVM Classifier for Finger Motion Recognition Based on Pressure Distribution Map , 2012 .

[45]  Angkoon Phinyomark,et al.  EMG feature evaluation for improving myoelectric pattern recognition robustness , 2013, Expert Syst. Appl..

[46]  Xiangyang Zhu,et al.  Hand Gesture Recognition and Finger Angle Estimation via Wrist-Worn Modified Barometric Pressure Sensing , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[47]  Warit Wichakool,et al.  Artificial elbow joint classification using upper arm based on surface-EMG signal , 2017, 2017 IEEE 3rd International Conference on Engineering Technologies and Social Sciences (ICETSS).