Simultaneous sEMG Classification of Hand/Wrist Gestures and Forces

Surface electromyography (sEMG) signals represent a promising approach for decoding the motor intention of amputees to control a multifunctional prosthetic hand in a non-invasive way. Several approaches based on proportional amplitude methods or simple thresholds on sEMG signals have been proposed to control a single degree of freedom at time, without the possibility of increasing the number of controllable multiple DoFs in a natural manner. Myoelectric control based on PR techniques have been introduced to add multiple DoFs by keeping low the number of electrodes and allowing the discrimination of different muscular patterns for each class of motion. However, the use of PR algorithms to simultaneously decode both gestures and forces has never been studied deeply. This paper introduces a hierarchical classification approach with the aim to assess the desired hand/wrist gestures, as well as the desired force levels to exert during grasping tasks. A Finite State Machine was introduced to manage and coordinate three classifiers based on the Non-Linear Logistic Regression algorithm. The classification architecture was evaluated across 31 healthy subjects. The “hand/wrist gestures classifier,” introduced for the discrimination of seven hand/wrist gestures, presented a mean classification accuracy of 98.78%, while the “Spherical and Tip force classifier,” created for the identification of three force levels, reached an average accuracy of 98.80 and 96.09%, respectively. These results were confirmed by Linear Discriminant Analysis (LDA) with time domain features extraction, considered as ground truth for the final validation of the performed analysis. A Wilcoxon Signed-Rank test was carried out for the statistical analysis of comparison between NLR and LDA and statistical significance was considered at p < 0.05. The comparative analysis reports not statistically significant differences in terms of F1Score performance between NLR and LDA. Thus, this study reveals that the use of non-linear classification algorithm, as NLR, is as much suitable as the benchmark LDA classifier for implementing an EMG pattern recognition system, able both to decode hand/wrist gestures and to associate different performed force levels to grasping actions.

[1]  K. F. Anderson,et al.  NASA's Anderson Loop , 1998 .

[2]  Øyvind Stavdahl,et al.  System training and assessment in simultaneous proportional myoelectric prosthesis control , 2013, Journal of NeuroEngineering and Rehabilitation.

[3]  Aiguo Song,et al.  Grip Force and 3D Push-Pull Force Estimation Based on sEMG and GRNN , 2017, Front. Neurosci..

[4]  Erik Scheme,et al.  Motion Normalized Proportional Control for Improved Pattern Recognition-Based Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Loredana Zollo,et al.  Current Achievements and Future Directions of Hand Prostheses Controlled via Peripheral Nervous System , 2017, The Hand.

[6]  L. J. Hargrove,et al.  A new hierarchical approach for simultaneous control of multi-joint powered prostheses , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[7]  Lauren H Smith,et al.  A comparison of the real-time controllability of pattern recognition to conventional myoelectric control for discrete and simultaneous movements , 2012, Journal of NeuroEngineering and Rehabilitation.

[8]  Xinjun Sheng,et al.  Towards Finger Gestures and Force Recognition Based on Wrist Electromyography and Accelerometers , 2017, ICIRA.

[9]  Marco Platzner,et al.  Development Of A Pattern Recognition-Based Myoelectric Transhumeral Prosthesis With Multifunctional Simultaneous Control Using A Model-Driven Approach For Mechatronic Systems , 2011 .

[10]  Dario Farina,et al.  Bionic reconstruction to restore hand function after brachial plexus injury: a case series of three patients , 2015, The Lancet.

[11]  Blair A. Lock,et al.  Determining the Optimal Window Length for Pattern Recognition-Based Myoelectric Control: Balancing the Competing Effects of Classification Error and Controller Delay , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Nazife Baykal,et al.  Resilient backpropagation for RBF networks , 2000, KES'2000. Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies. Proceedings (Cat. No.00TH8516).

[13]  I. Kingma,et al.  Heterogeneity of muscle activation in relation to force direction: a multi-channel surface electromyography study on the triceps surae muscle. , 2009, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[14]  Wei Li,et al.  sEMG-Based Identification of Hand Motion Commands Using Wavelet Neural Network Combined With Discrete Wavelet Transform , 2016, IEEE Transactions on Industrial Electronics.

[15]  Mamun Bin Ibne Reaz,et al.  Surface Electromyography Signal Processing and Classification Techniques , 2013, Sensors.

[16]  Loredana Zollo,et al.  NLR, MLP, SVM, and LDA: a comparative analysis on EMG data from people with trans-radial amputation , 2017, Journal of NeuroEngineering and Rehabilitation.

[17]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[18]  Erik Scheme,et al.  Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. , 2011, Journal of rehabilitation research and development.

[19]  Loredana Zollo,et al.  A bio-inspired force control for cyclic manipulation of prosthetic hands , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[20]  Madhavi Anugolu,et al.  Hybrid fusion of linear, non-linear and spectral models for the dynamic modeling of sEMG and skeletal muscle force: An application to upper extremity amputation , 2013, Comput. Biol. Medicine.

[21]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[22]  Todd A Kuiken,et al.  Target Achievement Control Test: evaluating real-time myoelectric pattern-recognition control of multifunctional upper-limb prostheses. , 2011, Journal of rehabilitation research and development.

[23]  Todd A. Kuiken,et al.  Improving Myoelectric Pattern Recognition Robustness to Electrode Shift by Changing Interelectrode Distance and Electrode Configuration , 2012, IEEE Transactions on Biomedical Engineering.

[24]  Guanglin Li,et al.  Toward attenuating the impact of arm positions on electromyography pattern-recognition based motion classification in transradial amputees , 2012, Journal of NeuroEngineering and Rehabilitation.

[25]  David G Lloyd,et al.  Neuromusculoskeletal modeling: estimation of muscle forces and joint moments and movements from measurements of neural command. , 2004, Journal of applied biomechanics.

[26]  Luca Benini,et al.  Analysis of Robust Implementation of an EMG Pattern Recognition based Control , 2014, BIOSIGNALS.

[27]  Bin Wang,et al.  Grasping Force Control of Prosthetic Hand Based on PCA and SVM , 2017, LSMS/ICSEE.

[28]  D T Hutchinson,et al.  Continuous Detection and Decoding of Dexterous Finger Flexions With Implantable MyoElectric Sensors , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Thomas Schmitz-Rode,et al.  Surface electromyography and muscle force: limits in sEMG-force relationship and new approaches for applications. , 2009, Clinical biomechanics.

[30]  Huosheng Hu,et al.  PCA and deep learning based myoelectric grasping control of a prosthetic hand , 2018, BioMedical Engineering OnLine.

[31]  Loredana Zollo,et al.  Multilevel control of an anthropomorphic prosthetic hand for grasp and slip prevention , 2016 .

[32]  R N Scott,et al.  Myoelectric prostheses: state of the art. , 1988, Journal of medical engineering & technology.

[33]  K. Nazarpour Surface EMG signals pattern recognition utilizing an adaptive crosstalk suppression preprocessor , 2005, 2005 ICSC Congress on Computational Intelligence Methods and Applications.

[34]  Guido Bugmann,et al.  Improving the Performance Against Force Variation of EMG Controlled Multifunctional Upper-Limb Prostheses for Transradial Amputees , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Petr Gajdos,et al.  Human activity recognition on raw sensor data via sparse approximation , 2013, 2013 36th International Conference on Telecommunications and Signal Processing (TSP).

[36]  Loredana Zollo,et al.  Control of Prosthetic Hands via the Peripheral Nervous System , 2016, Front. Neurosci..

[37]  Dario Farina,et al.  Influence of the training set on the accuracy of surface EMG classification in dynamic contractions for the control of multifunction prostheses , 2011, Journal of NeuroEngineering and Rehabilitation.

[38]  Levi J. Hargrove,et al.  A Comparison of Surface and Intramuscular Myoelectric Signal Classification , 2007, IEEE Transactions on Biomedical Engineering.

[39]  B POPOV THE BIO-ELECTRICALLY CONTROLLED PROSTHESIS. , 1965, The Journal of bone and joint surgery. British volume.

[40]  Bruno Siciliano,et al.  A force-and-slippage control strategy for a poliarticulated prosthetic hand , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[41]  Francesca Cordella,et al.  Development and preliminary testing of an instrumented object for force analysis during grasping , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[42]  O. Stavdahl,et al.  Control of Upper Limb Prostheses: Terminology and Proportional Myoelectric Control—A Review , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  Lucia Rita Quitadamo,et al.  Optimization of EMG-based hand gesture recognition: Supervised vs. unsupervised data preprocessing on healthy subjects and transradial amputees , 2014, Biomed. Signal Process. Control..

[44]  Max Ortiz-Catalan,et al.  Real-Time and Simultaneous Control of Artificial Limbs Based on Pattern Recognition Algorithms , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[45]  Erik Scheme,et al.  Training Strategies for Mitigating the Effect of Proportional Control on Classification in Pattern Recognition–Based Myoelectric Control , 2013, Journal of prosthetics and orthotics : JPO.

[46]  Weihua Sheng,et al.  Estimation of hand force from surface Electromyography signals using Artificial Neural Network , 2012, Proceedings of the 10th World Congress on Intelligent Control and Automation.

[47]  Marie-Françoise Lucas,et al.  Optimization of wavelets for classification of movement-related cortical potentials generated by variation of force-related parameters , 2007, Journal of Neuroscience Methods.