Latent Factors Limiting the Performance of sEMG-Interfaces

Recent advances in recording and real-time analysis of surface electromyographic signals (sEMG) have fostered the use of sEMG human–machine interfaces for controlling personal computers, prostheses of upper limbs, and exoskeletons among others. Despite a relatively high mean performance, sEMG-interfaces still exhibit strong variance in the fidelity of gesture recognition among different users. Here, we systematically study the latent factors determining the performance of sEMG-interfaces in synthetic tests and in an arcade game. We show that the degree of muscle cooperation and the amount of the body fatty tissue are the decisive factors in synthetic tests. Our data suggest that these factors can only be adjusted by long-term training, which promotes fine-tuning of low-level neural circuits driving the muscles. Short-term training has no effect on synthetic tests, but significantly increases the game scoring. This implies that it works at a higher decision-making level, not relevant for synthetic gestures. We propose a procedure that enables quantification of the gestures’ fidelity in a dynamic gaming environment. For each individual subject, the approach allows identifying “problematic” gestures that decrease gaming performance. This information can be used for optimizing the training strategy and for adapting the signal processing algorithms to individual users, which could be a way for a qualitative leap in the development of future sEMG-interfaces.

[1]  Dario Farina,et al.  Blind separation of linear instantaneous mixtures of nonstationary surface myoelectric signals , 2004, IEEE Transactions on Biomedical Engineering.

[2]  M. Bishop,et al.  Considerations for the Use of Surface Electromyography , 2004 .

[3]  Victor B. Kazantsev,et al.  A Human-Computer Interface based on Electromyography Command-Proportional Control , 2016, NEUROTECHNIX.

[4]  Victor B. Kazantsev,et al.  Myoelectric Control System of Lower Limb Exoskeleton for Re-training Motion Deficiencies , 2015, ICONIP.

[5]  L. Cherapkina The neurofeedback successfulness of sportsmen , 2012 .

[6]  Victor B. Kazantsev,et al.  Combined Use of Command-Proportional Control of External Robotic Devices Based on Electromyography Signals , 2015 .

[7]  Oscar Herreras,et al.  Disentanglement of local field potential sources by independent component analysis , 2010, Journal of Computational Neuroscience.

[8]  Dario Farina,et al.  Influence of the training set on the accuracy of surface EMG classification in dynamic contractions for the control of multifunction prostheses , 2011, Journal of NeuroEngineering and Rehabilitation.

[9]  Levi J. Hargrove,et al.  A Comparison of Surface and Intramuscular Myoelectric Signal Classification , 2007, IEEE Transactions on Biomedical Engineering.

[10]  Kazuo Kiguchi,et al.  SUEFUL-7: A 7DOF upper-limb exoskeleton robot with muscle-model-oriented EMG-based control , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Dario Farina,et al.  A Novel Percutaneous Electrode Implant for Improving Robustness in Advanced Myoelectric Control , 2016, Front. Neurosci..

[12]  Victor B. Kazantsev,et al.  A Spiking Neural Network in sEMG Feature Extraction , 2015, Sensors.

[13]  He Huang,et al.  An Analysis of EMG Electrode Configuration for Targeted Muscle Reinnervation Based Neural Machine Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Dirk Helbing,et al.  How simple rules determine pedestrian behavior and crowd disasters , 2011, Proceedings of the National Academy of Sciences.

[16]  Julia Makarova,et al.  High-Dimensional Brain: A Tool for Encoding and Rapid Learning of Memories by Single Neurons , 2017, Bulletin of Mathematical Biology.

[17]  Yoshiaki Hayashi,et al.  An EMG-Based Control for an Upper-Limb Power-Assist Exoskeleton Robot , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  K. Kiguchi,et al.  EMG-Based Neuro-Fuzzy Control of a 4DOF Upper-Limb Power-Assist Exoskeleton , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[19]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[20]  D Farina,et al.  Surface EMG Crosstalk Evaluated from Experimental Recordings and Simulated Signals , 2004, Methods of Information in Medicine.

[21]  Adrian D. C. Chan,et al.  A Gaussian mixture model based classification scheme for myoelectric control of powered upper limb prostheses , 2005, IEEE Transactions on Biomedical Engineering.

[22]  Junuk Chu,et al.  A Real-Time EMG Pattern Recognition System Based on Linear-Nonlinear Feature Projection for a Multifunction Myoelectric Hand , 2006, IEEE Transactions on Biomedical Engineering.

[23]  Daniel P Ferris,et al.  Locomotor adaptation to a soleus EMG-controlled antagonistic exoskeleton. , 2013, Journal of neurophysiology.

[24]  H Lahrmann,et al.  Clinical utility of surface EMG: report of the Therapeutics and Technology Assessment Subcommittee of the American Academy of Neurology. , 2001, Neurology.

[25]  F. Russo,et al.  Exercise-related cognitive effects on sensory-motor control in athletes and drummers compared to non-athletes and other musicians , 2017, Neuroscience.

[26]  Oscar Herreras,et al.  The right hippocampus leads the bilateral integration of gamma-parsed lateralized information , 2016, eLife.

[27]  Valeri A. Makarov,et al.  Prediction-for-CompAction: navigation in social environments using generalized cognitive maps , 2015, Biological Cybernetics.

[28]  Valeri A. Makarov,et al.  Waves in isotropic Totalistic Cellular Automata: Application to Real-Time robot Navigation , 2016, Adv. Complex Syst..

[29]  Farrah Wong,et al.  Analysis of Surface Electromyography for On-Off Control , 2013 .

[30]  Dario Farina,et al.  EMG-based simultaneous and proportional estimation of wrist/hand kinematics in uni-lateral trans-radial amputees , 2011, Journal of NeuroEngineering and Rehabilitation.

[31]  Geoffrey I. Webb,et al.  Encyclopedia of Machine Learning , 2011, Encyclopedia of Machine Learning.

[32]  Levi J Hargrove,et al.  A real-time comparison between direct control, sequential pattern recognition control and simultaneous pattern recognition control using a Fitts’ law style assessment procedure , 2014, Journal of NeuroEngineering and Rehabilitation.

[33]  Kevin B. Englehart,et al.  Fatigue estimation with a multivariable myoelectric mapping function , 2006, IEEE Transactions on Biomedical Engineering.

[34]  Aidan D. Roche,et al.  Prosthetic Myoelectric Control Strategies: A Clinical Perspective , 2014, Current Surgery Reports.

[35]  O. Stavdahl,et al.  Control of Upper Limb Prostheses: Terminology and Proportional Myoelectric Control—A Review , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[37]  Sougata Karmakar,et al.  Muscle Computer Interface: A Review , 2013 .

[38]  V. A. Makarov,et al.  New uses of LFPs: Pathway-specific threads obtained through spatial discrimination , 2015, Neuroscience.

[39]  Jan Toth,et al.  Motor imagery based brain-computer interface , 2014 .

[40]  H. Devries MUSCLES ALIVE-THEIR FUNCTIONS REVEALED BY ELECTROMYOGRAPHY , 1976 .

[41]  Rajesh P. N. Rao,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. 1 Online Electromyographic Control of a Robotic , 2022 .

[42]  Jun Morimoto,et al.  Bilinear Modeling of EMG Signals to Extract User-Independent Features for Multiuser Myoelectric Interface , 2013, IEEE Transactions on Biomedical Engineering.

[43]  Stefano Stramigioli,et al.  Myoelectric forearm prostheses: state of the art from a user-centered perspective. , 2011, Journal of rehabilitation research and development.

[44]  Fatimah Ibrahim,et al.  The Theory and Fundamentals of Bioimpedance Analysis in Clinical Status Monitoring and Diagnosis of Diseases , 2014, Sensors.

[45]  C. Richardson,et al.  Clinical utility of surface EMG: report of the Therapeutics and Technology Assessment Subcommittee of the American Academy of Neurology. , 2001, Neurology.

[46]  Todd A. Kuiken,et al.  Dual Window Pattern Recognition Classifier for Improved Partial-Hand Prosthesis Control , 2016, Front. Neurosci..