Are armband sEMG devices dense enough for long-term use? - Sensor placement shifts cause significant reduction in recognition accuracy

Abstract Myoelectric control systems (MCSs), which recognize motions through surface electromyograms (sEMGs), present potential applicability for clinical, recreational, and motion-assisting purposes. To increase the adoption of armband device-based MCSs, the performance of motion recognition algorithms should be determined over long periods and sensor placement shifts. We prepared an sEMG dataset to assess motion recognition algorithms for practical use over long periods with varying sensor placement. The dataset comprises 30 recording sessions over 40–42 days, in which sensors were placed at three different placements. We used an armband eight-channel sEMG device for capturing 22 types of forearm motions from five healthy male subjects. To consider only motion periods to learn classifiers, we extracted relevant 1.5-s segments via multiscale sample entropy. We evaluated the dataset on a conventional motion recognition algorithm, finding robust intraday performance but significantly deteriorated inter-day performance under varying sensor placement. Hence, the armband sEMG device is dense enough for short-term use but not apt for long-term use regarding the conventional recognition algorithm. Adaptation techniques are required for developing armband device-based MCSs for long-term use. The dataset and sample codes from this study are publicly available at GitHub .

[1]  Tzyy-Ping Jung,et al.  A Wearable Multi-Modal Bio-Sensing System Towards Real-World Applications , 2019, IEEE Transactions on Biomedical Engineering.

[2]  Patrick van der Smagt,et al.  Surface EMG in advanced hand prosthetics , 2008, Biological Cybernetics.

[3]  M. Reischl CONTROL STRATEGIES FOR HAND PROSTHESES USING MYOELECTRIC PATTERNS , 2002 .

[4]  Ahmed W. Shehata,et al.  Improving Performance of Pattern Recognition-Based Myoelectric Control Using a Desktop Robotic Arm Training Tool , 2018, 2018 IEEE Life Sciences Conference (LSC).

[5]  Manfredo Atzori,et al.  Movement Error Rate for Evaluation of Machine Learning Methods for sEMG-Based Hand Movement Classification , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Adrian D. C. Chan,et al.  A Gaussian mixture model based classification scheme for myoelectric control of powered upper limb prostheses , 2005, IEEE Transactions on Biomedical Engineering.

[7]  Giulio Sandini,et al.  Multi-subject/daily-life activity EMG-based control of mechanical hands , 2009, Journal of NeuroEngineering and Rehabilitation.

[8]  Guanglin Li,et al.  Conditioning and Sampling Issues of EMG Signals in Motion Recognition of Multifunctional Myoelectric Prostheses , 2011, Annals of Biomedical Engineering.

[9]  Suguru Kanoga,et al.  Assessing the effect of transfer learning on myoelectric control systems with three electrode positions , 2018, 2018 IEEE International Conference on Industrial Technology (ICIT).

[10]  Nikolaos G. Bourbakis,et al.  A Survey on Wearable Sensor-Based Systems for Health Monitoring and Prognosis , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  Levi J. Hargrove,et al.  Classification of Simultaneous Movements Using Surface EMG Pattern Recognition , 2013, IEEE Transactions on Biomedical Engineering.

[12]  Barbara Hammer,et al.  Counteracting Electrode Shifts in Upper-Limb Prosthesis Control via Transfer Learning , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Suman Samui,et al.  An experimental study on upper limb position invariant EMG signal classification based on deep neural network , 2020, Biomed. Signal Process. Control..

[14]  Blair A. Lock,et al.  Determining the Optimal Window Length for Pattern Recognition-Based Myoelectric Control: Balancing the Competing Effects of Classification Error and Controller Delay , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[15]  Huosheng Hu,et al.  Myoelectric control systems - A survey , 2007, Biomed. Signal Process. Control..

[16]  Guanglin Li,et al.  Principal Components Analysis Preprocessing for Improved Classification Accuracies in Pattern-Recognition-Based Myoelectric Control , 2009, IEEE Transactions on Biomedical Engineering.

[17]  B Hudgins,et al.  Myoelectric signal processing for control of powered limb prostheses. , 2006, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[18]  Lucia Rita Quitadamo,et al.  Optimization of EMG-based hand gesture recognition: Supervised vs. unsupervised data preprocessing on healthy subjects and transradial amputees , 2014, Biomed. Signal Process. Control..

[19]  Honghai Liu,et al.  Bacterial memetic algorithm based feature selection for surface EMG based hand motion recognition in long-term use , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[20]  Barbara Hammer,et al.  Transfer Learning for Rapid Re-calibration of a Myoelectric Prosthesis After Electrode Shift , 2017 .

[21]  Jieping Ye,et al.  Using uncorrelated discriminant analysis for tissue classification with gene expression data , 2004, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[22]  Angkoon Phinyomark,et al.  EMG feature evaluation for improving myoelectric pattern recognition robustness , 2013, Expert Syst. Appl..

[23]  Levi J Hargrove,et al.  Adapting myoelectric control in real-time using a virtual environment , 2019, Journal of NeuroEngineering and Rehabilitation.

[24]  Fuchun Sun,et al.  sEMG-Based Joint Force Control for an Upper-Limb Power-Assist Exoskeleton Robot , 2014, IEEE Journal of Biomedical and Health Informatics.

[25]  Suguru Kanoga,et al.  Transfer Learning Over Time and Position in Wearable Myoelectric Control Systems , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[26]  Andrzej Cichocki,et al.  Bimodal BCI Using Simultaneously NIRS and EEG , 2014, IEEE Transactions on Biomedical Engineering.

[27]  Pornchai Phukpattaranont,et al.  Feature reduction and selection for EMG signal classification , 2012, Expert Syst. Appl..

[28]  Adrian D. C. Chan,et al.  Myoelectric Control Development Toolbox , 2007 .

[29]  Sethu Vijayakumar,et al.  Multi-grip classification-based prosthesis control with two EMG-IMU sensors , 2019, bioRxiv.

[30]  Xu Zhang,et al.  A Component-Based Vocabulary-Extensible Sign Language Gesture Recognition Framework , 2016, Sensors.

[31]  P. Silburn,et al.  Wearable Sensor Use for Assessing Standing Balance and Walking Stability in People with Parkinson’s Disease: A Systematic Review , 2015, PloS one.

[32]  Tomohiro Shibata,et al.  Continuous and simultaneous estimation of finger kinematics using inputs from an EMG-to-muscle activation model , 2014, Journal of NeuroEngineering and Rehabilitation.

[33]  Ying Cheng,et al.  Motor Function Evaluation of Hemiplegic Upper-Extremities Using Data Fusion from Wearable Inertial and Surface EMG Sensors , 2017, Sensors.

[34]  Luca Benini,et al.  Adaptive EMG-based hand gesture recognition using hyperdimensional computing , 2019, ArXiv.

[35]  Todd A. Kuiken,et al.  The Effects of Electrode Size and Orientation on the Sensitivity of Myoelectric Pattern Recognition Systems to Electrode Shift , 2011, IEEE Transactions on Biomedical Engineering.

[36]  K.B. Englehart,et al.  Multiple Binary Classifications via Linear Discriminant Analysis for Improved Controllability of a Powered Prosthesis , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  Joris M. Lambrecht,et al.  Electromyogram-based neural network control of transhumeral prostheses. , 2011, Journal of rehabilitation research and development.

[38]  A. Hall Acland’s Video Atlas of Human Anatomy , 2010, BMJ : British Medical Journal.

[39]  Levi J. Hargrove,et al.  A Comparison of Surface and Intramuscular Myoelectric Signal Classification , 2007, IEEE Transactions on Biomedical Engineering.

[40]  Dario Farina,et al.  Improving the Robustness of Myoelectric Pattern Recognition for Upper Limb Prostheses by Covariate Shift Adaptation , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  Dario Farina,et al.  Simultaneous and Proportional Force Estimation for Multifunction Myoelectric Prostheses Using Mirrored Bilateral Training , 2011, IEEE Transactions on Biomedical Engineering.

[42]  Ping Zhou,et al.  Sample entropy analysis of surface EMG for improved muscle activity onset detection against spurious background spikes. , 2012, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[43]  Ernest Nlandu Kamavuako,et al.  EVALUATION OF CLASSIFIERS PERFORMANCE USING THE MYO ARMBAND , 2017 .

[44]  Lauren H Smith,et al.  A comparison of the real-time controllability of pattern recognition to conventional myoelectric control for discrete and simultaneous movements , 2012, Journal of NeuroEngineering and Rehabilitation.

[45]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[46]  Todd A. Kuiken,et al.  A Decision-Based Velocity Ramp for Minimizing the Effect of Misclassifications During Real-Time Pattern Recognition Control , 2011, IEEE Transactions on Biomedical Engineering.

[47]  Angkoon Phinyomark,et al.  Feature Extraction and Selection for Myoelectric Control Based on Wearable EMG Sensors , 2018, Sensors.

[48]  Theocharis Kyriacou,et al.  Feasibility of using combined EMG and kinematic signals for prosthesis control: A simulation study using a virtual reality environment , 2016, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[49]  Nathaniel H. Hunt,et al.  The Appropriate Use of Approximate Entropy and Sample Entropy with Short Data Sets , 2012, Annals of Biomedical Engineering.

[50]  Chun-Yi Su,et al.  Development of a physiological signals enhanced teleoperation strategy , 2015, 2015 IEEE International Conference on Information and Automation.

[51]  Lucas C. Parra,et al.  Adaptive Auto-Regressive Proportional Myoelectric Control , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[52]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[53]  M. P. Griffin,et al.  Sample entropy analysis of neonatal heart rate variability. , 2002, American journal of physiology. Regulatory, integrative and comparative physiology.

[54]  Manfredo Atzori,et al.  Comparison of six electromyography acquisition setups on hand movement classification tasks , 2017, PloS one.

[55]  Hong-Bo Xie,et al.  Measuring time series regularity using nonlinear similarity-based sample entropy , 2008 .

[56]  Yu Hu,et al.  Surface EMG-Based Inter-Session Gesture Recognition Enhanced by Deep Domain Adaptation , 2017, Sensors.

[57]  R.Fff. Weir,et al.  A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[58]  Gudrun Klinker,et al.  Investigation into Natural Gestures Using EMG for "SuperNatural" Interaction in VR , 2018, UIST.

[59]  D. Farina,et al.  Simultaneous and Proportional Estimation of Hand Kinematics From EMG During Mirrored Movements at Multiple Degrees-of-Freedom , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[60]  Manfredo Atzori,et al.  Electromyography data for non-invasive naturally-controlled robotic hand prostheses , 2014, Scientific Data.