EMG Pattern Recognition in the Era of Big Data and Deep Learning

The increasing amount of data in electromyographic (EMG) signal research has greatly increased the importance of developing advanced data analysis and machine learning techniques which are better able to handle “big data”. Consequently, more advanced applications of EMG pattern recognition have been developed. This paper begins with a brief introduction to the main factors that expand EMG data resources into the era of big data, followed by the recent progress of existing shared EMG data sets. Next, we provide a review of recent research and development in EMG pattern recognition methods that can be applied to big data analytics. These modern EMG signal analysis methods can be divided into two main categories: (1) methods based on feature engineering involving a promising big data exploration tool called topological data analysis; and (2) methods based on feature learning with a special emphasis on “deep learning”. Finally, directions for future research in EMG pattern recognition are outlined and discussed.

[1]  Ayoub Al-Hamadi,et al.  The biovid heat pain database data for the advancement and systematic validation of an automated pain recognition system , 2013, 2013 IEEE International Conference on Cybernetics (CYBCO).

[2]  Krzysztof J. Gorgolewski,et al.  Making Data Sharing Count: A Publication-Based Solution , 2012, Front. Neurosci..

[3]  Clément Gosselin,et al.  Transfer learning for sEMG hand gestures recognition using convolutional neural networks , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[4]  Kianoush Nazarpour,et al.  Combined influence of forearm orientation and muscular contraction on EMG pattern recognition , 2016, Expert Syst. Appl..

[5]  Beth Jelfs,et al.  Self-Recalibrating Surface EMG Pattern Recognition for Neuroprosthesis Control Based on Convolutional Neural Network , 2017, Front. Neurosci..

[6]  Baijian Yang,et al.  Big Data Dimension Reduction Using PCA , 2016, 2016 IEEE International Conference on Smart Cloud (SmartCloud).

[7]  Gamini Dissanayake,et al.  Muscle computer interfaces for driver distraction reduction , 2013, Comput. Methods Programs Biomed..

[8]  Rami N. Khushaba,et al.  Electromyogram (EMG) feature reduction using Mutual Components Analysis for multifunction prosthetic fingers control , 2012, 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV).

[9]  Seong-Whan Lee,et al.  Movement intention decoding based on deep learning for multiuser myoelectric interfaces , 2016, 2016 4th International Winter Conference on Brain-Computer Interface (BCI).

[10]  P. A. Karthick,et al.  Surface electromyography based muscle fatigue detection using high-resolution time-frequency methods and machine learning algorithms , 2018, Comput. Methods Programs Biomed..

[11]  Max Ortiz-Catalan,et al.  Real-Time and Simultaneous Control of Artificial Limbs Based on Pattern Recognition Algorithms , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Ayoub Al-Hamadi,et al.  “BioVid Emo DB”: A multimodal database for emotion analyses validated by subjective ratings , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[13]  Erik Scheme,et al.  Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. , 2011, Journal of rehabilitation research and development.

[14]  Jaime Valls Miró,et al.  Towards limb position invariant myoelectric pattern recognition using time-dependent spectral features , 2014, Neural Networks.

[15]  Bruce C. Wheeler,et al.  EMG feature evaluation for movement control of upper extremity prostheses , 1995 .

[16]  Zhizeng Luo,et al.  Feature-Level Fusion of Surface Electromyography for Activity Monitoring , 2018, Sensors.

[17]  J. Samet,et al.  The Sleep Heart Health Study: design, rationale, and methods. , 1997, Sleep.

[18]  Subramanian Ramanathan,et al.  DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses , 2015, IEEE Transactions on Affective Computing.

[19]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[20]  Huosheng Hu,et al.  Support Vector Machine-Based Classification Scheme for Myoelectric Control Applied to Upper Limb , 2008, IEEE Transactions on Biomedical Engineering.

[21]  M. Terzano,et al.  Atlas, rules, and recording techniques for the scoring of cyclic alternating pattern (CAP) in human sleep. , 2002, Sleep medicine.

[22]  Angkoon Phinyomark,et al.  A feasibility study on the use of anthropometric variables to make muscle-computer interface more practical , 2013, Eng. Appl. Artif. Intell..

[23]  Bo Håkansson,et al.  Real-time classification of simultaneous hand and wrist motions using Artificial Neural Networks with variable threshold outputs , 2013, ICANN 2013.

[24]  Tanja Schultz,et al.  Pattern learning with deep neural networks in EMG-based speech recognition , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  Stefan Haufe,et al.  EEG potentials predict upcoming emergency brakings during simulated driving , 2011, Journal of neural engineering.

[26]  Anthony Tzes,et al.  Improving EMG based classification of basic hand movements using EMD , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[27]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[28]  Hai Hu,et al.  Application of Linear Discriminant Analysis in Dimensionality Reduction for Hand Motion Classification , 2012 .

[29]  Pornchai Phukpattaranont,et al.  A Review of Control Methods for Electric Power Wheelchairs Based on Electromyography Signals with Special Emphasis on Pattern Recognition , 2011 .

[30]  Jamileh Yousefi,et al.  Characterizing EMG data using machine-learning tools , 2014, Comput. Biol. Medicine.

[31]  Pornchai Phukpattaranont,et al.  Feature reduction and selection for EMG signal classification , 2012, Expert Syst. Appl..

[32]  Sangmin Lee,et al.  EMG Pattern Classification by Split and Merge Deep Belief Network , 2016, Symmetry.

[33]  Tanja Schultz,et al.  Advancing Muscle-Computer Interfaces with High-Density Electromyography , 2015, CHI.

[34]  Tanja Schultz,et al.  Recognizing Hand and Finger Gestures with IMU based Motion and EMG based Muscle Activity Sensing , 2015, BIOSIGNALS.

[35]  Chusak Limsakul,et al.  EMG FEATURE EXTRACTION FOR TOLERANCE OF 50 HZ INTERFERENCE , 2009 .

[36]  Klaus-Robert Müller,et al.  Channel selection for simultaneous and proportional myoelectric prosthesis control of multiple degrees-of-freedom , 2014, Journal of neural engineering.

[37]  Pornchai Phukpattaranont,et al.  INVESTIGATING LONG-TERM EFFECTS OF FEATURE EXTRACTION METHODS FOR CONTINUOUS EMG PATTERN CLASSIFICATION , 2012 .

[38]  A J van den Bogert,et al.  Muscle coordination and function during cutting movements. , 1999, Medicine and science in sports and exercise.

[39]  Jürgen Schmidhuber,et al.  Deep Neural Network Frontend for Continuous EMG-Based Speech Recognition , 2016, INTERSPEECH.

[40]  Angkoon Phinyomark,et al.  Topological Data Analysis of Biomedical Big Data , 2018, Signal Processing and Machine Learning for Biomedical Big Data.

[41]  Junuk Chu,et al.  A Real-Time EMG Pattern Recognition System Based on Linear-Nonlinear Feature Projection for a Multifunction Myoelectric Hand , 2006, IEEE Transactions on Biomedical Engineering.

[42]  Manfredo Atzori,et al.  Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands , 2016, Front. Neurorobot..

[43]  Erik J. Scheme,et al.  On the robustness of EMG features for pattern recognition based myoelectric control; A multi-dataset comparison , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[44]  Adel Al-Jumaily,et al.  A Framework of Temporal-Spatial Descriptors-Based Feature Extraction for Improved Myoelectric Pattern Recognition , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[45]  Erik Scheme,et al.  Navigating features: a topologically informed chart of electromyographic features space , 2017, Journal of The Royal Society Interface.

[46]  K. Englehart,et al.  Resolving the Limb Position Effect in Myoelectric Pattern Recognition , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[47]  Mohammad Hassan Moradi,et al.  Evaluation of the forearm EMG signal features for the control of a prosthetic hand. , 2003, Physiological measurement.

[48]  Desney S. Tan,et al.  Enabling always-available input with muscle-computer interfaces , 2009, UIST '09.

[49]  Gyanendra K. Verma,et al.  Deep belief network based affect recognition from physiological signals , 2017, 2017 4th IEEE Uttar Pradesh Section International Conference on Electrical, Computer and Electronics (UPCON).

[50]  Dennis C. Tkach,et al.  Study of stability of time-domain features for electromyographic pattern recognition , 2010, Journal of NeuroEngineering and Rehabilitation.

[51]  Manfredo Atzori,et al.  Comparison of six electromyography acquisition setups on hand movement classification tasks , 2017, PloS one.

[52]  Kevin B. Englehart,et al.  A wavelet-based continuous classification scheme for multifunction myoelectric control , 2001, IEEE Transactions on Biomedical Engineering.

[53]  Angkoon Phinyomark,et al.  Feature Extraction and Selection for Myoelectric Control Based on Wearable EMG Sensors , 2018, Sensors.

[54]  Bo Håkansson,et al.  Evaluation of classifier topologies for the real-time classification of simultaneous limb motions , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[55]  Pornchai Phukpattaranont,et al.  WAVELET-BASED DENOISING ALGORITHM FOR ROBUST EMG PATTERN RECOGNITION , 2011 .

[56]  Ilja Kuzborskij,et al.  Characterization of a Benchmark Database for Myoelectric Movement Classification , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[57]  Angkoon Phinyomark,et al.  The Relationship Between Anthropometric Variables and Features of Electromyography Signal for Human–Computer Interface , 2014 .

[58]  Enzo Mastinu,et al.  Analog front-ends comparison in the way of a portable, low-power and low-cost EMG controller based on pattern recognition , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[59]  Erik Scheme,et al.  A feature extraction issue for myoelectric control based on wearable EMG sensors , 2018, 2018 IEEE Sensors Applications Symposium (SAS).

[60]  Chunfeng Li,et al.  Features extraction and multi-classification of sEMG using a GPU-Accelerated GA/MLP hybrid algorithm. , 2017, Journal of X-ray science and technology.

[61]  Manfredo Atzori,et al.  Electromyography data for non-invasive naturally-controlled robotic hand prostheses , 2014, Scientific Data.

[62]  Hamid R. Marateb,et al.  A Novel Spatial Feature for the Identification of Motor Tasks Using High-Density Electromyography , 2017, Sensors.

[63]  Yinghong Peng,et al.  EMG‐Based Estimation of Limb Movement Using Deep Learning With Recurrent Convolutional Neural Networks , 2018, Artificial organs.

[64]  Dong Yu,et al.  Scalable stacking and learning for building deep architectures , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[65]  S. Puthusserypady,et al.  Nonlinear analysis of EMG signals - a chaotic approach , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[66]  H. Traue,et al.  Pain Intensity Recognition Rates via Biopotential Feature Patterns with Support Vector Machines , 2015, PloS one.

[67]  Guido Bugmann,et al.  Improving the Performance Against Force Variation of EMG Controlled Multifunctional Upper-Limb Prostheses for Transradial Amputees , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[68]  Manfredo Atzori,et al.  Building the Ninapro database: A resource for the biorobotics community , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[69]  Hyeon-Min Shim,et al.  Multi-channel electromyography pattern classification using deep belief networks for enhanced user experience , 2015 .

[70]  Shin-Ki Kim,et al.  A Supervised Feature-Projection-Based Real-Time EMG Pattern Recognition for Multifunction Myoelectric Hand Control , 2007, IEEE/ASME Transactions on Mechatronics.

[71]  Angkoon Phinyomark,et al.  EMG feature evaluation for improving myoelectric pattern recognition robustness , 2013, Expert Syst. Appl..

[72]  Yu Hu,et al.  Surface EMG-Based Inter-Session Gesture Recognition Enhanced by Deep Domain Adaptation , 2017, Sensors.

[73]  Sethu Vijayakumar,et al.  Improved prosthetic hand control with concurrent use of myoelectric and inertial measurements , 2017, Journal of NeuroEngineering and Rehabilitation.

[74]  David E. Goldberg,et al.  Efficient Parallel Genetic Algorithms: Theory and Practice , 2000 .

[75]  Laurent Albera,et al.  Emotion Recognition Based on High-Resolution EEG Recordings and Reconstructed Brain Sources , 2020, IEEE Transactions on Affective Computing.

[76]  Chi-Woong Mun,et al.  Comparison of k-nearest neighbor, quadratic discriminant and linear discriminant analysis in classification of electromyogram signals based on the wrist-motion directions , 2011 .

[77]  Max Ortiz-Catalan,et al.  BioPatRec: A modular research platform for the control of artificial limbs based on pattern recognition algorithms , 2013, Source Code for Biology and Medicine.

[78]  Barbara Caputo,et al.  Repeatability of grasp recognition for robotic hand prosthesis control based on sEMG data , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[79]  Angkoon Phinyomark,et al.  Resting-State fMRI Functional Connectivity: Big Data Preprocessing Pipelines and Topological Data Analysis , 2017, IEEE Transactions on Big Data.

[80]  K. Englehart,et al.  Determination of optimum threshold values for EMG time domain features; a multi-dataset investigation. , 2016, Journal of neural engineering.

[81]  Laurence T. Yang,et al.  A survey on deep learning for big data , 2018, Inf. Fusion.

[82]  Björn Krüger,et al.  Novel Methods for Surface EMG Analysis and Exploration Based on Multi-Modal Gaussian Mixture Models , 2016, PloS one.

[83]  Xiangyang Zhu,et al.  A Multichannel Surface EMG System for Hand Motion Recognition , 2015, Int. J. Humanoid Robotics.

[84]  Adrian D. C. Chan,et al.  Myoelectric Control Development Toolbox , 2007 .

[85]  Xue-wen Chen,et al.  Big Data Deep Learning: Challenges and Perspectives , 2014, IEEE Access.

[86]  K. Englehart,et al.  On the Suitability of Integrating Accelerometry Data with Electromyography Signals for Resolving the Effect of Changes in Limb Position during Dynamic Limb Movement , 2014 .

[87]  Clément Gosselin,et al.  Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[88]  Xiaodong Zhang,et al.  Surface EMG based continuous estimation of human lower limb joint angles by using deep belief networks , 2018, Biomed. Signal Process. Control..

[89]  Geethanjali Purushothaman,et al.  Identification of a feature selection based pattern recognition scheme for finger movement recognition from multichannel EMG signals , 2018, Australasian Physical & Engineering Sciences in Medicine.

[90]  Murtaza Haider,et al.  Beyond the hype: Big data concepts, methods, and analytics , 2015, Int. J. Inf. Manag..

[91]  Rita Amado Laezza,et al.  Deep neural networks for myoelectric pattern recognition - An implementation for multifunctional control , 2018 .

[92]  Antanas Verikas,et al.  Electromyographic Patterns during Golf Swing: Activation Sequence Profiling and Prediction of Shot Effectiveness , 2016, Sensors.

[93]  Weidong Geng,et al.  Gesture recognition by instantaneous surface EMG images , 2016, Scientific Reports.

[94]  Frank Vogt,et al.  Fast principal component analysis of large data sets , 2001 .

[95]  Gamini Dissanayake,et al.  Toward improved control of prosthetic fingers using surface electromyogram (EMG) signals , 2012, Expert Syst. Appl..

[96]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[97]  Facundo Mémoli,et al.  Topological Methods for the Analysis of High Dimensional Data Sets and 3D Object Recognition , 2007, PBG@Eurographics.

[98]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[99]  Marc'Aurelio Ranzato,et al.  Large Scale Distributed Deep Networks , 2012, NIPS.

[100]  Adrian D. C. Chan,et al.  Investigating Classification Parameters for Continuous Myoelectrically Controlled Prostheses , 2005 .

[101]  Cees T. A. M. de Laat,et al.  Addressing big data issues in Scientific Data Infrastructure , 2013, 2013 International Conference on Collaboration Technologies and Systems (CTS).

[102]  Clément Gosselin,et al.  A convolutional neural network for robotic arm guidance using sEMG based frequency-features , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[103]  Anton Nijholt,et al.  Affective Pacman: A Frustrating Game for Brain-Computer Interface Experiments , 2009, INTETAIN.

[104]  Dong Yu,et al.  Tensor Deep Stacking Networks , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[105]  G. Carlsson,et al.  Topology based data analysis identifies a subgroup of breast cancers with a unique mutational profile and excellent survival , 2011, Proceedings of the National Academy of Sciences.

[106]  U. Rajendra Acharya,et al.  Deep learning for healthcare applications based on physiological signals: A review , 2018, Comput. Methods Programs Biomed..

[107]  Pornchai Phukpattaranont,et al.  EMG AMPLITUDE ESTIMATORS BASED ON PROBABILITY DISTRIBUTION FOR MUSCLE–COMPUTER INTERFACE , 2013 .

[108]  J. F. Alonso,et al.  Identification of isometric contractions based on High Density EMG maps. , 2013, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[109]  Sean R. Anderson,et al.  Compact Deep Neural Networks for Computationally Efficient Gesture Classification From Electromyography Signals , 2018, 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob).

[110]  Khaled A. Harras,et al.  Multimodal Deep Learning Approach for Joint EEG-EMG Data Compression and Classification , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).

[111]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[112]  Ying Tan,et al.  GPU-based parallel particle swarm optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[113]  Erik Scheme,et al.  Training Strategies for Mitigating the Effect of Proportional Control on Classification in Pattern Recognition–Based Myoelectric Control , 2013, Journal of prosthetics and orthotics : JPO.

[114]  M. Swiontkowski Targeted Muscle Reinnervation for Real-time Myoelectric Control of Multifunction Artificial Arms , 2010 .

[115]  Pornchai Phukpattaranont,et al.  EMG feature extraction for tolerance of white Gaussian noise , 2008 .

[116]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[117]  Erik J. Scheme,et al.  Validation of a Selective Ensemble-Based Classification Scheme for Myoelectric Control Using a Three-Dimensional Fitts' Law Test , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.