An Improved Performance of Deep Learning Based on Convolution Neural Network to Classify the Hand Motion by Evaluating Hyper Parameter

High accuracy in pattern recognition based on electromyography(EMG) contributes to the effectiveness of prosthetics hand development. This study aimed to improve performance and simplify the deep learning pre-processing based on the convolution neural network (CNN) algorithm for classifying ten hand motion from two raw EMG signals. The main contribution of this study is the simplicity of pre-processing stage in classifier machine. For instance, the feature extraction process is not required. Furthermore, the performance of the classifier was improved by evaluating the best hyperparameter in deep learning architecture. To validate the performance of deep learning, the public dataset from ten subjects was evaluated. The performance of the proposed method was compared to other conventional machine learning, specifically LDA, SVM, and KNN. The CNN can discriminate the ten hand-motion based on raw EMG signal without handcrafts feature extraction. The results of the evaluation showed that CNN outperformed other classifiers. The average accuracy for all motion ranges between 0.77 and 0.93. The statistical t-test between using two-channel(CH1 and CH2) and single-channel(CH2) shows that there is no significant difference in accuracy with p-value >0.05. The proposed method was useful in the study of prosthetic hand, which required the simple architecture of machine learning and high performance in the classification.

[1]  Carlo J. De Luca,et al.  The Use of Surface Electromyography in Biomechanics , 1997 .

[2]  Clément Gosselin,et al.  Transfer learning for sEMG hand gestures recognition using convolutional neural networks , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[3]  Ta-Te Lin,et al.  A novel STFT-ranking feature of multi-channel EMG for motion pattern recognition , 2015, Expert Syst. Appl..

[4]  Oyas Wahyunggoro,et al.  Muscle fatigue compensation of the electromyography signal for elbow joint angle estimation using adaptive feature , 2018, Comput. Electr. Eng..

[5]  Alan Smith,et al.  Myoelectric control techniques for a rehabilitation robot , 2011 .

[6]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[7]  Francesco Carlo Morabito,et al.  A Convolutional Neural Network approach for classification of dementia stages based on 2D-spectral representation of EEG recordings , 2019, Neurocomputing.

[8]  Arto Visala,et al.  urrent state of digital signal processing in myoelectric interfaces and elated applications , 2015 .

[9]  Dennis C. Tkach,et al.  Study of stability of time-domain features for electromyographic pattern recognition , 2010, Journal of NeuroEngineering and Rehabilitation.

[10]  Erik Scheme,et al.  EMG Pattern Recognition in the Era of Big Data and Deep Learning , 2018, Big Data Cogn. Comput..

[11]  C. J. Luca,et al.  SURFACE ELECTROMYOGRAPHY : DETECTION AND RECORDING , 2022 .

[12]  P. Geethanjali,et al.  A Low-Cost Real-Time Research Platform for EMG Pattern Recognition-Based Prosthetic Hand , 2015, IEEE/ASME Transactions on Mechatronics.

[13]  David G Lloyd,et al.  Estimation of muscle forces and joint moments using a forward-inverse dynamics model. , 2005, Medicine and science in sports and exercise.

[14]  Pornchai Phukpattaranont,et al.  Feature reduction and selection for EMG signal classification , 2012, Expert Syst. Appl..

[15]  Sean R. Anderson,et al.  Compact Deep Neural Networks for Computationally Efficient Gesture Classification From Electromyography Signals , 2018, 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob).

[16]  Kevin B. Englehart,et al.  A wavelet-based continuous classification scheme for multifunction myoelectric control , 2001, IEEE Transactions on Biomedical Engineering.

[17]  Erik Scheme,et al.  Motion Normalized Proportional Control for Improved Pattern Recognition-Based Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Stanislas Chambon,et al.  A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Clément Gosselin,et al.  Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Kianoush Nazarpour,et al.  Combined influence of forearm orientation and muscular contraction on EMG pattern recognition , 2016, Expert Syst. Appl..

[21]  Huosheng Hu,et al.  Myoelectric control systems - A survey , 2007, Biomed. Signal Process. Control..

[22]  Gamini Dissanayake,et al.  Toward improved control of prosthetic fingers using surface electromyogram (EMG) signals , 2012, Expert Syst. Appl..

[23]  Winnie Jensen,et al.  Relationship between grasping force and features of single-channel intramuscular EMG signals , 2009, Journal of Neuroscience Methods.

[24]  Sangmin Lee,et al.  EMG Pattern Classification by Split and Merge Deep Belief Network , 2016, Symmetry.

[25]  M. O'Malley,et al.  Effect of elbow joint angle on force-EMG relationships in human elbow flexor and extensor muscles. , 2008, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[26]  Ergin Kilic,et al.  EMG based neural network and admittance control of an active wrist orthosis , 2017 .

[27]  Levi J. Hargrove,et al.  A Comparison of Surface and Intramuscular Myoelectric Signal Classification , 2007, IEEE Transactions on Biomedical Engineering.

[28]  Erik Scheme,et al.  Real-time, simultaneous myoelectric control using a convolutional neural network , 2018, PloS one.

[29]  Blair A. Lock,et al.  Determining the Optimal Window Length for Pattern Recognition-Based Myoelectric Control: Balancing the Competing Effects of Classification Error and Controller Delay , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  K. K. Ray,et al.  EMG based man-machine interaction - A pattern recognition research platform , 2014, Robotics Auton. Syst..

[31]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.

[32]  Jaime Valls Miró,et al.  Towards limb position invariant myoelectric pattern recognition using time-dependent spectral features , 2014, Neural Networks.

[33]  Bruce C. Wheeler,et al.  EMG feature evaluation for movement control of upper extremity prostheses , 1995 .

[34]  Oyas Wahyunggoro,et al.  An Investigation Into Time Domain Features of Surface Electromyography to Estimate the Elbow Joint Angle , 2017 .

[35]  Levi J. Hargrove,et al.  Classification of Simultaneous Movements Using Surface EMG Pattern Recognition , 2013, IEEE Transactions on Biomedical Engineering.

[36]  Angkoon Phinyomark,et al.  EMG feature evaluation for improving myoelectric pattern recognition robustness , 2013, Expert Syst. Appl..

[37]  Rita Amado Laezza,et al.  Deep neural networks for myoelectric pattern recognition - An implementation for multifunctional control , 2018 .