Hand gesture movement classification based on dynamically structured neural network

As one of the complex biomedical signals, electromyography represents the electrical activation of the muscle providing useful information about gesture movements. A dynamically structured neural network is proposed to be used as an efficient tool to classify such movement patterns through some EMG signals generated from hand/arm movements with unknown complexity in real-time. The dynamically structured neural network is trained to establish input/output mapping while learning its optimal structure. The proposed architecture's performance is compared to various size statically structured neural network configurations. Over two folds of improvements are observed in terms of accuracy and computation time when four common hand gestures (flexion, extension, fist and rest) tested both in the training and validation data sets. Additionally, the robust performance was obtained by reducing an optimal number of EMG channels. After completing the extensive tests, the present algorithm showed the same excellent classification performance of EMG signals obtained from subjects even including those not trained before. It was concluded that the suggested algorithm offers a powerful classification solutions for hand gesture movements in real-time applications and promises to be a viable methodology for future expansions.

[1]  Mustafa Yilmaz,et al.  Classification of EMG signals using wavelet neural network , 2006, Journal of Neuroscience Methods.

[2]  Tao Li,et al.  EMG pattern recognition using decomposition techniques for constructing multiclass classifiers , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[3]  Ferat Sahin,et al.  Real-Time American Sign Language Recognition System Using Surface EMG Signal , 2015, 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA).

[4]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[5]  Michael L. Walters,et al.  Application of support vector machines to detect hand and wrist gestures using a myoelectric armband , 2017 .

[6]  Narasimhan Sundararajan,et al.  A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation , 2005, IEEE Transactions on Neural Networks.

[7]  .. S. Day.  Important Factors in surface EMG measurement By Dr , 2002 .

[8]  F. Mohd-Yasin,et al.  Techniques of EMG signal analysis: detection, processing, classification and applications , 2006, Biological Procedures Online.

[9]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[10]  Takayuki Koizumi,et al.  Forearm motion discrimination technique using real-time EMG signals , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  Toshio Tsuji,et al.  A Hybrid Motion Classification Approach for EMG-Based Human–Robot Interfaces Using Bayesian and Neural Networks , 2009, IEEE Transactions on Robotics.

[12]  Ajat Shatru Arora,et al.  Multi-Class SVM Classification of Surface EMG Signal for Upper Limb Function , 2009, 2009 3rd International Conference on Bioinformatics and Biomedical Engineering.

[13]  N. Shoylev,et al.  Neural Networks for Online Classification of Hand and Finger Movements Using Surface EMG signals , 2006, 2006 8th Seminar on Neural Network Applications in Electrical Engineering.

[14]  Adrian D. C. Chan,et al.  A Gaussian mixture model based classification scheme for myoelectric control of powered upper limb prostheses , 2005, IEEE Transactions on Biomedical Engineering.

[15]  Rami J. Oweis,et al.  ANN-based EMG classification for myoelectric control , 2014, Int. J. Medical Eng. Informatics.