A bionic hand controlled by hand gesture recognition based on surface EMG signals: A preliminary study

Abstract A bionic hand with fine motor ability could be a favorable option for replacing the human hand when performing various operations. Myoelectric control has been widely used to recognize hand movements in recent years. However, most of the previous studies have focused on whole-hand movements, with only a few investigating subtler motions. The aim of this study was to construct a prototype system for recognizing hand postures with the aim of controlling a bionic hand by analyzing sEMG signals measured at the flexor digitorum superficialis and extensor digitorum muscles. We adopted multiple features commonly used in previous studies—mean absolute value, zero crossing, slope sign change, and waveform length—in the algorithm for extracting hand-posture features, and the k-nearest-neighbors (KNN) algorithm as the classifier to perform hand-posture recognition. The bionic hand was controlled by an Arduino microprocessor, which converted the signals received from the classification process that were fed to the servo motors controlling the bionic fingers. We constructed a two-channel sEMG pattern-recognition system that can identify human hand postures and control a homemade bionic hand to perform corresponding hand postures. The KNN approach was able to recognize four different hand postures with a classification accuracy of 94% in the online experiment by using the channel combination. Moreover, the experimental tests show that the bionic hand could faithfully imitate the hand postures of the human hand. This study has bridged the gap between the features of sEMG signals of fingers and the postures of a bionic hand.

[1]  Shuai Yang,et al.  Hand gesture recognition: An overview , 2013, 2013 5th IEEE International Conference on Broadband Network & Multimedia Technology.

[2]  Xinjun Sheng,et al.  Continuous estimation of finger joint angles under different static wrist motions from surface EMG signals , 2014, Biomed. Signal Process. Control..

[3]  Siu-Yeung Cho,et al.  Human action recognition employing negative space features , 2013, J. Vis. Commun. Image Represent..

[4]  Christian Cipriani,et al.  Real-time myoelectric control of a multi-fingered hand prosthesis using principal components analysis , 2012, Journal of NeuroEngineering and Rehabilitation.

[5]  Nianfeng Wang,et al.  Realtime recognition of multi-finger prehensile gestures , 2014, Biomed. Signal Process. Control..

[6]  K. K. Ray,et al.  EMG based man-machine interaction - A pattern recognition research platform , 2014, Robotics Auton. Syst..

[7]  S. A. Ahmad,et al.  Surface Electromyography Feature Extraction Based on Wavelet Transform , 2012 .

[8]  Pornchai Phukpattaranont,et al.  Feature reduction and selection for EMG signal classification , 2012, Expert Syst. Appl..

[9]  P.M. Szecowka,et al.  Control of dexterous hand - algorithm implementation issues , 2009, 2009 9th International Conference on Information Technology and Applications in Biomedicine.

[10]  Lucia Rita Quitadamo,et al.  Optimization of EMG-based hand gesture recognition: Supervised vs. unsupervised data preprocessing on healthy subjects and transradial amputees , 2014, Biomed. Signal Process. Control..

[11]  P. Manimegalai HAND GESTURE RECOGNITION BASED ON EMG SIGNALS USING ANN , 2013 .

[12]  Jaime Valls Miró,et al.  Towards limb position invariant myoelectric pattern recognition using time-dependent spectral features , 2014, Neural Networks.

[13]  Yunhui Liu,et al.  Hand Motion Classification Using a Multi-Channel Surface Electromyography Sensor , 2012, Sensors.

[14]  Ahmet Alkan,et al.  Identification of EMG signals using discriminant analysis and SVM classifier , 2012, Expert Syst. Appl..

[15]  Xun Chen,et al.  Pattern recognition of number gestures based on a wireless surface EMG system , 2013, Biomed. Signal Process. Control..

[16]  Daniel C. Sweeney,et al.  Mitigation of impedance changes due to electroporation therapy using bursts of high-frequency bipolar pulses , 2015, Biomedical engineering online.

[17]  Angkoon Phinyomark,et al.  Feature extraction of the first difference of EMG time series for EMG pattern recognition , 2014, Comput. Methods Programs Biomed..

[18]  Angkoon Phinyomark,et al.  EMG feature evaluation for improving myoelectric pattern recognition robustness , 2013, Expert Syst. Appl..

[19]  Angkoon Phinyomark,et al.  A feasibility study on the use of anthropometric variables to make muscle-computer interface more practical , 2013, Eng. Appl. Artif. Intell..

[20]  Lucia Rita Quitadamo,et al.  Evaluating the influence of subject-related variables on EMG-based hand gesture classification , 2014, 2014 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[21]  Dinesh K Kumar,et al.  Selection of suitable hand gestures for reliable myoelectric human computer interface , 2015, Biomedical engineering online.

[22]  Jian Huang,et al.  A real-time EMG pattern recognition method for virtual myoelectric hand control , 2014, Neurocomputing.

[23]  Huosheng Hu,et al.  Myoelectric control systems - A survey , 2007, Biomed. Signal Process. Control..

[24]  Gamini Dissanayake,et al.  Toward improved control of prosthetic fingers using surface electromyogram (EMG) signals , 2012, Expert Syst. Appl..

[25]  Ta-Te Lin,et al.  A novel STFT-ranking feature of multi-channel EMG for motion pattern recognition , 2015, Expert Syst. Appl..

[26]  R.N. Scott,et al.  A new strategy for multifunction myoelectric control , 1993, IEEE Transactions on Biomedical Engineering.

[27]  Nianfeng Wang,et al.  The recognition of multi-finger prehensile postures using LDA , 2013, Biomed. Signal Process. Control..

[28]  Angel Rubio,et al.  Channel and feature selection for a surface electromyographic pattern recognition task , 2014, Expert Syst. Appl..

[29]  Dario Farina,et al.  Surface EMG processing: Introduction to the special issue , 2008, Biomed. Signal Process. Control..

[30]  Rafal Zdunek,et al.  Electromyography and mechanomyography signal recognition: Experimental analysis using multi-way array decomposition methods , 2017 .

[31]  Vijay P. Singh,et al.  Towards identification of finger flexions using single channel surface electromyography – able bodied and amputee subjects , 2013, Journal of NeuroEngineering and Rehabilitation.

[32]  Khairul Anam,et al.  Two-channel surface electromyography for individual and combined finger movements , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).