Surface EMG based handgrip force predictions using gene expression programming

The main objective of this study is to precisely predict muscle forces from surface electromyography (sEMG) for hand gesture recognition. A robust variant of genetic programming, namely Gene Expression Programming (GEP), is utilized to derive a new empirical model of handgrip sEMG-force relationship. A series of handgrip forces and corresponding sEMG signals were recorded from 6 healthy male subjects and during 4 levels of percentage of maximum voluntary contraction (%MVC) in experiments. Using one-way ANOVA with multiple comparisons test, 10 features of the sEMG time domain were extracted from homogeneous subsets and used as input vectors. Subsequently, a handgrip force prediction model was developed based on GEP. In order to compare the performance of this model, other models based on a back propagation neural network and a support vector machine were trained using the same input vectors and data sets. The root mean square error and the correlation coefficient between the actual and predicted forces were calculated to assess the performance of the three models . The results show that the GEP model provide the highest accuracy and generalization capability among the studied models. It was concluded that the proposed GEP model is relatively short, simple and excellent for predicting handgrip forces based on sEMG signals.

[1]  Jaime Valls Miró,et al.  Towards limb position invariant myoelectric pattern recognition using time-dependent spectral features , 2014, Neural Networks.

[2]  Aaron J. Young,et al.  Analysis of using EMG and mechanical sensors to enhance intent recognition in powered lower limb prostheses , 2014, Journal of neural engineering.

[3]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[4]  Mohammad Ahad,et al.  EMG based classification of percentage of maximum voluntary contraction using artificial neural networks , 2014, 2014 IEEE Dallas Circuits and Systems Conference (DCAS).

[5]  Antonis A. Argyros,et al.  Vision-based Hand Gesture Recognition for Human-Computer Interaction , 2008 .

[6]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Øyvind Stavdahl,et al.  A multi-modal approach for hand motion classification using surface EMG and accelerometers , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Guangyou Xu,et al.  Subject-independent natural action recognition , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[9]  Mikhail A. Lebedev,et al.  Recognition of Handwriting from Electromyography , 2009, PloS one.

[10]  Guido Bugmann,et al.  A preliminary investigation of the effect of force variation for myoelectric control of hand prosthesis , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  Kazushi Ikeda,et al.  Towards excluding redundancy in electrode grid for automatic speech recognition based on surface EMG , 2014, Neurocomputing.

[12]  Kongqiao Wang,et al.  Automatic recognition of sign language subwords based on portable accelerometer and EMG sensors , 2010, ICMI-MLMI '10.

[13]  Sougata Karmakar,et al.  Muscle Computer Interface: A Review , 2013 .

[14]  Todd A. Kuiken,et al.  The Effects of Electrode Size and Orientation on the Sensitivity of Myoelectric Pattern Recognition Systems to Electrode Shift , 2011, IEEE Transactions on Biomedical Engineering.

[15]  Yasuhiro Kikuchi,et al.  Comparative Analysis of Muscle Architecture in Primate Arm and Forearm , 2010, Anatomia, histologia, embryologia.

[16]  Dario Farina,et al.  The Extraction of Neural Information from the Surface EMG for the Control of Upper-Limb Prostheses: Emerging Avenues and Challenges , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Hongnian Yu,et al.  Impact of Load Variation on Joint Angle Estimation From Surface EMG Signals , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Roberto Merletti,et al.  The extraction of neural strategies from the surface EMG. , 2004, Journal of applied physiology.

[19]  N. Georganas,et al.  Human emotion recognition from body language of the head using soft computing techniques , 2012 .

[20]  Shahrokh Valaee,et al.  A Novel Accelerometer-based Gesture Recognition System by , 2010 .

[21]  M. Paulin,et al.  Intra-session and inter-day reliability of forearm surface EMG during varying hand grip forces. , 2013, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[22]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.

[23]  Øyvind Stavdahl,et al.  System training and assessment in simultaneous proportional myoelectric prosthesis control , 2013, Journal of NeuroEngineering and Rehabilitation.

[24]  Dario Farina,et al.  Influence of the training set on the accuracy of surface EMG classification in dynamic contractions for the control of multifunction prostheses , 2011, Journal of NeuroEngineering and Rehabilitation.

[25]  Dario Farina,et al.  Effect of arm position on the prediction of kinematics from EMG in amputees , 2012, Medical & Biological Engineering & Computing.

[26]  Jalal Shiri,et al.  Artificial neural networks vs. Gene Expression Programming for estimating outlet dissolved oxygen in micro-irrigation sand filters fed with effluents , 2013 .

[27]  Winnie Jensen,et al.  Estimation of Grasping Force from Features of Intramuscular EMG Signals with Mirrored Bilateral Training , 2011, Annals of Biomedical Engineering.

[28]  Jaap H van Dieën,et al.  Prediction of handgrip forces using surface EMG of forearm muscles. , 2005, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[29]  C. K. Battye,et al.  The use of myo-electric currents in the operation of prostheses. , 1955, The Journal of bone and joint surgery. British volume.

[30]  R. Scott,et al.  Myoelectric control of prostheses. , 1986, Critical reviews in biomedical engineering.

[31]  Erik Scheme,et al.  Electromyogram pattern recognition for control of powered upper-limb prostheses: state of the art and challenges for clinical use. , 2011, Journal of rehabilitation research and development.

[32]  Guanglin Li,et al.  Toward attenuating the impact of arm positions on electromyography pattern-recognition based motion classification in transradial amputees , 2012, Journal of NeuroEngineering and Rehabilitation.

[33]  Antonio Frisoli,et al.  An emg-based robotic hand exoskeleton for bilateral training of grasp , 2013, 2013 World Haptics Conference (WHC).

[34]  O. Kisi,et al.  Comparison of Gene Expression Programming with neuro-fuzzy and neural network computing techniques in estimating daily incoming solar radiation in the Basque Country (Northern Spain) , 2012 .

[35]  Carlo J. De Luca Control of upper-limb prostheses: a case for neuroelectric control. , 1978 .

[36]  R. L. Linscheid,et al.  Muscles across the elbow joint: a biomechanical analysis. , 1981, Journal of biomechanics.

[37]  Kejun Zhang,et al.  An Upper-Limb Power-Assist Exoskeleton Using Proportional Myoelectric Control , 2014, Sensors.

[38]  Rafael Radkowski,et al.  Interactive Hand Gesture-based Assembly for Augmented Reality Applications , 2012, ACHI 2012.

[39]  Silvestro Micera,et al.  A critical review of interfaces with the peripheral nervous system for the control of neuroprostheses and hybrid bionic systems , 2005, Journal of the peripheral nervous system : JPNS.

[40]  Candida Ferreira Gene expression programming , 2006 .

[41]  K. Englehart,et al.  Resolving the Limb Position Effect in Myoelectric Pattern Recognition , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[42]  Dario Farina,et al.  Myoelectric Control of Artificial Limbs¿Is There a Need to Change Focus? [In the Spotlight] , 2012, IEEE Signal Process. Mag..

[43]  Mohammad Hassan Moradi,et al.  Evaluation of the forearm EMG signal features for the control of a prosthetic hand. , 2003, Physiological measurement.

[44]  Haitham Hasan,et al.  RETRACTED ARTICLE: Human–computer interaction using vision-based hand gesture recognition systems: a survey , 2013, Neural Computing and Applications.

[45]  A K Bourke,et al.  Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. , 2007, Gait & posture.

[46]  Lars Bretzner,et al.  Hand gesture recognition using multi-scale colour features, hierarchical models and particle filtering , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[47]  Kejun Zhang,et al.  Web music emotion recognition based on higher effective gene expression programming , 2013, Neurocomputing.

[48]  E. Biddiss,et al.  Upper limb prosthesis use and abandonment: A survey of the last 25 years , 2007, Prosthetics and orthotics international.

[49]  A. J. Fridlund,et al.  Pattern recognition of self-reported emotional state from multiple-site facial EMG activity during affective imagery. , 1984, Psychophysiology.

[50]  Giulio Sandini,et al.  Fine detection of grasp force and posture by amputees via surface electromyography , 2009, Journal of Physiology-Paris.

[51]  Ning Jiang,et al.  Extracting Simultaneous and Proportional Neural Control Information for Multiple-DOF Prostheses From the Surface Electromyographic Signal , 2009, IEEE Transactions on Biomedical Engineering.

[52]  Jian Huang,et al.  A real-time EMG pattern recognition method for virtual myoelectric hand control , 2014, Neurocomputing.

[53]  Todd A. Kuiken,et al.  Improving Myoelectric Pattern Recognition Robustness to Electrode Shift by Changing Interelectrode Distance and Electrode Configuration , 2012, IEEE Transactions on Biomedical Engineering.

[54]  R Kadefors,et al.  A cube model for the classification of work with hand tools and the formulation of functional requirements. , 1993, Applied ergonomics.

[55]  Charles Jorgensen,et al.  Gestures as Input: Neuroelectric Joysticks and Keyboards , 2003, IEEE Pervasive Comput..

[56]  Cândida Ferreira,et al.  Gene Expression Programming: A New Adaptive Algorithm for Solving Problems , 2001, Complex Syst..

[57]  Aydin Akan,et al.  Prediction of externally applied forces to human hands using frequency content of surface EMG signals , 2010, Comput. Methods Programs Biomed..

[58]  Dario Farina,et al.  Simultaneous and Proportional Force Estimation for Multifunction Myoelectric Prostheses Using Mirrored Bilateral Training , 2011, IEEE Transactions on Biomedical Engineering.

[59]  Xu Zhang,et al.  Multiple Hand Gesture Recognition Based on Surface EMG Signal , 2007, 2007 1st International Conference on Bioinformatics and Biomedical Engineering.

[60]  J Malchaire,et al.  Evaluation of handgrip force from EMG measurements. , 1995, Applied ergonomics.

[61]  L.J. Hadjileontiadis,et al.  Evaluation of surface EMG features for the recognition of American Sign Language gestures , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[62]  O. Stavdahl,et al.  Control of Upper Limb Prostheses: Terminology and Proportional Myoelectric Control—A Review , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[63]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[64]  Othman Omran Khalifa,et al.  EMG signal classification for human computer interaction: a review , 2009 .

[65]  Jiangping Wang,et al.  Eyebrow emotional expression recognition using surface EMG signals , 2015, Neurocomputing.

[66]  Betsy V. Hunter,et al.  Muscle moment arm and normalized moment contributions as reference data for musculoskeletal elbow and wrist joint models. , 2009, Journal of biomechanics.

[67]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[68]  J. Rafiee,et al.  Feature extraction of forearm EMG signals for prosthetics , 2011, Expert Syst. Appl..

[69]  Kongqiao Wang,et al.  Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors , 2009, IUI.

[70]  Mohamed Kaâniche,et al.  Gesture recognition from video sequences , 2009 .

[71]  T Stieglitz,et al.  Neural Prostheses in Clinical Applications – Trends from Precision Mechanics towards Biomedical Microsystems in Neurological Rehabilitation / Neuroprothesen in der klinischen Anwendung – Trends von der Feinwerktechnik zu biomedizinischen Mikrosystemen in der neurologischen Rehabilitation , 2004, Biomedizinische Technik. Biomedical engineering.

[72]  Dario Farina,et al.  Intuitive, Online, Simultaneous, and Proportional Myoelectric Control Over Two Degrees-of-Freedom in Upper Limb Amputees , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[73]  Marimuthu Palaniswami,et al.  Subtle Hand Gesture Identification for HCI Using Temporal Decorrelation Source Separation BSS of Surface EMG , 2007, 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007).

[74]  Guido Bugmann,et al.  Improving the Performance Against Force Variation of EMG Controlled Multifunctional Upper-Limb Prostheses for Transradial Amputees , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[75]  R. Clement,et al.  Bionic prosthetic hands: A review of present technology and future aspirations. , 2011, The surgeon : journal of the Royal Colleges of Surgeons of Edinburgh and Ireland.

[76]  R WheelerKevin,et al.  Gestures as Input , 2003 .

[77]  Huosheng Hu,et al.  Myoelectric control systems - A survey , 2007, Biomed. Signal Process. Control..

[78]  P. Geethanjali,et al.  Identification of motion from multi-channel EMG signals for control of prosthetic hand , 2011, Australasian Physical & Engineering Sciences in Medicine.

[79]  Dario Farina,et al.  The extraction of neural strategies from the surface EMG: an update. , 2014, Journal of applied physiology.

[80]  E. Rustighi,et al.  Subject-specific musculoskeletal parameters of wrist flexors and extensors estimated by an EMG-driven musculoskeletal model. , 2012, Medical engineering & physics.