Intelligent Human-Computer Interaction Based on Surface EMG Gesture Recognition

Urban intelligence is an emerging concept which guides a series of infrastructure developments in modern smart cities. Human–computer interaction (HCI) is the interface between residents and the smart cities, it plays a key role in bridging the gap in applicating information technologies in modern cities. Hand gestures have been widely acknowledged as a promising HCI method, recognition human hand gestures using surface electromyogram (sEMG) is an important research topic in the application of sEMG. However, state-of-the-art signal processing technologies are not robust in feature extraction and pattern recognition with sEMG signals, several technical problems are still yet to be solved. For example, how to maintain the availability of myoelectric control in intermittent use, since pattern recognition qualities are greatly affected by time variability, but it is unavoidable during daily use. How to ensure the reliability and effectiveness of myoelectric control system also important in developing a good human–machine interface. In this paper, linear discriminant analysis (LDA) and extreme learning machine (ELM) are implemented in hand gesture recognition system, which is able to reduce the redundant information in sEMG signals and improve recognition efficiency and accuracy. The characteristic map slope (CMS) is extracted by using the feature re-extraction method because CMS can strengthen the relationship of features cross time domain and enhance the feasibility of cross-time identification. This study is focusing on optimizing the time differences in sEMG pattern recognition, the experimental results are beneficial to reducing the time differences in gesture recognition based on sEMG. The recognition framework proposed in this paper can enhance the generalization ability of HCI in the long term use and it also simplifies the data collection stage before training the device ready for daily use, which is of great significance to improve the time generalization performance of an HCI system.

[1]  Gongfa Li,et al.  Coke Oven Intelligent Integrated Control System , 2013 .

[2]  Gongfa Li,et al.  Research on the method of step feature extraction for EOD robot based on 2D laser radar , 2015 .

[3]  G. Li,et al.  Thermal Mechanical Stress Analysis of Ladle Lining with Integral Brick Joint , 2018 .

[4]  Xinping Yan,et al.  An Evidential Reasoning‐Based CREAM to Human Reliability Analysis in Maritime Accident Process , 2017, Risk analysis : an official publication of the Society for Risk Analysis.

[5]  C. Guedes Soares,et al.  Incorporating evidential reasoning and TOPSIS into group decision-making under uncertainty for handling ship without command , 2018, Ocean Engineering.

[6]  Ying Sun,et al.  Towards the sEMG hand: internet of things sensors and haptic feedback application , 2018, Multimedia Tools and Applications.

[7]  Zhe Li,et al.  Adaptive fuzzy sliding mode control algorithm simulation for 2-DOF articulated robot , 2017, Int. J. Wirel. Mob. Comput..

[8]  Ajat Shatru Arora,et al.  Stress analysis of lower back using EMG signal , 2017 .

[9]  Honghai Liu,et al.  Intelligent control model and its simulation of flue temperature in coke oven , 2015 .

[10]  Honghai Liu,et al.  An Interactive Image Segmentation Method in Hand Gesture Recognition , 2017, Sensors.

[11]  Ying Sun,et al.  Gear reducer optimal design based on computer multimedia simulation , 2018, The Journal of Supercomputing.

[12]  Hongli Dong,et al.  Event-triggered distributed filtering over sensor networks with deception attacks and partial measurements , 2018, Int. J. Gen. Syst..

[13]  Honghai Liu,et al.  Jointly network: a network based on CNN and RBM for gesture recognition , 2018, Neural Computing and Applications.

[14]  Gongfa Li,et al.  Numerical simulation of temperature field and thermal stress field in the new type of ladle with the nanometer adiabatic material , 2015 .

[15]  Fuad E. Alsaadi,et al.  Improved Tobit Kalman filtering for systems with random parameters via conditional expectation , 2018, Signal Process..

[16]  Ying Sun,et al.  Surface EMG hand gesture recognition system based on PCA and GRNN , 2019, Neural Computing and Applications.

[17]  Gongfa Li,et al.  Intelligent Control of Air Compressor Production Process , 2013 .

[18]  Gongfa Li,et al.  Influence of Working Lining Parameters on Temperature and Stress Field of Ladle , 2013 .

[19]  Honghai Liu,et al.  Intelligent computational control of multi-fingered dexterous robotic hand , 2015 .

[20]  Jiujun Cheng,et al.  TRec: an efficient recommendation system for hunting passengers with deep neural networks , 2018, Neural Computing and Applications.

[21]  Hui Yu,et al.  Gesture recognition based on binocular vision , 2018, Cluster Computing.

[22]  Gongfa Li,et al.  Decomposition algorithm for depth image of human health posture based on brain health , 2019, Neural Computing and Applications.

[23]  Honghai Liu,et al.  D-S evidential theory on sEMG signal recognition , 2017, Int. J. Comput. Sci. Math..

[24]  Yinfeng Fang,et al.  Interface Prostheses With Classifier-Feedback-Based User Training , 2017, IEEE Transactions on Biomedical Engineering.

[25]  Honghai Liu,et al.  Fusion hand gesture segmentation and extraction based on CMOS sensor and 3D sensor , 2017 .

[26]  Dingguo Zhang,et al.  sEMG Bias-Driven Functional Electrical Stimulation System for Upper-Limb Stroke Rehabilitation , 2018, IEEE Sensors Journal.

[27]  Bo Tao,et al.  Probability analysis for grasp planning facing the field of medical robotics , 2019, Measurement.

[28]  Honghai Liu,et al.  Gesture Recognition Based on Kinect and sEMG Signal Fusion , 2018, Mobile Networks and Applications.

[29]  Honghai Liu,et al.  Simultaneous Calibration: A Joint Optimization Approach for Multiple Kinect and External Cameras , 2017, Sensors.

[30]  Hao Wu,et al.  Dynamic Gesture Recognition in the Internet of Things , 2019, IEEE Access.

[31]  Bo Tao,et al.  Gesture recognition based on skeletonization algorithm and CNN with ASL database , 2018, Multimedia Tools and Applications.

[32]  Gongfa Li,et al.  A novel feature extraction method for machine learning based on surface electromyography from healthy brain , 2019, Neural Computing and Applications.

[33]  Guo Zhang Jiang,et al.  Numerical Simulation-Based Optimization of Contact Stress Distribution and Lubrication Conditions in the Straight Worm Drive , 2018, Strength of Materials.

[34]  Gongfa Li,et al.  Numerical simulation of the influence factors for rotary kiln in temperature field and stress field and the structure optimization , 2015 .

[35]  Honghai Liu,et al.  Gesture recognition based on modified adaptive orthogonal matching pursuit algorithm , 2017, Cluster Computing.

[36]  Gongfa Li,et al.  Human Lesion Detection Method Based on Image Information and Brain Signal , 2019, IEEE Access.

[37]  Xiangyang Zhu,et al.  A Multichannel Surface EMG System for Hand Motion Recognition , 2015, Int. J. Humanoid Robotics.

[38]  Honghai Liu,et al.  Intelligent computation in grasping control of dexterous robot hand , 2015 .

[39]  Caihua Xiong,et al.  Design and Implementation of an Anthropomorphic Hand for Replicating Human Grasping Functions , 2016, IEEE Transactions on Robotics.

[40]  Honghai Liu,et al.  Hand gesture recognition based on convolution neural network , 2017, Cluster Computing.

[41]  Honghai Liu,et al.  Surface EMG data aggregation processing for intelligent prosthetic action recognition , 2018, Neural Computing and Applications.

[42]  Ilse Jonkers,et al.  EMG-Driven Optimal Estimation of Subject-SPECIFIC Hill Model Muscle–Tendon Parameters of the Knee Joint Actuators , 2017, IEEE Transactions on Biomedical Engineering.

[43]  Honghai Liu,et al.  Development of articulated robot trajectory planning , 2017, Int. J. Comput. Sci. Math..

[44]  Honghai Liu,et al.  Gesture recognition based on sparse representation , 2016 .

[45]  Yasuharu Koike,et al.  Hybrid Control of a Vision-Guided Robot Arm by EOG, EMG, EEG Biosignals and Head Movement Acquired via a Consumer-Grade Wearable Device , 2016, IEEE Access.

[46]  Honghai Liu,et al.  Gesture recognition based on an improved local sparse representation classification algorithm , 2017, Cluster Computing.

[47]  Honghai Liu,et al.  Optimal grasp planning of multi-fingered robotic hands:a review , 2015 .