Gesture recognition based on skeletonization algorithm and CNN with ASL database

In the field of human-computer interaction, vision-based gesture recognition methods are widely studied. However, its recognition effect depends to a large extent on the performance of the recognition algorithm. The skeletonization algorithm and convolutional neural network (CNN) for the recognition algorithm reduce the impact of shooting angle and environment on recognition effect, and improve the accuracy of gesture recognition in complex environments. According to the influence of the shooting angle on the same gesture recognition, the skeletonization algorithm is optimized based on the layer-by-layer stripping concept, so that the key node information in the hand skeleton diagram is extracted. The gesture direction is determined by the spatial coordinate axis of the hand. Based on this, gesture segmentation is implemented to overcome the influence of the environment on the recognition effect. In order to further improve the accuracy of gesture recognition, the ASK gesture database is used to train the convolutional neural network model. The experimental results show that compared with SVM method, dictionary learning + sparse representation, CNN method and other methods, the recognition rate reaches 96.01%.

[1]  Gongfa Li,et al.  Research on the method of step feature extraction for EOD robot based on 2D laser radar , 2015 .

[2]  Honghai Liu,et al.  Intelligent control model and its simulation of flue temperature in coke oven , 2015 .

[3]  Honghai Liu,et al.  An Interactive Image Segmentation Method in Hand Gesture Recognition , 2017, Sensors.

[4]  Honghai Liu,et al.  Gesture Recognition Based on Kinect and sEMG Signal Fusion , 2018, Mobile Networks and Applications.

[5]  Gongfa Li,et al.  Numerical simulation of temperature field and thermal stress field in the new type of ladle with the nanometer adiabatic material , 2015 .

[6]  Fuad E. Alsaadi,et al.  Improved Tobit Kalman filtering for systems with random parameters via conditional expectation , 2018, Signal Process..

[7]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[8]  Karen Emmorey,et al.  ASL-LEX: A lexical database of American Sign Language , 2017, Behavior research methods.

[9]  Honghai Liu,et al.  Jointly network: a network based on CNN and RBM for gesture recognition , 2018, Neural Computing and Applications.

[10]  Gongfa Li,et al.  Intelligent Control of Air Compressor Production Process , 2013 .

[11]  Honghai Liu,et al.  Simultaneous Calibration: A Joint Optimization Approach for Multiple Kinect and External Cameras , 2017, Sensors.

[12]  Jong Chul Ye,et al.  A General Framework for Compressed Sensing and Parallel MRI Using Annihilating Filter Based Low-Rank Hankel Matrix , 2015, IEEE Transactions on Computational Imaging.

[13]  Guo Zhang Jiang,et al.  Numerical Simulation-Based Optimization of Contact Stress Distribution and Lubrication Conditions in the Straight Worm Drive , 2018, Strength of Materials.

[14]  Yiqiang Chen,et al.  Context-Aware Information Based Ultrasonic Gesture Recognition Method , 2018 .

[15]  Honghai Liu,et al.  Gesture recognition based on an improved local sparse representation classification algorithm , 2017, Cluster Computing.

[16]  Ying Sun,et al.  Gear reducer optimal design based on computer multimedia simulation , 2018, The Journal of Supercomputing.

[17]  Gongfa Li,et al.  Numerical simulation of the influence factors for rotary kiln in temperature field and stress field and the structure optimization , 2015 .

[18]  Honghai Liu,et al.  Gesture recognition based on modified adaptive orthogonal matching pursuit algorithm , 2017, Cluster Computing.

[19]  G. Li,et al.  Thermal Mechanical Stress Analysis of Ladle Lining with Integral Brick Joint , 2018 .

[20]  Gongfa Li,et al.  A simulation-based study of dispatching rules in a dynamic job shop scheduling problem with batch release and extended technical precedence constraints , 2017, Eur. J. Oper. Res..

[21]  Hongli Dong,et al.  Event-triggered distributed filtering over sensor networks with deception attacks and partial measurements , 2018, Int. J. Gen. Syst..

[22]  Shuncong Zhong,et al.  Sine-modulated wavelength-independent full-range complex spectral optical coherence tomography with an ultra-broadband light source , 2015 .

[23]  Gongfa Li,et al.  Influence of Working Lining Parameters on Temperature and Stress Field of Ladle , 2013 .

[24]  Zhihong Li,et al.  Preparation and characterization of mechanical properties of foam glass for artificial floating island carrier , 2015 .

[25]  Honghai Liu,et al.  Optimal grasp planning of multi-fingered robotic hands:a review , 2015 .

[26]  Ognjan Luzanin,et al.  Hand gesture recognition using low-budget data glove and cluster-trained probabilistic neural network , 2014 .

[27]  Ying Sun,et al.  Towards the sEMG hand: internet of things sensors and haptic feedback application , 2018, Multimedia Tools and Applications.

[28]  Xiangyang Zhu,et al.  A Multichannel Surface EMG System for Hand Motion Recognition , 2015, Int. J. Humanoid Robotics.

[29]  Łukasz Błaszczyk.  Compressed sensing in MRI – mathematical preliminaries and basic examples , 2016 .

[30]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[31]  Honghai Liu,et al.  Hand gesture recognition based on convolution neural network , 2017, Cluster Computing.

[32]  Toby Sharp,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR.

[33]  Gongfa Li,et al.  Research on steady-state simulation in dynamic job shop scheduling problem , 2015 .

[34]  Hui Yu,et al.  Gesture recognition based on binocular vision , 2018, Cluster Computing.

[35]  Gongfa Li,et al.  Coke Oven Intelligent Integrated Control System , 2013 .

[36]  Punam K. Saha,et al.  Fuzzy Object Skeletonization: Theory, Algorithms, and Applications , 2018, IEEE Transactions on Visualization and Computer Graphics.