A Recognition Method of Hand Gesture with CNN-SVM Model

Given the popularity of hand gesture sign language, automatic interpretation of different gestures has received ever increasing interests. However, owing to the complex of background and similarity between different gestures, a more robust method is needed for effective gesture recognition. In this paper, given the robustness of depth image, a depth image based segmentation is designed to extract the gesture region, while Convolutional Neural Network (CNN) and support vector machine (SVM) are trained respectively for feature extraction and gesture recognition. Experiments on America Sign Language dataset demonstrate that our method is promising and more efficient than some existing methods like HSF + RDF, SIFT + PLS, MPC and classical CNN.

[1]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[2]  Nikos Papamarkos,et al.  Hand gesture recognition using a neural network shape fitting technique , 2009, Eng. Appl. Artif. Intell..

[3]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[4]  S. Amirhassan Monadjemi,et al.  Rapid hand posture recognition using Adaptive Histogram Template of Skin and hand edge contour , 2010, 2010 6th Iranian Conference on Machine Vision and Image Processing.

[5]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[6]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[7]  Mohamed Khalil Hani,et al.  Character Recognition of License Plate Number Using Convolutional Neural Network , 2011, IVIC.

[8]  Sergio Escalera,et al.  Graph cuts optimization for multi-limb human segmentation in depth maps , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Karen Das,et al.  Recognition of Indian Sign Language in Live Video , 2013, ArXiv.

[10]  Michael Schmeing,et al.  Color Segmentation Based Depth Image Filtering , 2012, WDIA.

[11]  Maya Ingle,et al.  Real-Time Static Hand Gesture Recognition for American Sign Language (ASL) in Complex Background , 2012 .

[12]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[13]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[14]  Nicolas Pugeault,et al.  Spelling it out: Real-time ASL fingerspelling recognition , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).