Position-Free Hand Gesture Recognition Using Single Shot MultiBox Detector Based Neural Network

Hand Gesture Recognition plays an important role in noncontact human computer interaction. The traditional Recognition based on vision has specific requirements for the target location and equipment. We employ monocular camera to build a system which can detect the hand in any position of the screen and recognize the hand gesture. Single Shot MultiBox Detector (SSD) locates the hand position and Convolutional Neural Network (CNN) makes classification of the hand gestures. The gesture recognition performance of the proposed technique is 95.05% on Massey University gesture dataset, using CNN classifier.

[1]  Shanxin Yuan,et al.  First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[2]  Fuji Ren,et al.  Facial expression recognition based on AAM–SIFT and adaptive regional weighting , 2015 .

[3]  Wei Lu,et al.  Dynamic Hand Gesture Recognition With Leap Motion Controller , 2016, IEEE Signal Processing Letters.

[4]  Tse-Yu Pan,et al.  Sign language recognition in complex background scene based on adaptive skin colour modelling and support vector machine , 2018, Int. J. Big Data Intell..

[5]  Yael Edan,et al.  Vision-based hand-gesture applications , 2011, Commun. ACM.

[6]  Antonis A. Argyros,et al.  Accurate Hand Keypoint Localization on Mobile Devices , 2018, 2019 16th International Conference on Machine Vision Applications (MVA).

[7]  Pavlo Molchanov,et al.  Hand gesture recognition with 3D convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Stefan Lee,et al.  Lending A Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  Pavlo Molchanov,et al.  Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Ali Borji,et al.  Analysis of Hand Segmentation in the Wild , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Napoleon H. Reyes,et al.  A New 2D Static Hand Gesture Colour Image Dataset for ASL Gestures , 2011 .

[14]  Ian D. Reid,et al.  RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[16]  BatchNorm,et al.  Cross-modal Deep Variational Hand Pose Estimation , 2018 .

[17]  Thomas Brox,et al.  Learning to Estimate 3D Hand Pose from Single RGB Images , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[18]  Soma Mitra,et al.  Vision based Hand Gesture Recognition using Dynamic Time Warping for Indian Sign Language , 2016, 2016 International Conference on Information Science (ICIS).

[19]  Brandon Garcia,et al.  Real-time American Sign Language Recognition with Convolutional Neural Networks , 2022 .

[20]  Yi Yang,et al.  Depth-Based Hand Pose Estimation: Methods, Data, and Challenges , 2015, International Journal of Computer Vision.

[21]  Fuji Ren,et al.  Improvement of Developmental Drawing Imitation Using Recurrent Neural Network Through Incorporation of AVITEWRITE Model , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[22]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.

[23]  Samit Ari,et al.  Hand Gesture Recognition Using Local Histogram Feature Descriptor , 2018, 2018 2nd International Conference on Trends in Electronics and Informatics (ICOEI).

[24]  Junsong Yuan,et al.  Robust Part-Based Hand Gesture Recognition Using Kinect Sensor , 2013, IEEE Transactions on Multimedia.

[25]  Rahul Kala,et al.  Static hand gesture recognition using stacked Denoising Sparse Autoencoders , 2014, 2014 Seventh International Conference on Contemporary Computing (IC3).

[26]  C Baur,et al.  A non-contact mouse for surgeon-computer interaction. , 2004, Technology and health care : official journal of the European Society for Engineering and Medicine.