Static Hand Gesture Recognition using Convolutional Neural Network with Data Augmentation

Computer is a part and parcel in our day to day life and used in various fields. The interaction of human and computer is accomplished by conventional input devices like mouse, keyboard etc. Hand gestures can be a useful medium of human-computer interaction and can make the interaction easier. Gestures vary in orientation and shape from person to person. So, non-linearity exists in this problem. Recent research has proved the supremacy of Convolutional Neural Network (CNN) for image representation and classification. Since, CNN can learn complex and non-linear relationships among images, in this paper, a static hand gesture recognition method deploying CNN was proposed. Data augmentation like re-scaling, zooming, shearing, rotation, width and height shifting was applied to the dataset. The model was trained on 8000 images and tested on 1600 images which were divided into 10 classes. The model with augmented data achieved accuracy 97.12% which is nearly 4% higher than the model without augmentation (92.87%).

[1]  Yoshua Bengio,et al.  Object Recognition with Gradient-Based Learning , 1999, Shape, Contour and Grouping in Computer Vision.

[2]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[3]  Jean Meunier,et al.  Static Hand Gesture Recognition Using Artificial Neural Network , 2013 .

[4]  Nikos Papamarkos,et al.  Hand gesture recognition using a neural network shape fitting technique , 2009, Eng. Appl. Artif. Intell..

[5]  Karl Andersson,et al.  A novel anomaly detection algorithm for sensor data under uncertainty , 2016, Soft Computing.

[6]  Mohammad Shahadat Hossain,et al.  A Belief Rule Based Expert System to Assess Tuberculosis under Uncertainty , 2017, Journal of Medical Systems.

[7]  Youlian Zhu,et al.  An Improved Median Filtering Algorithm for Image Noise Reduction , 2012 .

[8]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[9]  Aaron F. Bobick,et al.  Learning visual behavior for gesture analysis , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[10]  C. Jose L. Flores,et al.  Application of convolutional neural networks for static hand gestures recognition under different invariant features , 2017, 2017 IEEE XXIV International Conference on Electronics, Electrical Engineering and Computing (INTERCON).

[11]  Karl Andersson,et al.  A Belief Rule Based Expert System for Datacenter PUE Prediction under Uncertainty , 2017, IEEE Transactions on Sustainable Computing.

[12]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[13]  Qing Chen,et al.  Hand Gesture Recognition Using Haar-Like Features and a Stochastic Context-Free Grammar , 2008, IEEE Transactions on Instrumentation and Measurement.

[14]  Karl Andersson,et al.  A web based belief rule based expert system to predict flood , 2015, iiWAS.

[15]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[16]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[17]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[18]  Neil A. Dodgson,et al.  Decolorize: Fast, contrast enhancing, color to grayscale conversion , 2007, Pattern Recognit..

[19]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[20]  Pavlo Molchanov,et al.  Hand gesture recognition with 3D convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[21]  Xinhua Zhuang,et al.  Image Analysis Using Mathematical Morphology , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Mohammad Shahadat Hossain,et al.  Belief‐rule‐based expert systems for evaluation of e‐government: a case study , 2014, Expert Syst. J. Knowl. Eng..

[23]  Narciso García Santos,et al.  Hand gesture recognition using infrared imagery provided by leap motion controller , 2016, ACIVS 2016.