Hand Gestures Categorisation and Recognition

In this digital era, the focus is now on the development of applications that allow human beings and machines to interact directly. Up to now, many hand gesture recognition systems have been developed for different applications such as sign language recognition and smart surveillance. In recent years, researchers have shown interest in the development of hand gesture recognition applications for dancing movements, which involve dynamic hand gestures. However, there are still various challenges such as extraction of invariant factors, automatic segmentation, the transition between gestures, mixed gestures issues, nature of dynamic hand gestures and occlusions that need to be addressed. This research work aims at developing an application to categorise and recognise the classical “Bharatanatyam” dance hand gestures. Since no online database of “Bharatanatyam” gestures is available to the public for research purposes, a customised database has been built with 900 images, consisting of 15 instances for each hand gesture. In this work, Chain Codes and Histogram of Oriented Gradients (HOG) are proposed for the feature representation of the hand gestures. For the classification of the images, Support Vector Machine (SVM) and K-Nearest Neighbor (KNN) are explored. From the experiments conducted, Chain codes with SVM provide a recognition rate of 99.9% and a false rejection rate of only 0.1%, which is a promising technique for the deployment of movement recognition applications.

[1]  Malin Premaratne,et al.  Dynamic hand gesture recognition system using moment invariants , 2010, 2010 Fifth International Conference on Information and Automation for Sustainability.

[2]  M. Pauline Baker,et al.  Computer graphics with OpenGL , 1986 .

[3]  Chung-Lin Huang,et al.  Hand gesture recognition using a real-time tracking method and hidden Markov models , 2003, Image Vis. Comput..

[4]  Archana Ghotkar,et al.  PERFORMANCE ANALYSIS OF CHAIN CODE DESCRIPTOR FOR HAND SHAPE CLASSIFICATION , 2014 .

[5]  Pierre Soille,et al.  Erosion and Dilation , 1999 .

[6]  Sriparna Saha,et al.  Bharatanatyam hand gesture recognition using polygon representation , 2014, Proceedings of The 2014 International Conference on Control, Instrumentation, Energy and Communication (CIEC).

[7]  Goutam Sanyal,et al.  Hand Gesture Recognition Systems: A Survey , 2013 .

[8]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Yanan Xu,et al.  Review of hand gesture recognition study and application , 2017 .

[10]  S N Karishma,et al.  Fusion of Skin Color Detection and Background Subtraction for Hand Gesture Segmentation , 2014 .

[11]  Alasdair McAndrew,et al.  Introduction to digital image processing with Matlab , 2004 .