Static hand gesture recognition using neural networks

This paper presents a novel technique for hand gesture recognition through human–computer interaction based on shape analysis. The main objective of this effort is to explore the utility of a neural network-based approach to the recognition of the hand gestures. A unique multi-layer perception of neural network is built for classification by using backpropagation learning algorithm. The goal of static hand gesture recognition is to classify the given hand gesture data represented by some features into some predefined finite number of gesture classes. The proposed system presents a recognition algorithm to recognize a set of six specific static hand gestures, namely: Open, Close, Cut, Paste, Maximize, and Minimize. The hand gesture image is passed through three stages, preprocessing, feature extraction, and classification. In preprocessing stage some operations are applied to extract the hand gesture from its background and prepare the hand gesture image for the feature extraction stage. In the first method, the hand contour is used as a feature which treats scaling and translation of problems (in some cases). The complex moment algorithm is, however, used to describe the hand gesture and treat the rotation problem in addition to the scaling and translation. The algorithm used in a multi-layer neural network classifier which uses back-propagation learning algorithm. The results show that the first method has a performance of 70.83% recognition, while the second method, proposed in this article, has a better performance of 86.38% recognition rate.

[1]  William T. Freeman,et al.  Orientation Histograms for Hand Gesture Recognition , 1995 .

[2]  G. Awcock,et al.  Applied Image Processing , 1995 .

[3]  Jochen Triesch,et al.  Robust classification of hand postures against complex backgrounds , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[4]  Peter Ingwersen,et al.  Methodological Approach , 2021, Examining Gun Regulations, Warning Behaviors, and Policies to Prevent Mass Shootings.

[5]  Min Xie,et al.  Vision-Based Hand Gesture Recognition for Human-Vehicle Interaction , 1998 .

[6]  S. Naidoo,et al.  Vision-Based Static Hand Gesture Recognition Using Support Vector Machines , 2002 .

[7]  Tamás Szirányi,et al.  Hand-Gesture Based Film Restoration , 2002, PRIS.

[8]  Aditya Ramamoorthy,et al.  Recognition of dynamic hand gestures , 2003, Pattern Recognit..

[9]  Peter Xiaoping Liu,et al.  Visual gesture recognition for human-machine interface of robot teleoperation , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[10]  Abdolhossein Sarrafzadeh,et al.  A Color Hand Gesture Database for Evaluating and Improving Algorithms on Hand Gesture and Posture Recognition , 2005 .

[11]  A. Barczak,et al.  Real-time hand tracking using a set of cooperative classifiers based on Haar-like features A ndre , 2005 .

[12]  Patrick Lambert,et al.  Dynamic Hand Gesture Recognition Using the Skeleton of the Hand , 2005, EURASIP J. Adv. Signal Process..

[13]  Chin-Chen Chang,et al.  New Approach for Static Gesture Recognition , 2006, J. Inf. Sci. Eng..

[14]  Jayanthi Sivaswamy,et al.  A simple scheme for contour detection , 2018, VISAPP.

[15]  Cyrus Shahabi,et al.  An algorithmic approach for static and dynamic gesture recognition utilising mechanical and biomechanical characteristics , 2007, Int. J. Bioinform. Res. Appl..

[16]  Tae-Kyun Kim,et al.  Gesture Recognition Under Small Sample Size , 2007, ACCV.

[17]  Kanad K. Biswas,et al.  Real Time Hand Tracking and Gesture Recognition , 2009, IPCV.

[18]  Ismail A. Ismail,et al.  Signature Recognition using Multi Scale Fourier Descriptor And Wavelet Transform , 2010, ArXiv.

[19]  G.R.S. Murthy,et al.  Hand gesture recognition using neural networks , 2010, 2010 IEEE 2nd International Advance Computing Conference (IACC).

[20]  H. Winnemöller Practical Gesture Recognition for controlling Virtual Environments , 2022 .