A Hybrid Method for Gesture Recognition

In this article, we propose a new hybrid approach with Fourier technique well known as Fourier descriptor and HU moments to detect hand gesture signatures for vision-based applications. Fourier descriptors are efficient specifications of image feature extraction. They can be used for shape characterization by preventing the scale, translation, and rotation invariance, as well as their independent from small shape deviations. To obtain good results for hand images, they converted into HSV color space. HSV unlike RGB color space has some features help users understand the nuances in the images; since, if one color be similar to another color, HSV can get better results. After that, Hand image will be extracted from HSV image by implementing the threshold operation. The Fourier Descriptors of extracted hand images are hybridized with HU moments and are compared with the reference dictionary to perform gesture recognition. Experiments are performed on the Bochum Gestures database. Finally the performance of the gesture recognition using Euclidean distance investigated. Results show that proposed hybrid method gives a high performance for hand gesture applications.

[1]  Helen C. Shen,et al.  Palmprint identification using palmcodes , 2004, Third International Conference on Image and Graphics (ICIG'04).

[2]  Helge J. Ritter,et al.  Visual recognition of continuous hand postures , 2002, IEEE Trans. Neural Networks.

[3]  Sachin Jambawalikar,et al.  Hand Recognition Using Geometric Classifiers , 2004, ICBA.

[4]  Stan Sclaroff,et al.  3D hand pose reconstruction using specialized mappings , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  Bhavani M. Thuraisingham,et al.  An Effective Evidence Theory Based K-Nearest Neighbor (KNN) Classification , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[6]  Tim Ellis,et al.  Recognizing hand gesture using Fourier descriptors , 2004, ICPR 2004.

[7]  Surendra Ranganath,et al.  Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  S. Elliott,et al.  Implementation of hand geometry: an analysis of user perspectives and system performance , 2006, IEEE Aerospace and Electronic Systems Magazine.

[9]  Yun Liu,et al.  Hand Gesture Recognition Based on HU Moments in Interaction of Virtual Reality , 2012, 2012 4th International Conference on Intelligent Human-Machine Systems and Cybernetics.

[10]  Salah Bourennane,et al.  Comparison of fourier descriptors and Hu moments for hand posture recognition , 2007, 2007 15th European Signal Processing Conference.

[11]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Surendra Ranganath,et al.  Real-time gesture recognition system and application , 2002, Image Vis. Comput..

[13]  David W. Murray,et al.  Regression-based Hand Pose Estimation from Multiple Cameras , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[14]  Javier Ruiz-del-Solar,et al.  Real-Time Hand Gesture Detection and Recognition Using Boosted Classifiers and Active Learning , 2007, PSIVT.

[15]  David Zhang,et al.  Personal recognition using hand shape and texture , 2006, IEEE Transactions on Image Processing.

[16]  Ying Wu,et al.  View-independent recognition of hand postures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[17]  Ana González-Marcos,et al.  Biometric Identification through Hand Geometry Measurements , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Navid Razmjooy,et al.  A real-time mathematical computer method for potato inspection using machine vision , 2012, Comput. Math. Appl..

[19]  Jochen Triesch,et al.  A System for Person-Independent Hand Posture Recognition against Complex Backgrounds , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  John R. Kender,et al.  Finding skin in color images , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[22]  Thomas R. Crimmins.  A Complete Set of Fourier Descriptors for Two-Dimensional Shapes , 1982, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  Robert B. McGhee,et al.  Aircraft Identification by Moment Invariants , 1977, IEEE Transactions on Computers.