Vision-Based Hand Gesture Recognition Using Combinational Features

This paper presents a feature extraction method for hand gesture based on multi-layer perceptron. The feature of hand skin color in the YCbCr color space is used to detect hand gesture. The hand silhouette and features can be accurately extracted in means of binarizing the hand image and enhancing the contrast. Median and smoothing filters are integrated to remove the noise. Combinational parameters of Hu invariant moment, hand gesture region, and Fourier descriptor are created to form a new feature vector which can recognize hand gesture. To confirm the robustness of this proposed method, a dataset including 3500 images is built. Experimental results demonstrate that our system can successfully recognize hand gesture with 97.4% recognition rate.

[1]  Nikolaos G. Bourbakis,et al.  A survey of skin-color modeling and detection methods , 2007, Pattern Recognit..

[2]  G.P. Dimuro,et al.  Interval Fuzzy Rule-Based Hand Gesture Recognition , 2006, 12th GAMM - IMACS International Symposium on Scientific Computing, Computer Arithmetic and Validated Numerics (SCAN 2006).

[3]  Yen-Wei Chen,et al.  Articulated hand tracking by PCA-ICA approach , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[4]  Rogério Schmidt Feris,et al.  The isometric self-organizing map for 3D hand pose estimation , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[5]  Marion G. Ceruti,et al.  Wireless communication glove apparatus for motion tracking, gesture recognition, data transmission, and reception in extreme environments , 2009, SAC '09.

[6]  Yuntao Cui,et al.  Appearance-Based Hand Sign Recognition from Intensity Image Sequences , 2000, Comput. Vis. Image Underst..

[7]  Manuele Bicego,et al.  A Hidden Markov Model approach for appearance-based 3D object recognition , 2005, Pattern Recognit. Lett..

[8]  Ming C. Leu,et al.  Human-Computer Interaction System with Artificial Neural Network Using Motion Tracker and Data Glove , 2005, PReMI.