Hand pose identification from monocular image for sign language recognition

In this paper, a novel approach for hand pose recognition is proposed by analyzing the textures and key geometrical features of the hand. A skeletal hand model is constructed to analyze the abduction/adduction movements of the fingers and subsequently, texture analysis is performed to consider some inflexive finger movements. Probabilistic distributions of the geometric features are considered for modelling intra-class abduction/adduction variations. Gestures differing in inflexive positions of fingers are classified based on Homogeneous Texture Descriptors (HTD), where the texture region is characterized using the mean energy and energy deviation from a set of frequency channels. Similarity measures are computed between input gestures and pre-modelled gesture patterns from a database by considering intra class abduction/adduction angle variations and inter class inflexive variations. Experimental results show the efficacy of our proposed hand pose recognition system.

[1]  Sung Uk Lee,et al.  3D hand reconstruction from a monocular view , 2004, ICPR 2004.

[2]  Tosiyasu L. Kunii,et al.  Model-based analysis of hand posture , 1995, IEEE Computer Graphics and Applications.

[3]  Marco Winzker,et al.  2011 IEEE International Conference on Signal and Image Processing Applications, ICSIPA 2011, Kuala Lumpur, Malaysia, November 16-18, 2011 , 2011, International Conference on Signal and Image Processing Applications.

[4]  Stan Sclaroff,et al.  Skin color-based video segmentation under time-varying illumination , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jae Wook Jeon,et al.  Finger extraction from scene with grayscale morphology and BLOB analysis , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[6]  Haiying Guan,et al.  3D hand pose retrieval from a single 2D image , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[7]  B. S. Manjunath,et al.  MPEG‐7 Homogeneous Texture Descriptor , 2001 .

[8]  Debanga Raj Neog,et al.  Hand pose recognition using geometric features , 2011, 2011 National Conference on Communications (NCC).

[9]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Sung Kwan Kang,et al.  Color Based Hand and Finger Detection Technology for User Interaction , 2008, 2008 International Conference on Convergence and Hybrid Information Technology.

[11]  Mengfen Ho,et al.  A vision-based hand motion parameter capturing for HCI , 2008, 2008 International Conference on Audio, Language and Image Processing.

[12]  Hamid Soltanian-Zadeh,et al.  Rotation-invariant multiresolution texture analysis using Radon and wavelet transforms , 2005, IEEE Transactions on Image Processing.

[13]  Tsukasa Ogasawara,et al.  A hand-pose estimation for vision-based human interfaces , 2003, IEEE Trans. Ind. Electron..

[14]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).