Rapid hand posture recognition using Adaptive Histogram Template of Skin and hand edge contour

In this paper, we propose a real-time vision-based hand posture recognition approach, based on appearance-based features of hand. Our approach has three main steps: hand segmentation, feature extraction and posture recognition. For the hand segmentation, we introduce “Adaptive Histogram Template of Skin” which tries to extract histogram of the subject hand by sampling its color and texture. With this template, we can use back projection method to find skin color areas in an image. In the feature extraction step, we extract global hand's features using hand's edge contour, and hand's edge convex hull. The hand can be classified into one of the ten posture classes in the recognition step. Each posture class has a representative template which is used as reference for comparing to subject hand features. This approach is simple and fast enough to provide real-time recognition.

[1]  Cristina Manresa-Yee,et al.  Hand Tracking and Gesture Recognition for Human-Computer Interaction , 2009, Progress in Computer Vision and Image Analysis.

[2]  Joshua Ryan New,et al.  A Method for Hand Gesture Recognition , 2002 .

[3]  Thomas S. Huang,et al.  Tracking articulated hand motion with eigen dynamics analysis , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Thomas B. Moeslund,et al.  Computer vision-based gesture recognition for an augmented reality interface , 2004 .

[5]  Robyn A. Owens,et al.  Visual Sign Language Recognition , 2000, Theoretical Foundations of Computer Vision.

[6]  Ramon Mas,et al.  Hand Tracking and Gesture Recognition for Human-Computer Interaction , 2005 .

[7]  J. IIVARINENHelsinki Efficiency of Simple Shape Descriptors , 1997 .

[8]  Mohammed Waleed Kadous Auslan Sign Recognition Using Computers and Gloves , 1998 .

[9]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[10]  JEFFREY WOOD,et al.  Invariant pattern recognition: A review , 1996, Pattern Recognit..

[11]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[12]  David Casasent Intelligent Robots and Computer Vision XIV: Algorithms, Techniques, Active Vision, and Materials Handling , 1995 .

[13]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  V. Pisarevsky,et al.  Intel's Computer Vision Library: applications in calibration, stereo segmentation, tracking, gesture, face and object recognition , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[15]  Jan Flusser,et al.  Combined blur and affine moment invariants and their use in pattern recognition , 2003, Pattern Recognit..

[16]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Takeo Kanade,et al.  Visual Tracking of High DOF Articulated Structures: an Application to Human Hand Tracking , 1994, ECCV.

[18]  Ying Wu,et al.  For Vision-Based Human Computer Interaction , 2001 .

[19]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[20]  Robert B. McGhee,et al.  Aircraft Identification by Moment Invariants , 1977, IEEE Transactions on Computers.

[21]  N.D. Georganas,et al.  Real-time Vision-based Hand Gesture Recognition Using Haar-like Features , 2007, 2007 IEEE Instrumentation & Measurement Technology Conference IMTC 2007.

[22]  Anthony P. Reeves,et al.  Three-Dimensional Shape Analysis Using Moments , 1988 .

[23]  Alexandru Telea,et al.  An Image Inpainting Technique Based on the Fast Marching Method , 2004, J. Graphics, GPU, & Game Tools.

[24]  Ari Visa,et al.  Shape recognition of irregular objects , 1996, Other Conferences.

[25]  Tae-Woong Yoo,et al.  A fast algorithm for tracking human faces based on chromatic histograms , 1999, Pattern Recognit. Lett..

[26]  Rama Chellappa,et al.  Skin Detection -a Short Tutorial , 2010 .

[27]  Ying Wu,et al.  Hand modeling, analysis and recognition , 2001, IEEE Signal Process. Mag..

[28]  Demetri Psaltis,et al.  Image Normalization by Complex Moments , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.