A Robust Hand Detection Method Based on Skin Probability Map

Existing hand detection methods are usually implemented with Haar-like and HOG descriptors, which lack of robustness to complicate background and the change of the lighting conditions in real applications. In this paper, a robust hand detection method is presented by exploring various feature representations based on skin probability map (SPM) instead of conventional grayscale image space. We show that, in the generated SPM image, hand region can be greatly highlighted and the background regions can be suppressed. And then, the Haar-like and HOG features are calculated from the skin mask and probability maps respectively, and named as skin-Enhanced features. In the sliding window searching stage, an efficient 3-level detection framework is introduced. In the experiment, an extensive dataset is established for the training of classifiers. And the hand detection results show that, the proposed method is much more robust than conventional hand feature descriptors.

[1]  Stefan Lee,et al.  Lending A Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Andrew Zisserman,et al.  Hand detection using multiple proposals , 2011, BMVC.

[3]  Alejandro Betancourt,et al.  A Sequential Classifier for Hand Detection in the Framework of Egocentric Vision , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[4]  Yu Guo,et al.  Real-time hand detection based on multi-stage HOG-SVM classifier , 2013, 2013 IEEE International Conference on Image Processing.

[5]  N.D. Georganas,et al.  Real-time Vision-based Hand Gesture Recognition Using Haar-like Features , 2007, 2007 IEEE Instrumentation & Measurement Technology Conference IMTC 2007.

[6]  Lijun Yin,et al.  Multi-scale Topological Features for Hand Posture Representation and Analysis , 2013, 2013 IEEE International Conference on Computer Vision.

[7]  Luigi Cinque,et al.  Fast viewpoint-invariant articulated hand detection combining curve and graph matching , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[8]  Kuizhi Mei,et al.  A real-time hand detection system based on multi-feature , 2015, Neurocomputing.

[9]  Shiyang Yan,et al.  Combination of ACF detector and multi-task CNN for hand detection , 2016, 2016 IEEE 13th International Conference on Signal Processing (ICSP).

[10]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Mathias Kölsch,et al.  Robust hand detection , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[12]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[13]  Cheng Li,et al.  Pixel-Level Hand Detection in Ego-centric Videos , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Chieh-Chih Wang,et al.  Hand posture recognition using adaboost with SIFT for human robot interaction , 2007 .

[15]  Takehisa Yairi,et al.  Generalized BRIEF: A Novel Fast Feature Extraction Method for Robust Hand Detection , 2014, 2014 22nd International Conference on Pattern Recognition.

[16]  Yoshihiko Mochizuki,et al.  A HOG-based hand gesture recognition system on a mobile device , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[17]  Mircea Nicolescu,et al.  Vision-based hand pose estimation: A review , 2007, Comput. Vis. Image Underst..