Hand segmentation using skin color and background information

Precise hand segmentation is crucial for gesture-based Human-Machine Interaction. Skin color based hand segmentation using skin color models shows poor performance in complex background where similar colors of the skin and non-uniform illumination exist. We propose a new method for hand segmentation by using an adaptive skin color model and the background information around the hand. Firstly, our method captures pixel values of the hand and the background then converts them into YCbCr color space. Secondly, skin and background Gaussian models based on the color space of CbCr are proposed. Lastly, these models are taken to segment the whole image respectively, and then required for the intersection. The main contribution of the paper is that the background information is taken into account to split image in reversed side to enhance the performance. Experimental results show that our method outperforms the method that uses the skin color model only.

[1]  S. L. Phung,et al.  A novel skin color model in YCbCr color space and its application to human face detection , 2002, Proceedings. International Conference on Image Processing.

[2]  Abdul Rahman Ramli,et al.  A hand segmentation scheme using clustering technique in homogeneous background , 2002, Student Conference on Research and Development.

[3]  Abdesselam Bouzerdoum,et al.  Skin segmentation using color pixel classification: analysis and comparison , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Xiaofen Xing,et al.  Hand gesture segmentation based on improved kalman filter and TSL skin color model , 2011, 2011 International Conference on Multimedia Technology.

[5]  Abdesselam Bouzerdoum,et al.  Skin segmentation using color and edge information , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[6]  S. PatilKulakarni,et al.  Segmentation Algorithm for Multiple Face Detection in Color Images with Skin Tone Regions using Color Spaces and Edge Detection Techniques , 2010 .

[7]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[8]  Jing Pan,et al.  Hand Detection Using Robust Color Correction and Gaussian Mixture Model , 2011, 2011 Sixth International Conference on Image and Graphics.

[9]  Alexander H. Waibel,et al.  A real-time face tracker , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[10]  Shigeru Akamatsu,et al.  Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[11]  Junaidi Abdullah,et al.  A new method for hand segmentation using free-form skin color model , 2010, 2010 3rd International Conference on Advanced Computer Theory and Engineering(ICACTE).

[12]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[13]  Narendra Ahuja,et al.  Gaussian mixture model for human skin color and its applications in image and video databases , 1998, Electronic Imaging.