Color based skin classification

Skin detection is used in applications ranging from face detection, tracking body parts and hand gesture analysis, to retrieval and blocking objectionable content. In this paper, we investigate and evaluate (1) the effect of color space transformation on skin detection performance and finding the appropriate color space for skin detection, (2) the role of the illuminance component of a color space, (3) the appropriate pixel based skin color modeling technique and finally, (4) the effect of color constancy algorithms on color based skin classification. The comprehensive color space and skin color modeling evaluation will help in the selection of the best combinations for skin detection. Nine skin modeling approaches (AdaBoost, Bayesian network, J48, Multilayer Perceptron, Naive Bayesian, Random Forest, RBF network, SVM and the histogram approach of Jones and Rehg (2002)) in six color spaces (IHLS, HSI, RGB, normalized RGB, YCbCr and CIELAB) with the presence or absence of the illuminance component are compared and evaluated. Moreover, the impact of five color constancy algorithms on skin detection is reported. Results on a database of 8991 images with manually annotated pixel-level ground truth show that (1) the cylindrical color spaces outperform other color spaces, (2) the absence of the illuminance component decreases performance, (3) the selection of an appropriate skin color modeling approach is important and that the tree based classifiers (Random forest, J48) are well suited to pixel based skin detection. As a best combination, the Random Forest combined with the cylindrical color spaces, while keeping the illuminance component outperforms other combinations, and (4) the usage of color constancy algorithms can improve skin detection performance.

[1]  Andrew Blake,et al.  Bayesian color constancy revisited , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  G. Buchsbaum.  A spatial processor model for object colour perception , 1980 .

[3]  Ian Craw,et al.  A SOM Based Approach to Skin Detection with Application in Real Time Systems , 2001, BMVC.

[4]  Nicu Sebe,et al.  Skin detection: a Bayesian network approach , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[5]  Abdesselam Bouzerdoum,et al.  Skin segmentation using color pixel classification: analysis and comparison , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  J. Y. Lee,et al.  An Elliptical Boundary Model for Skin Color Detection , 2002 .

[7]  David A. Forsyth,et al.  Finding Naked People , 1996, ECCV.

[8]  Allan Hanbury,et al.  A 3D-Polar Coordinate Colour Representation Well Adapted to Image Analysis , 2003, SCIA.

[9]  Stan Sclaroff,et al.  Skin color-based video segmentation under time-varying illumination , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  King Ngi Ngan,et al.  Locating facial region of a head-and-shoulders color image , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[11]  Jean-Christophe Terrillon,et al.  Comparative Performance of Different Chrominance Spaces for Color Segmentation and Detection of Human Faces in Complex Scene Images , 1999 .

[12]  Jason Brand,et al.  A comparative assessment of three approaches to pixel-level human skin-detection , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[13]  Kin-Man Lam,et al.  A robust scheme for live detection of human faces in color images , 2003, Signal Process. Image Commun..

[14]  A. Ardeshir Goshtasby,et al.  Detecting human faces in color images , 1998, Image Vis. Comput..

[15]  Manolis I. A. Lourakis,et al.  Real-Time Tracking of Multiple Skin-Colored Objects with a Possibly Moving Camera , 2004, ECCV.

[16]  P. Peer,et al.  Human skin color clustering for face detection , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[17]  Julian Stöttinger,et al.  An adaptive multiple model approach for fast content-based skin detection in on-line videos , 2008, AREA '08.

[18]  Hans Jørgen Andersen,et al.  Estimation of the illuminant colour from human skin colour , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[19]  Edward J. Delp,et al.  Optimum color spaces for skin detection , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[20]  Allan Hanbury,et al.  Skin Paths for Contextual Flagging Adult Videos , 2009, ISVC.

[21]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[22]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Nikolaos G. Bourbakis,et al.  A survey of skin-color modeling and detection methods , 2007, Pattern Recognit..

[24]  Joost van de Weijer,et al.  Author Manuscript, Published in "ieee Transactions on Image Processing Edge-based Color Constancy , 2022 .

[25]  Francis Quek,et al.  Comparison of five color models in skin pixel classification , 1999, Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No.PR00378).

[26]  Pau-Choo Chung,et al.  Naked image detection based on adaptive and extensible skin color model , 2007, Pattern Recognit..

[27]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[28]  Alexander H. Waibel,et al.  Skin-Color Modeling and Adaptation , 1998, ACCV.

[29]  Min C. Shin,et al.  Objective evaluation of approaches of skin detection using ROC analysis , 2007, Comput. Vis. Image Underst..

[30]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[31]  Tieniu Tan,et al.  Mixture clustering using multidimensional histograms for skin detection , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[32]  Georgios Tziritas,et al.  Face Detection Using Quantized Skin Color Regions Merging and Wavelet Packet Analysis , 1999, IEEE Trans. Multim..

[33]  Narendra Ahuja,et al.  Gaussian mixture model for human skin color and its applications in image and video databases , 1998, Electronic Imaging.