A survey of skin-color modeling and detection methods

Skin detection plays an important role in a wide range of image processing applications ranging from face detection, face tracking, gesture analysis, content-based image retrieval systems and to various human computer interaction domains. Recently, skin detection methodologies based on skin-color information as a cue has gained much attention as skin-color provides computationally effective yet, robust information against rotations, scaling and partial occlusions. Skin detection using color information can be a challenging task as the skin appearance in images is affected by various factors such as illumination, background, camera characteristics, and ethnicity. Numerous techniques are presented in literature for skin detection using color. In this paper, we provide a critical up-to-date review of the various skin modeling and classification strategies based on color information in the visual spectrum. The review is divided into three different categories: first, we present the various color spaces used for skin modeling and detection. Second, we present different skin modeling and classification approaches. However, many of these works are limited in performance due to real-world conditions such as illumination and viewing conditions. To cope up with the rapidly changing illumination conditions, illumination adaptation techniques are applied along with skin-color detection. Third, we present various approaches that use skin-color constancy and dynamic adaptation techniques to improve the skin detection performance in dynamically changing illumination and environmental conditions. Wherever available, we also indicate the various factors under which the skin detection techniques perform well.

[1]  Kwang-Ting Cheng,et al.  Adaptive learning of an accurate skin-color model , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[2]  Edward J. Delp,et al.  Optimum color spaces for skin detection , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[3]  Matti Pietikäinen,et al.  Detection of skin color under changing illumination: a comparative study , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[4]  G. Buchsbaum A spatial processor model for object colour perception , 1980 .

[5]  Shigeru Akamatsu,et al.  Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[6]  Georgios Tziritas,et al.  Face Detection Using Quantized Skin Color Regions Merging and Wavelet Packet Analysis , 1999, IEEE Trans. Multim..

[7]  Ahmed M. Elgammal,et al.  Skin Detection , 2009, Encyclopedia of Biometrics.

[8]  J. Y. Lee,et al.  An Elliptical Boundary Model for Skin Color Detection , 2002 .

[9]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[10]  Uday B. Desai,et al.  Finding faces in color images using wavelet transform , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[11]  Masahide Kaneko,et al.  Skin-color extraction in images with complex background and varying illumination , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[12]  Seong G. Kong,et al.  Recent advances in visual and infrared face recognition - a review , 2005, Comput. Vis. Image Underst..

[13]  J. Ohya,et al.  Automatic skin-color distribution extraction for face detection and tracking , 2000, WCC 2000 - ICSP 2000. 2000 5th International Conference on Signal Processing Proceedings. 16th World Computer Congress 2000.

[14]  Nikolaos G. Bourbakis,et al.  Image chromatic adaptation using ANNs for skin color adaptation , 2004, 16th IEEE International Conference on Tools with Artificial Intelligence.

[15]  Dante Augusto Couto Barone,et al.  Do mixture models in chromaticity space improve skin detection? , 2003, Pattern Recognit..

[16]  Qian Chen,et al.  Face Detection From Color Images Using a Fuzzy Pattern Matching Method , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  William R. Mathew,et al.  Color as a Science , 2005 .

[18]  King Ngi Ngan,et al.  Locating facial region of a head-and-shoulders color image , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[19]  D H Brainard,et al.  Bayesian color constancy. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  Linda G. Shapiro,et al.  A flexible image database system for content-based retrieval , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[21]  Jason Brand,et al.  A comparative assessment of three approaches to pixel-level human skin-detection , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[22]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[23]  A. Martínez,et al.  The AR face databasae , 1998 .

[24]  Richard A. Foulds,et al.  Toward robust skin identification in video images , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[25]  Kin-Man Lam,et al.  A novel approach for human face detection from color images under complex background , 2001, Pattern Recognition.

[26]  Sethuraman Panchanathan,et al.  iCare - a user centric approach to the development of assistive devices for the blind and visually impaired , 2003, Proceedings. 15th IEEE International Conference on Tools with Artificial Intelligence.

[27]  Jian-Gang Wang,et al.  Frontal-view face detection and facial feature extraction using color and morphological operations , 1999, Pattern Recognit. Lett..

[28]  Hayit Greenspan,et al.  Mixture model for face-color modeling and segmentation , 2001, Pattern Recognit. Lett..

[29]  Tieniu Tan,et al.  Mixture clustering using multidimensional histograms for skin detection , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[30]  James L. Crowley,et al.  Robust face tracking using color , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[31]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[32]  S. David,et al.  Human Face Detection and Tracking using Skin Color Modeling and Connected Component Operators , 2002 .

[33]  Shaogang Gong,et al.  Modelling facial colour and identity with Gaussian mixtures , 1998, Pattern Recognit..

[34]  D H Brainard,et al.  Analysis of the retinex theory of color vision. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[35]  Hans Jørgen Andersen,et al.  Tracking regions of human skin through illumination changes , 2003, Pattern Recognit. Lett..

[36]  Andrea Salgian,et al.  Face recognition with visible and thermal infrared imagery , 2003, Comput. Vis. Image Underst..

[37]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[38]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Ioannis Pitas,et al.  A novel method for automatic face segmentation, facial feature extraction and tracking , 1998, Signal Process. Image Commun..

[40]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[41]  Dante Augusto Couto Barone,et al.  A probabilistic model for the human skin color , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[42]  Mika Laaksonen,et al.  Adaptive skin color modeling using the skin locus for selecting training pixels , 2003, Pattern Recognit..

[43]  A Probabilistic Neural Network for Human Face Identification based on Fuzzy Logic Chromatic Rules , .

[44]  Wen Gao,et al.  Face detection and location based on skin chrominance and lip chrominance transformation from color images , 2001, Pattern Recognit..

[45]  Min C. Shin,et al.  Effect of colorspace transformation, the illuminance component, and color modeling on skin detection , 2004, CVPR 2004.

[46]  King Ngi Ngan,et al.  Face segmentation using skin-color map in videophone applications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[47]  A. Ardeshir Goshtasby,et al.  Detecting human faces in color images , 1998, Image Vis. Comput..

[48]  Alfredo Gardel Vicente,et al.  Unsupervised and adaptive Gaussian skin-color model , 2000, Image Vis. Comput..

[49]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[50]  Ian Craw,et al.  A SOM Based Approach to Skin Detection with Application in Real Time Systems , 2001, BMVC.

[51]  Vlad C. Cardei,et al.  A neural network approach to colour constancy , 2000 .

[52]  Samy Bengio,et al.  Improving face verification using skin color information , 2002, Object recognition supported by user interaction for service robots.

[53]  Verónica Vilaplana,et al.  A morphological approach for segmentation and tracking of human faces , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[54]  Werasak Kurutach,et al.  A new robust face detection in color images , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[55]  Narendra Ahuja,et al.  Gaussian mixture model for human skin color and its applications in image and video databases , 1998, Electronic Imaging.

[56]  Subhasis Chaudhuri,et al.  Self-induced color correction for skin tracking under varying illumination , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[57]  Alexander H. Waibel,et al.  Segmenting hands of arbitrary color , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[58]  Tae-Woong Yoo,et al.  A fast algorithm for tracking human faces based on chromatic histograms , 1999, Pattern Recognit. Lett..

[59]  Hichem Sahbi,et al.  Coarse to Fine Face Detection Based on Skin Color Adaption , 2002, Biometric Authentication.

[60]  Graham D. Finlayson,et al.  Improving gamut mapping color constancy , 2000, IEEE Trans. Image Process..

[61]  Brian V. Funt,et al.  A comparison of computational color constancy algorithms. I: Methodology and experiments with synthesized data , 2002, IEEE Trans. Image Process..

[62]  Narciso García,et al.  Face detection based on a new color space YCgCr , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[63]  A. Bouzerdoum,et al.  A Bayesian approach to skin color classification in YCbCr color space , 2000, 2000 TENCON Proceedings. Intelligent Systems and Technologies for the New Millennium (Cat. No.00CH37119).

[64]  Stan Sclaroff,et al.  Skin color-based video segmentation under time-varying illumination , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Kin-Man Lam,et al.  A robust scheme for live detection of human faces in color images , 2003, Signal Process. Image Commun..

[66]  Min C. Shin,et al.  Does colorspace transformation make any difference on skin detection? , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[67]  Bruce J. Tromberg,et al.  Face Recognition in Hyperspectral Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Brian V. Funt,et al.  A comparison of computational color constancy Algorithms. II. Experiments with image data , 2002, IEEE Trans. Image Process..

[69]  Elli Angelopoulou,et al.  Multispectral skin color modeling , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[70]  C. Balas,et al.  An imaging colorimeter for noncontact tissue color mapping , 1997, IEEE Transactions on Biomedical Engineering.

[71]  Alex Pentland,et al.  LAFTER: lips and face real time tracker , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[72]  Hamid Reza Shahbazkia,et al.  Fast and accurate skin segmentation in color images , 2004, First Canadian Conference on Computer and Robot Vision, 2004. Proceedings..

[73]  Nikolaos G. Bourbakis,et al.  An intelligent assistant for navigation of visually impaired people , 2001, Proceedings 2nd Annual IEEE International Symposium on Bioinformatics and Bioengineering (BIBE 2001).

[74]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[75]  Alexander H. Waibel,et al.  A real-time face tracker , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[76]  Nicu Sebe,et al.  Skin detection: a Bayesian network approach , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[77]  David G. Stork,et al.  Pattern Classification , 1973 .

[78]  Ying Dai,et al.  Face-texture model based on SGLD and its application in face detection in a color scene , 1996, Pattern Recognit..

[79]  Huicheng Zheng,et al.  Statistical Models for Skin Detection , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[80]  C. Chen,et al.  Detection of human faces in colour images , 1997 .

[81]  Helge J. Ritter,et al.  Adaptive color segmentation-a comparison of neural and statistical methods , 1997, IEEE Trans. Neural Networks.

[82]  Matti Pietikäinen,et al.  Physics-based face database for color research , 2000, J. Electronic Imaging.

[83]  E. Morales,et al.  Automatic Feature Construction and a Simple Rule Induction Algorithm for Skin Detection , 2002 .

[84]  Vijayan K. Asari,et al.  Neural network based skin color model for face detection , 2003, 32nd Applied Imagery Pattern Recognition Workshop, 2003. Proceedings..

[85]  Abdesselam Bouzerdoum,et al.  Skin segmentation using color pixel classification: analysis and comparison , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[86]  Eli Saber,et al.  Frontal-view face detection and facial feature extraction using color, shape and symmetry based cost functions , 1998, Pattern Recognit. Lett..

[87]  David A. Forsyth,et al.  Finding Naked People , 1996, ECCV.

[88]  Ki-Sang Hong,et al.  Adaptive skin-color filter , 2001, Pattern Recognit..

[89]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[90]  Abdesselam Bouzerdoum,et al.  A universal and robust human skin color model using neural networks , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[91]  Shigeru Akamatsu,et al.  Detection of human faces in complex scene images by use of a skin color model and of invariant Fourier-Mellin moments , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[92]  Ioannis Pitas,et al.  Extraction of facial regions and features using color and shape information , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[93]  Francis Quek,et al.  Comparison of five color models in skin pixel classification , 1999, Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No.PR00378).

[94]  Huicheng Zheng,et al.  From Maximum Entropy to Belief Propagation: An application to Skin Detection , 2004, BMVC.

[95]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[96]  Alexander H. Waibel,et al.  Skin-Color Modeling and Adaptation , 1998, ACCV.

[97]  P. Peer,et al.  Human skin color clustering for face detection , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[98]  Dante Augusto Couto Barone,et al.  Performance evaluation of single and multiple-Gaussian models for skin color modeling , 2002, Proceedings. XV Brazilian Symposium on Computer Graphics and Image Processing.

[99]  David A. Forsyth,et al.  A novel algorithm for color constancy , 1990, International Journal of Computer Vision.

[100]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[101]  Sang Chul Ahn,et al.  Object oriented face detection using range and color information , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[102]  Luis Enrique Sucar,et al.  On Selecting an Appropriate Colour Space for Skin Detection , 2002, MICAI.