Skin Detection and Segmentation in Color Images

This chapter presents an overview of existing methods for human skin detection and segmentation. First of all, the skin color modeling schemes are outlined, and their limitations are discussed based on the presented experimental study. Then, we explain the techniques which were reported helpful in improving the efficacy of color-based classification, namely (1) textural features extraction, (2) model adaptation schemes, and (3) spatial analysis of the skin blobs. The chapter presents meaningful qualitative and quantitative results obtained during our study, which demonstrate the benefits of exploiting particular techniques for improving the skin detection outcome.

[1]  David R. Musicant,et al.  Active set support vector regression , 2004, IEEE Transactions on Neural Networks.

[2]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[3]  Chee Seng Chan,et al.  A Fusion Approach for Efficient Human Skin Detection , 2012, IEEE Transactions on Industrial Informatics.

[4]  Ioannis Pitas,et al.  Facial feature extraction in frontal views using biometric analogies , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[5]  Hayit Greenspan,et al.  Mixture model for face-color modeling and segmentation , 2001, Pattern Recognit. Lett..

[6]  Michal Kawulok,et al.  Energy-based blob analysis for improving precision of skin segmentation , 2010, Multimedia Tools and Applications.

[7]  O. G. Kakde,et al.  Skin Color Detection Model Using Neural Networks and its Performance Evaluation , 2010 .

[8]  Michal Kawulok.  Dynamic Skin Detection in Color Images for Sign Language Recognition , 2008, ICISP.

[9]  Ahmed Bouridane,et al.  Skin Detection using a Markov Random Field and a New Color Space , 2006, 2006 International Conference on Image Processing.

[10]  Alaa Y. Taqa,et al.  Increasing the reliability of skin detectors , 2010 .

[11]  Allan Hanbury,et al.  Skin detection: A random forest approach , 2010, 2010 IEEE International Conference on Image Processing.

[12]  Jaecheol Ryou,et al.  Adult Image Detection Using Bayesian Decision Rule Weighted by SVM Probability , 2009, 2009 Fourth International Conference on Computer Sciences and Convergence Information Technology.

[13]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[14]  Shohreh Kasaei,et al.  Skin Detection Using Contourlet-Based Texture Analysis , 2009, 2009 Fourth International Conference on Digital Telecommunications.

[15]  Che Cheng,et al.  Marketing Audit of Chinese Enterprises Based on SVRM and Random Variable Sum Model , 2007, 2007 International Conference on Convergence Information Technology (ICCIT 2007).

[16]  Michal Kawulok.  Texture Analysis for Skin Probability Maps Refinement , 2012, MCPR.

[17]  Greg Schohn,et al.  Less is More: Active Learning with Support Vector Machines , 2000, ICML.

[18]  Maria Pateraki,et al.  Visual tracking of hands, faces and facial features of multiple persons , 2012, Machine Vision and Applications.

[19]  P. Peer,et al.  Human skin color clustering for face detection , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[20]  A. Nowosielski,et al.  Fast and efficient algorithm for face detection in colour images , 2004 .

[21]  Franc Solina,et al.  Eliminating the Influence of Non-Standard Illumination from Images , 2003 .

[22]  Oksam Chae,et al.  Skin Segmentation Using Color Distance Map and Water-Flow Property , 2008, 2008 The Fourth International Conference on Information Assurance and Security.

[23]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[24]  Yue Cao,et al.  Research on a Skin Color Detection Algorithm Based on Self-adaptive Skin Color Model , 2010, 2010 International Conference on Communications and Intelligence Information Security.

[25]  Michal Kawulok,et al.  Discriminative Textural Features for Image and Video Colorization , 2012, IEICE Trans. Inf. Syst..

[26]  Min C. Shin,et al.  Does colorspace transformation make any difference on skin detection? , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[27]  George Awad,et al.  Automatic Skin Segmentation for Gesture Recognition Combining Region and Support Vector Machine Active Learning , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[28]  Hung-Ming Sun,et al.  Skin detection for single images using dynamic skin color modeling , 2010, Pattern Recognit..

[29]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[30]  Kwanghoon Sohn,et al.  An illumination invariant skin-color model for face detection , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[31]  Lijuan Duan,et al.  A Method of Human Skin Region Detection Based on PCNN , 2009, ISNN.

[32]  Xi Xiao,et al.  A Mumford-Shah level-set approach for skin segmentation using a new color space , 2008, 2008 Asia Simulation Conference - 7th International Conference on System Simulation and Scientific Computing.

[33]  Kevin Curran,et al.  A dynamic threshold approach for skin tone detection in colour images , 2012, Int. J. Biom..

[34]  Carlo Gatta,et al.  ACE: An Automatic Color Equalization Algorithm , 2002, CGIV.

[35]  Tieniu Tan,et al.  Skin color detection using multiple cues , 2004, ICPR 2004.

[36]  Shanq-Jang Ruan,et al.  Statistical skin color detection method without color transformation for real-time surveillance systems , 2012, Eng. Appl. Artif. Intell..

[37]  Nikolaos G. Bourbakis,et al.  A survey of skin-color modeling and detection methods , 2007, Pattern Recognit..

[38]  Jakub Nalepa,et al.  Support Vector Machines Training Data Selection Using a Genetic Algorithm , 2012, SSPR/SPR.

[39]  Rini Akmeliawati,et al.  Dynamic approach for real-time skin detection , 2012, Journal of Real-Time Image Processing.

[40]  Junaidi Abdullah,et al.  Adaptive skin color model for hand segmentation , 2010, 2010 International Conference on Computer Applications and Industrial Electronics.

[41]  Ioannis Pitas,et al.  Robust Watermarking of Facial Images Based on Salient Geometric Pattern Matching , 2000, IEEE Trans. Multim..

[42]  Ioannis Pitas,et al.  Face localization and facial feature extraction based on shape and color information , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[43]  Fakhri Alam Khan,et al.  Systematic skin segmentation: merging spatial and non-spatial data , 2012, Multimedia Tools and Applications.

[44]  Kwang-Ting Cheng,et al.  Adaptive learning of an accurate skin-color model , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[45]  Shohreh Kasaei,et al.  A new dynamic cellular learning automata-based skin detector , 2009, Multimedia Systems.

[46]  Abdesselam Bouzerdoum,et al.  Adaptive skin segmentation in color images , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[47]  Edward J. Delp,et al.  Optimum color spaces for skin detection , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[48]  Raimondo Schettini,et al.  Pixel based skin colour classification exploiting explicit skin cluster definition methods , 2005 .

[49]  T. Martin McGinnity,et al.  Chromaticity Space for Illuminant Invariant Recognition , 2012, IEEE Transactions on Image Processing.

[50]  E. Granum,et al.  Skin colour detection under changing lighting conditions , 1999 .

[51]  David A. Forsyth,et al.  Automatic Detection of Human Nudes , 1999, International Journal of Computer Vision.

[52]  Stan Sclaroff,et al.  Skin color-based video segmentation under time-varying illumination , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Marcel J. T. Reinders,et al.  A self-calibrating chrominance model applied to skin color detection , 2007, VISAPP.

[54]  Nikolaos G. Bourbakis,et al.  Image chromatic adaptation using ANNs for skin color adaptation , 2004, 16th IEEE International Conference on Tools with Artificial Intelligence.

[55]  M. Abdullah-Al-Wadud,et al.  Region-of-Interest Selection for Skin Detection Based Applications , 2007, 2007 International Conference on Convergence Information Technology (ICCIT 2007).

[56]  Manolis I. A. Lourakis,et al.  Real-Time Tracking of Multiple Skin-Colored Objects with a Possibly Moving Camera , 2004, ECCV.

[57]  Juan José Pantrigo,et al.  Comparing Color and Texture-Based Algorithms for Human Skin Detection , 2008, ICEIS.

[58]  S. L. Phung,et al.  A novel skin color model in YCbCr color space and its application to human face detection , 2002, Proceedings. International Conference on Image Processing.

[59]  Javier Ruiz-del-Solar,et al.  Skin detection using neighborhood information , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[60]  Graham D. Finlayson,et al.  Color by Correlation: A Simple, Unifying Framework for Color Constancy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[61]  Dante Augusto Couto Barone,et al.  Do mixture models in chromaticity space improve skin detection? , 2003, Pattern Recognit..

[62]  Shigeru Akamatsu,et al.  Automatic detection of human faces in natural scene images by use of a skin color model and of invariant moments , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[63]  Shizhong Jiang,et al.  Skin color detection by illumination estimation and normalization in shadow regions , 2010, The 2010 IEEE International Conference on Information and Automation.

[64]  Allan Hanbury,et al.  Color based skin classification , 2012, Pattern Recognit. Lett..

[65]  Kevin Curran,et al.  A dynamic threshold approach for skin segmentation in color images , 2010, 2010 IEEE International Conference on Image Processing.

[66]  Chi-Man Pun,et al.  Skin Color Segmentation by Texture Feature Extraction and K-mean Clustering , 2011, 2011 Third International Conference on Computational Intelligence, Communication Systems and Networks.

[67]  Michal Kawulok,et al.  Precise multi-level face detector for advanced analysis of facial images , 2012 .

[68]  Min C. Shin,et al.  Objective evaluation of approaches of skin detection using ROC analysis , 2007, Comput. Vis. Image Underst..

[69]  P.H.N. de With,et al.  Improved skin segmentation for TV image enhancement, using color and texture features , 2010, 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE).

[70]  Michal Kawulok,et al.  Fast propagation-based skin regions segmentation in color images , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[71]  Oscar C. Au,et al.  Automatic white balancing using standard deviation of RGB components , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[72]  Hamid Reza Shahbazkia,et al.  Improved Automatic Skin Detection in Color Images , 2003, DICTA.

[73]  Jason Brand,et al.  A comparative assessment of three approaches to pixel-level human skin-detection , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[74]  Mika Laaksonen,et al.  Skin detection in video under changing illumination conditions , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[75]  Bernt Schiele,et al.  Comprehensive Colour Image Normalization , 1998, ECCV.

[76]  Sebastian Lang,et al.  Improving adaptive skin color segmentation by incorporating results from face detection , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[77]  Abdolhossein Sarrafzadeh,et al.  An adaptive real-time skin detector based on Hue thresholding: A comparison on two motion tracking methods , 2006, Pattern Recognit. Lett..

[78]  Franc Solina,et al.  15 seconds of fame - an interactive, computer-vision based art installation , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[79]  B. N Jagadesh.  Skin Colour Segmentation Using Finite Bivariate Pearsonian Type-Iib Mixture Model and K-Means , 2012 .

[80]  Helman Stern,et al.  Adaptive color space switching for face tracking in multi-colored lighting environments , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[81]  Vijayan K. Asari,et al.  Neural network based skin color model for face detection , 2003, 32nd Applied Imagery Pattern Recognition Workshop, 2003. Proceedings..

[82]  Raja Sekhara Rao Kurra,et al.  Similarity of Inference Face Matching On Angle Oriented Face Recognition , 2011 .

[83]  Allan Hanbury,et al.  A 3D-Polar Coordinate Colour Representation Well Adapted to Image Analysis , 2003, SCIA.

[84]  Wen Gao,et al.  An adaptive skin color detection algorithm with confusing backgrounds elimination , 2005, IEEE International Conference on Image Processing 2005.

[85]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[86]  Narendra Ahuja,et al.  Gaussian mixture model for human skin color and its applications in image and video databases , 1998, Electronic Imaging.

[87]  Xiaohua Wang,et al.  Skin color detection under complex background , 2011, 2011 International Conference on Mechatronic Science, Electric Engineering and Computer (MEC).

[88]  David A. Clausi,et al.  A fast method to determine co-occurrence texture features , 1998, IEEE Trans. Geosci. Remote. Sens..

[89]  Wei Jiang,et al.  Skin Detection Using Color, Texture and Space Information , 2007, Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007).

[90]  Abdesselam Bouzerdoum,et al.  Skin segmentation using color pixel classification: analysis and comparison , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[91]  Ming-Chieh Chi,et al.  ROI video coding based on H.263+ with robust skin-color detection technique , 2003, IEEE Trans. Consumer Electron..

[92]  Kevin Curran,et al.  A skin tone detection algorithm for an adaptive approach to steganography , 2009, Signal Process..

[93]  Francis Quek,et al.  Comparison of five color models in skin pixel classification , 1999, Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No.PR00378).

[94]  Pau-Choo Chung,et al.  Naked image detection based on adaptive and extensible skin color model , 2007, Pattern Recognit..

[95]  Kwang-Ting Cheng,et al.  An adaptive skin model and its application to objectionable image filtering , 2004, MULTIMEDIA '04.

[96]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[97]  Bernt Schiele,et al.  Skin Patch Detection in Real-World Images , 2002, DAGM-Symposium.