Skin color modeling for face detection and segmentation: a review and a new approach

Detecting skin-colored pixels, although seems a straightforward easy task, has proven to be quite a challenging task in images that are captured under complex unconstrained imaging conditions. Color segmentation is an important method of segmenting the body in images. In this paper, we first provides a review of skin color modeling research works for face detection. In particular, we focus on discussing the challenges of skin color modeling, detection, and segmentation, and then we present the skin color modeling and region-based skin segmentation. We also propose a new approach to analyze the hue characteristics of monitoring personnel in coal mine. We determine the skin color boundaries of the miners using the boundary detection method based on the response of visual hue. And then, we apply to determining hue area method using dual hue detector to segment skin color for miners. Experiments show that the method has excellent ability to segment skin regions of miners. We also summarize the most widely used methods for skin detection approaches and collecting their numerical evaluation results.

[1]  Tao Xu,et al.  Pixel-wise skin colour detection based on flexible neural tree , 2013, IET Image Process..

[2]  Abdesselam Bouzerdoum,et al.  Skin segmentation using color and edge information , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[3]  Ki-Sang Hong,et al.  Adaptive skin-color filter , 2001, Pattern Recognit..

[4]  Zaher Al Aghbari,et al.  Hill-manipulation: An effective algorithm for color image segmentation , 2006, Image Vis. Comput..

[5]  Abdesselam Bouzerdoum,et al.  A universal and robust human skin color model using neural networks , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[6]  John C. Russ,et al.  Image Processing Handbook, Fourth Edition , 2002 .

[7]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[8]  Stan Sclaroff,et al.  Estimation and prediction of evolving color distributions for skin segmentation under varying illumination , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[9]  Abdesselam Bouzerdoum,et al.  A Bayesian skin/non-skin color classifier using non-parametric density estimation , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[10]  S. Pizer,et al.  The Image Processing Handbook , 1994 .

[11]  Nicu Sebe,et al.  Skin detection: a Bayesian network approach , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[12]  Franc Solina,et al.  An Automatic Human Face Detection Method , 1999 .

[13]  William K. Pratt,et al.  Digital Image Processing: PIKS Inside , 2001 .

[14]  Alaa Y. Taqa,et al.  Increasing the reliability of skin detectors , 2010 .

[15]  Wei Chen,et al.  Face detection based on half face-template , 2009, 2009 9th International Conference on Electronic Measurement & Instruments.

[16]  Roziati Zainuddin,et al.  Skin segmentation based on multi pixel color clustering models , 2012, Digit. Signal Process..

[17]  Sung-Il Chien,et al.  Skin Color Detection through Estimation and Conversion of Illuminant Color Under Various Illuminations , 2007, IEEE Transactions on Consumer Electronics.

[18]  Zhi Liu,et al.  An efficient face segmentation algorithm based on binary partition tree , 2005, Signal Process. Image Commun..

[19]  Wei Chen,et al.  Agglomerative clustering using improved rough sets and its applications in cooperative object localization , 2013, Comput. Electr. Eng..

[20]  Yongjie Li,et al.  Efficient Color Boundary Detection with Color-Opponent Mechanisms , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  S. L. Eddins,et al.  Digital Image Processing Using MATLAB: AND Mathworks, MATLAB Sim SV 07 , 2007 .

[22]  Luis Enrique Sucar,et al.  On Selecting an Appropriate Colour Space for Skin Detection , 2002, MICAI.

[23]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[24]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[26]  Ioannis Pitas,et al.  A novel method for automatic face segmentation, facial feature extraction and tracking , 1998, Signal Process. Image Commun..

[27]  Francis Quek,et al.  Comparison of five color models in skin pixel classification , 1999, Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No.PR00378).

[28]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[29]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Ian Craw,et al.  A SOM Based Approach to Skin Detection with Application in Real Time Systems , 2001, BMVC.

[31]  Roziati Zainuddin,et al.  Human Face Detection in Color Images , 2004, Adv. Complex Syst..

[32]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[33]  Li Wang,et al.  Face Location in Dim-Lightening Coal Mine Surveillance Images , 2009, 2009 2nd International Congress on Image and Signal Processing.

[34]  Liyanage C. De Silva,et al.  Multimodal Approach to Human-Face Detection and Tracking , 2008, IEEE Transactions on Industrial Electronics.

[35]  Peter Peer,et al.  an interactive, computer-vision based art installation , 2002 .

[36]  Edward M. Riseman,et al.  TextFinder: An Automatic System to Detect and Recognize Text In Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Giovani Gómez.  On selecting colour components for skin detection , 2002, Object recognition supported by user interaction for service robots.

[38]  Raimondo Schettini,et al.  Internet imaging VII , 2006 .

[39]  Jakub Nalepa,et al.  Spatial-based skin detection using discriminative skin-presence features , 2014, Pattern Recognit. Lett..

[40]  Moritz Stoerring,et al.  Computer vision and human skin colour , 2004 .

[41]  Mika Laaksonen,et al.  Adaptive skin color modeling using the skin locus for selecting training pixels , 2003, Pattern Recognit..

[42]  David R. Bull,et al.  Projective image restoration using sparsity regularization , 2013, 2013 IEEE International Conference on Image Processing.

[43]  King Ngi Ngan,et al.  Face segmentation using skin-color map in videophone applications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[44]  A. Ardeshir Goshtasby,et al.  Detecting human faces in color images , 1998, Image Vis. Comput..

[45]  Chiho Kim,et al.  Color segmentation robust to brightness variations by using B-spline curve modeling , 2008, Pattern Recognit..

[46]  Yizhen Huang,et al.  Super-resolution using neural networks based on the optimal recovery theory , 2006, 2006 16th IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing.

[47]  Georgios Tziritas,et al.  Face Detection Using Quantized Skin Color Regions Merging and Wavelet Packet Analysis , 1999, IEEE Trans. Multim..

[48]  Raimondo Schettini,et al.  Skin segmentation using multiple thresholding , 2006, Electronic Imaging.

[49]  Wei-Che Chen,et al.  Region-Based and Content Adaptive Skin Detection in Color Images , 2007, Int. J. Pattern Recognit. Artif. Intell..

[50]  Narendra Ahuja,et al.  Hand gesture recognition and face detection in images , 2000 .

[51]  Chia-Feng Juang,et al.  Using self-organizing fuzzy network with support vector learning for face detection in color images , 2008, Neurocomputing.

[52]  Franc Solina,et al.  15 seconds of fame - an interactive, computer-vision based art installation , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[53]  Thomas B. Moeslund,et al.  Long-Term Occupancy Analysis Using Graph-Based Optimisation in Thermal Imagery , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[54]  Shigeru Akamatsu,et al.  Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[55]  Manolis I. A. Lourakis,et al.  Real-Time Tracking of Multiple Skin-Colored Objects with a Possibly Moving Camera , 2004, ECCV.

[56]  Patrick Shen-Pei Wang,et al.  Extracting Faces and Facial Features from Color Images , 2008, Int. J. Pattern Recognit. Artif. Intell..

[57]  Kevin Curran,et al.  A dynamic threshold approach for skin segmentation in color images , 2010, 2010 IEEE International Conference on Image Processing.

[58]  Ming Li,et al.  A new image co-segmentation method using saliency detection for surveillance image of coal miners , 2014, Comput. Electr. Eng..

[59]  Kin-Man Lam,et al.  A novel approach for human face detection from color images under complex background , 2001, Pattern Recognition.

[60]  Arne Leijon,et al.  Human skin color detection in RGB space with Bayesian estimation of beta mixture models , 2010, 2010 18th European Signal Processing Conference.

[61]  J. Y. Lee,et al.  An Elliptical Boundary Model for Skin Color Detection , 2002 .

[62]  Yizhen Huang,et al.  Image Based Source Camera Identification using Demosaicking , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[63]  Volkan Atalay,et al.  Projection based method for segmentation of human face and its evaluation , 2002, Pattern Recognit. Lett..

[64]  Jin Bae Park,et al.  New Fuzzy Skin Model for Face Detection , 2005, Australian Conference on Artificial Intelligence.

[65]  Nikolaos G. Bourbakis,et al.  A survey of skin-color modeling and detection methods , 2007, Pattern Recognit..

[66]  Chiho Kim,et al.  Color Segmentation Robust to Brightness Variations by Using B-spline Curve Modeling , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[67]  S. Amirhassan Monadjemi,et al.  A novel fuzzy rule base system for pose independent faces detection , 2011, Appl. Soft Comput..

[68]  Mika Laaksonen,et al.  Skin detection in video under changing illumination conditions , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[69]  Qian Chen,et al.  Face Detection From Color Images Using a Fuzzy Pattern Matching Method , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[70]  Allan Hanbury,et al.  Color based skin classification , 2012, Pattern Recognit. Lett..

[71]  Junwei Han,et al.  Automatic skin segmentation and tracking in sign language recognition , 2009 .

[72]  Chee Seng Chan,et al.  A Fusion Approach for Efficient Human Skin Detection , 2012, IEEE Transactions on Industrial Informatics.

[73]  Isaac Cohen,et al.  Target tracking with incomplete detection , 2009, Comput. Vis. Image Underst..

[74]  Abdesselam Bouzerdoum,et al.  Skin segmentation using color pixel classification: analysis and comparison , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[75]  Jianping Fan,et al.  A robust incremental learning framework for accurate skin region segmentation in color images , 2007, Pattern Recognit..

[76]  Vijayan K. Asari,et al.  Neural network based skin color model for face detection , 2003, 32nd Applied Imagery Pattern Recognition Workshop, 2003. Proceedings..