Face Detection Based on Skin Color Segmentation Using Fuzzy Entropy

Face detection is the first step of any automated face recognition system. One of the most popular approaches to detect faces in color images is using a skin color segmentation scheme, which in many cases needs a proper representation of color spaces to interpret image information. In this paper, we propose a fuzzy system for detecting skin in color images, so that each color tone is assumed to be a fuzzy set. The Red, Green, and Blue (RGB), the Hue, Saturation and Value (HSV), and the YCbCr (where Y is the luminance and Cb,Cr are the chroma components) color systems are used for the development of our fuzzy design. Thus, a fuzzy three-partition entropy approach is used to calculate all of the parameters needed for the fuzzy systems, and then, a face detection method is also developed to validate the segmentation results. The results of the experiments show a correct skin detection rate between 94% and 96% for our fuzzy segmentation methods, with a false positive rate of about 0.5% in all cases. Furthermore, the average correct face detection rate is above 93%, and even when working with heterogeneous backgrounds and different light conditions, it achieves almost 88% correct detections. Thus, our method leads to accurate face detection results with low false positive and false negative rates.

[1]  W. Kelly,et al.  Screening for Objectionable Images: A Review of Skin Detection Techniques , 2008, 2008 International Machine Vision and Image Processing Conference.

[2]  Chih-Lyang Hwang,et al.  The Segmentation of Different Skin Colors Using the Combination of Graph Cuts and Probability Neural Network , 2011, IWANN.

[3]  Abdesselam Bouzerdoum,et al.  A universal and robust human skin color model using neural networks , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[4]  Narendra Ahuja,et al.  Gaussian mixture model for human skin color and its applications in image and video databases , 1998, Electronic Imaging.

[5]  Smriti Srivastava,et al.  Face Detection Using Fuzzy Logic and Skin Color Segmentation in Images , 2010, 2010 3rd International Conference on Emerging Trends in Engineering and Technology.

[6]  Edward J. Delp,et al.  Optimum color spaces for skin detection , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[7]  H. D. Cheng,et al.  Threshold selection based on fuzzy c-partition entropy approach , 1998, Pattern Recognit..

[8]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[9]  Anasua Sarkar,et al.  Shannon entropy based fuzzy distance norm for pixel classification in remote sensing imagery , 2015, Proceedings of the 2015 Third International Conference on Computer, Communication, Control and Information Technology (C3IT).

[10]  Yousra Ben Jemaa,et al.  FUZZY CLASSIFICATION, IMAGE SEGMENTATION AND SHAPE ANALYSIS FOR HUMAN FACE DETECTION , 2006, 2006 8th international Conference on Signal Processing.

[11]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[12]  Wu-Chih Hu,et al.  Learning-based Face Detection by Adaptive Switching of Skin Color Models and AdaBoost under Varying Illumination , 2011, J. Inf. Hiding Multim. Signal Process..

[13]  Jie Huang,et al.  Skin detection method based on cascaded AdaBoost classifier , 2012 .

[14]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Sos S. Agaian,et al.  Local Shannon entropy measure with statistical tests for image randomness , 2013, Inf. Sci..

[16]  Tieniu Tan,et al.  Skin color detection using multiple cues , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[17]  Gang Hua,et al.  A convolutional neural network cascade for face detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  N. A. Abdul Rahim,et al.  RGB-H-CbCr skin colour model for human face detection , 2006 .

[19]  Karim Faez,et al.  Fuzzy Classification of Human Skin Color in Color Images , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[20]  Qiang Ji,et al.  A Bayesian Network Model for Automatic and Interactive Image Segmentation , 2011, IEEE Transactions on Image Processing.

[21]  G. Balakrishnan,et al.  Comparative Study for Two Color Spaces HSCbCr and YCbCr in Skin Color Detection , 2012 .

[22]  Weixing Wang,et al.  Efficient multilevel image segmentation through fuzzy entropy maximization and graph cut optimization , 2014, Pattern Recognit..

[23]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[24]  Allan Hanbury,et al.  Color based skin classification , 2012, Pattern Recognit. Lett..

[25]  Jue Jiang,et al.  Skin color enhancement based on favorite skin color in HSV color space , 2010, IEEE Transactions on Consumer Electronics.

[26]  P. Peer,et al.  Human skin color clustering for face detection , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[27]  Shahrel Azmin Suandi,et al.  Fusion of Multi Color Space for Human Skin Region Segmentation , 2013 .

[28]  Ali Selamat,et al.  Fuzzy Mamdani Inference System Skin Detection , 2009, 2009 Ninth International Conference on Hybrid Intelligent Systems.

[29]  Preeti R. Bajaj,et al.  Active Facial Tracking , 2010, 2010 3rd International Conference on Emerging Trends in Engineering and Technology.

[30]  Ankit Kumar,et al.  Auto-segmentation using mean-shift and entropy analysis , 2016, 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom).

[31]  C. A. Murthy,et al.  Fuzzy thresholding: mathematical framework, bound functions and weighted moving average technique , 1990, Pattern Recognit. Lett..

[32]  Hamid Reza Shahbazkia,et al.  Improved Automatic Skin Detection in Color Images , 2003, DICTA.

[33]  Richard B. Reilly,et al.  VALID: A New Practical Audio-Visual Database, and Comparative Results , 2005, AVBPA.

[34]  Qiong Liu,et al.  A robust skin color based face detection algorithm , 2010, 2010 2nd International Asia Conference on Informatics in Control, Automation and Robotics (CAR 2010).

[35]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[36]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[37]  Francisco Herrera,et al.  A model based on linguistic 2-tuples for dealing with multigranular hierarchical linguistic contexts in multi-expert decision-making , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[38]  Zhengyou Zhang,et al.  A Survey of Recent Advances in Face Detection , 2010 .

[39]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  John S. D. Mason,et al.  Enhancing face detection in colour images using a skin probability map , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[41]  Hung-Ming Sun,et al.  Skin detection for single images using dynamic skin color modeling , 2010, Pattern Recognit..

[42]  Nikolaos G. Bourbakis,et al.  A survey of skin-color modeling and detection methods , 2007, Pattern Recognit..

[43]  Michael Beetz,et al.  A Person and Context Specific Approach for Skin Color Classification , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[44]  Arne Leijon,et al.  Bayesian Estimation of Beta Mixture Models with Variational Inference , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  B. Jedynak,et al.  Blocking Adult Images Based on Statistical Skin Detection , 2004 .

[46]  S. Shirali-Shahreza,et al.  A New Bayesian Classifier for Skin Detection , 2008, 2008 3rd International Conference on Innovative Computing Information and Control.

[47]  Osama A. Omer,et al.  A two-dimensional image segmentation method based on genetic algorithm and entropy , 2017 .

[48]  Shih-Han Chen,et al.  Skin-color correction method based on hue template mapping for wide color gamut liquid crystal display devices , 2011 .

[49]  Mohammad Saber Iraji,et al.  Skin Color Segmentation in YCBCR Color Space with Adaptive Fuzzy Neural Network (Anfis) , 2012 .

[50]  Jiri Matas,et al.  XM2VTSDB: The Extended M2VTS Database , 1999 .

[51]  Herman Akdag,et al.  A symbolic approach for colorimetric alterations , 2001, EUSFLAT Conf..

[52]  Luigi di Stefano,et al.  A simple and efficient connected components labeling algorithm , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[53]  Xiong Zhang,et al.  A Real-Time Hand Detection System during Hand over Face Occlusion , 2015, MUE 2015.