Skin Color in Face Analysis

This chapter deals with the role of color in facial image analysis such as face detection and recognition. First, we introduce the use of color information in computer vision in general and in the field of facial image analysis in particular. Then, we give an introduction to color formation and discuss the effect of illumination on color appearance, and its consequences. The skin data can come from different sources like real faces, photos or print. Separating the sources of skin data is presented, and skin color modeling is discussed. We also review the use of color in face detection, while the contribution of color to face recognition is covered.

[1]  Ioannis Pitas,et al.  Face localization and facial feature extraction based on shape and color information , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[2]  K. Plataniotis,et al.  Color Image Processing : Methods and Applications , 2006 .

[3]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Shaogang Gong,et al.  Tracking and segmenting people in varying lighting conditions using colour , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[5]  Chengjun Liu,et al.  Robust Face Recognition Using Color Information , 2009, ICB.

[6]  E. A. Edwards,et al.  The pigments and color of living human skin , 1939 .

[7]  Jouglas Alves Tomaschitz,et al.  Skin Detection Applied to Multi-Racial Images , 2009, 2009 16th International Conference on Systems, Signals and Image Processing.

[8]  Elli Angelopoulou,et al.  Multispectral skin color modeling , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Hung-Ming Sun,et al.  Skin detection for single images using dynamic skin color modeling , 2010, Pattern Recognit..

[10]  Nikolaos G. Bourbakis,et al.  A survey of skin-color modeling and detection methods , 2007, Pattern Recognit..

[11]  Narendra Ahuja,et al.  Detecting human faces in color images , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[12]  Chi-Ho Chan.  Multi-scale local Binary Pattern Histogram for Face Recognition , 2007, ICB.

[13]  Matti Pietikäinen,et al.  A Hybrid Approach to Face Detection under Unconstrained Environments , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[14]  Sung-Il Chien,et al.  Skin Color Detection through Estimation and Conversion of Illuminant Color using Sclera Region of Eye under Varying Illumination , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[15]  P. Sinha,et al.  Contribution of Color to Face Recognition , 2002, Perception.

[16]  Chengjun Liu,et al.  Learning the Uncorrelated, Independent, and Discriminating Color Spaces for Face Recognition , 2008, IEEE Transactions on Information Forensics and Security.

[17]  Seiji Inokuchi,et al.  Simulation and analysis of spectral distributions of human skin , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[18]  Jussi Parkkinen,et al.  Near-infrared images of skin , 2008, CGIV/MCS.

[19]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Yong Man Ro,et al.  Color Face Recognition for Degraded Face Images , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Chengjun Liu,et al.  Fusion of the complementary Discrete Cosine Features in the YIQ color space for face recognition , 2008, Comput. Vis. Image Underst..

[22]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[23]  Seongbeak Yoon,et al.  Masked fake face detection using radiance measurements. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[24]  Hans Jørgen Andersen,et al.  Physics-based modelling of human skin colour under mixed illuminants , 2001, Robotics Auton. Syst..

[25]  Chengjun Liu,et al.  Color Image Discriminant Models and Algorithms for Face Recognition , 2008, IEEE Transactions on Neural Networks.

[26]  Luis Torres,et al.  The importance of the color information in face recognition , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[27]  L. Harwood,et al.  A Chrominance Demodulator IC with Dynamic Flesh Correction , 1976, IEEE Transactions on Consumer Electronics.

[28]  Matti Pietikäinen,et al.  Physics-based face database for color research , 2000, J. Electronic Imaging.

[29]  Ki-Sang Hong,et al.  Adaptive skin-color filter , 2001, Pattern Recognit..

[30]  Jianping Fan,et al.  A robust incremental learning framework for accurate skin region segmentation in color images , 2007, Pattern Recognit..

[31]  Gunther Wyszecki,et al.  Color Science: Concepts and Methods, Quantitative Data and Formulae, 2nd Edition , 2000 .

[32]  Norimichi Tsumura,et al.  Principal Component Analysis of Skin Color and Its Application to Colorimetric Color Reproduction on CRT Display and Hardcopy , 1996, Journal of Imaging Science and Technology.

[33]  R Kemp,et al.  Perception and Recognition of Normal and Negative Faces: The Role of Shape from Shading and Pigmentation Cues , 1996, Perception.

[34]  Georgios Tziritas,et al.  Face Detection Using Quantized Skin Color Regions Merging and Wavelet Packet Analysis , 1999, IEEE Trans. Multim..

[35]  Tae-Woong Yoo,et al.  A fast algorithm for tracking human faces based on chromatic histograms , 1999, Pattern Recognit. Lett..

[36]  Matti Pietikäinen,et al.  Facial Skin Color Modeling , 2005 .

[37]  Jagath C. Rajapakse,et al.  Color channel encoding with NMF for face recognition , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[38]  Matti Pietikäinen,et al.  Color-based face detection using skin locus model and hierarchical filtering , 2002, Object recognition supported by user interaction for service robots.

[39]  Anil K. Jain,et al.  Handbook of Face Recognition, 2nd Edition , 2011 .

[40]  Brian V. Funt,et al.  Is Machine Colour Constancy Good Enough? , 1998, ECCV.

[41]  Richard B. Reilly,et al.  A colour face image database for benchmarking of automatic face detection algorithms , 2003, Proceedings EC-VIP-MC 2003. 4th EURASIP Conference focused on Video/Image Processing and Multimedia Communications (IEEE Cat. No.03EX667).

[42]  Chengjun Liu,et al.  Color space normalization: Enhancing the discriminating power of color spaces for face recognition , 2010, Pattern Recognit..

[43]  Yeong-Ho Ha,et al.  Automatic flesh tone reappearance for color enhancement in TV , 1997 .

[44]  Matti Pietikäinen,et al.  Comparison of skin color detection and tracking methods under varying illumination , 2005, J. Electronic Imaging.

[45]  Shigeru Akamatsu,et al.  Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[46]  Graham D. Finlayson,et al.  Designing a Simple 3-Channel Camera for Skin Detection , 2004, Color Imaging Conference.

[47]  Frédo Durand,et al.  Light mixture estimation for spatially varying white balance , 2008, SIGGRAPH 2008.

[48]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[49]  Chengjun Liu,et al.  A Hybrid Color and Frequency Features Method for Face Recognition , 2008, IEEE Transactions on Image Processing.

[50]  Alex Waibel,et al.  Face locating and tracking for human-computer interaction , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[51]  Qian Chen,et al.  Face Detection From Color Images Using a Fuzzy Pattern Matching Method , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Anil K. Jain,et al.  Face detection and modeling for recognition , 2002 .

[53]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[54]  Mika Laaksonen,et al.  Adaptive skin color modeling using the skin locus for selecting training pixels , 2003, Pattern Recognit..

[55]  J. Birgitta Martinkauppi,et al.  Behavior of skin color under varying illumination seen by different cameras at different color spaces , 2001, IS&T/SPIE Electronic Imaging.

[56]  Chengjun Liu,et al.  A General Discriminant Model for Color Face Recognition , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[57]  Matti Pietikäinen,et al.  Color Cue in Facial Image Analysis , 2006 .

[58]  A. Lynn Abbott,et al.  EURASIP Journal on Applied Signal Processing 2004:4, 1–8 c ○ 2004 Hindawi Publishing Corporation Optimization of Color Conversion for Face Recognition , 2003 .