Skin Patch Detection in Real-World Images

While human skin is relatively easy to detect in controlled environments, detection in uncontrolled settings such as in consumer digital photographs is generally hard. Algorithms need to robustly deal with variations in lighting, color resolution, and imaging noise. This paper proposes a simple generative skin patch model combining shape and color information. The model is parametric and represents the spatial arrangement of skin pixels as compact elliptical regions. Its parameters are estimated by maximizing the mutual information between the model-generated skin pixel distribution and the distribution of skin color as observed in the image. The core of this work is an empirical evaluation on a database of 653 consumer digital photographs. In addition, we investigate the potential of combining our skin detector with state-of-the-art appearance-based face detectors.

[1]  E. Granum,et al.  Skin colour detection under changing lighting conditions , 1999 .

[2]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[3]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[4]  Brian V. Funt,et al.  Color constancy under varying illumination , 1995, Proceedings of IEEE International Conference on Computer Vision.

[5]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[6]  G. Marchal,et al.  Multi-modal volume registration by maximization of mutual information , 1997 .

[7]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[9]  Thomas S. Huang,et al.  Face detection with information-based maximum discrimination , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  James Ze Wang,et al.  System for screening ob-jectionable images using daubechies''wavelets , 1997 .

[11]  David A. Forsyth,et al.  Finding Naked People , 1996, ECCV.

[12]  Takeo Kanade,et al.  A statistical method for 3D object detection applied to faces and cars , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[13]  James Ze Wang,et al.  System for Screening Objectionable Images Using Daubechies' Wavelets and Color Histograms , 1997, IDMS.

[14]  Alex Pentland,et al.  Learning words from natural audio-visual input , 1998, ICSLP.

[15]  Shigeru Akamatsu,et al.  Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[16]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Stan Sclaroff,et al.  Estimation and prediction of evolving color distributions for skin segmentation under varying illumination , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).