Skin probability map and its use in face detection

This paper is in two parts. The first part quantatively assesses an approach to skin segmentation. The second part describes the development and quantitative assessment of an approach to face detection (FD), with the application of content-based image retrieval in mind. Skin detection is introduced as a front-end to an earlier approach to FD by Huang (1994). The baseline approach searches grey scale images only, and is found to be susceptible to variations in lighting conditions and complex backgrounds. It is hypothesised that by integrating colour information into Huang's approach, the number of false faces can be reduced. A skin probability map (SPM) is generated from a large quantity of labeled data (530 images containing faces and 714 images that do not) and is used to pre-process colour test images. Image regions are then ranked in terms of their skin content, thus removing improbable face regions. The performance improvements are shown in terms of false acceptance (FA) and false rejection (FR) scores. As a front-end to Huang's approach, the benefits of skin segmentation can be seen by a reduction in the FA score from 79% to 15% with a negligible impact on FR.

[1]  John S. D. Mason,et al.  Enhancing face detection in colour images using a skin probability map , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[2]  Clement T. Yu,et al.  Detecting human faces in color images , 1998, Proceedings International Workshop on Multi-Media Database Management Systems (Cat. No.98TB100249).

[3]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  Jason Brand,et al.  A comparative assessment of three approaches to pixel-level human skin-detection , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[5]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[6]  James L. Crowley,et al.  Multi-modal tracking of faces for video communications , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  M. Brandstein,et al.  Multi-source face tracking with audio and visual data , 1999, 1999 IEEE Third Workshop on Multimedia Signal Processing (Cat. No.99TH8451).

[8]  Ioannis Pitas,et al.  Looking for Faces and Facial Features in Color Images , 1997 .

[9]  Thomas S. Huang,et al.  Human face detection in a complex background , 1994, Pattern Recognit..