A new skin colour estimation method based on change detection and cluster analysis

Skin colour is a useful and robust cue for face and hand detection and tracking and it has been widely exploited in many different applications such as human motion analysis or image and video retrieval. The presented work is a result of the joint Fraunhofer/Max-Planck research project AVATecH (Advancing Video/Audio Technology in Humanities Research), which deals with automatic annotation of large video corpora in humanities research for psycholinguistics. One of the tasks in this project is the development of a robust skin colour estimation algorithm necessary for the realization of tools for hands and head tracking. Because of the peculiarities of the large video corpora, there are no skin colour models applicable to detect the correct skin colour in each video. Therefore an algorithm was developed that estimates skin colour independently for each video and more important, it works reliably without the need of a training set. The algorithm uses both a change detection tool, to select the most suitable frames for skin colour estimation, and an iterative clustering algorithm to select the range in the YUV domain that best represents skin colour.

[1]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Clement T. Yu,et al.  Detecting human faces in color images , 1998, Proceedings International Workshop on Multi-Media Database Management Systems (Cat. No.98TB100249).

[3]  Sebastian Lang,et al.  Improving adaptive skin color segmentation by incorporating results from face detection , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[4]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[5]  Marcel J. T. Reinders,et al.  A self-calibrating chrominance model applied to skin color detection , 2007, VISAPP.

[6]  Qian Chen,et al.  Face detection by fuzzy pattern matching , 1995, Proceedings of IEEE International Conference on Computer Vision.

[7]  J. Y. Lee,et al.  An Elliptical Boundary Model for Skin Color Detection , 2002 .

[8]  Kevin Curran,et al.  A skin tone detection algorithm for an adaptive approach to steganography , 2009, Signal Process..

[9]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[10]  P. Peer,et al.  Human skin color clustering for face detection , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[11]  Ian Craw,et al.  A SOM Based Approach to Skin Detection with Application in Real Time Systems , 2001, BMVC.