Segmentation of faces in video footage using HSV color for face detection and image retrieval

Previous studies on face detection in video footages show that segmenting faces accurately and reliably is often hard to succeed, leading instead to laborious and tedious interactive manipulation. This paper presents a segmentation method using controlled weights on the three HSV components and constructs a face detection and image retrieval system. First, it is shown that HSV color has advantages over RGB or YCbCr one when segmenting a face and generating a binary pattern that retains as many features of the face as possible in the original color picture. Then, a face detection and image retrieval system is constructed using HSV color, where each time a significant scene change is detected segmentation is carried out for the beginning frame using a few sets of the weights on the HSV components, and resulting patterns are checked in some requirements and correlated with a typical face pattern. Computer experiments show that the successful detection rate is more than 95 percent and that images can be retrieved from an input face image in a short time.

[1]  Wan-Chi Siu,et al.  Extracting Semantic Video Objects , 2001, IEEE Computer Graphics and Applications.

[2]  Federico Girosi,et al.  Training support vector machines: an application to face detection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Takeo Kanade,et al.  Name-It: Naming and Detecting Faces in News Videos , 1999, IEEE Multim..

[5]  Raphaël Féraud,et al.  A Fast and Accurate Face Detector Based on Neural Networks , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Demin Wang Unsupervised video segmentation based on watersheds and temporal tracking , 1998, IEEE Trans. Circuits Syst. Video Technol..

[7]  A. Murat Tekalp,et al.  Simultaneous alpha map generation and 2-D mesh tracking for multimedia applications , 1997, Proceedings of International Conference on Image Processing.

[8]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Takeo Kanade,et al.  Probabilistic modeling of local appearance and spatial relationships for object recognition , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[10]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.