Face segmentation using skin-color map in videophone applications

This paper addresses our proposed method to automatically segment out a person's face from a given image that consists of a head-and-shoulders view of the person and a complex background scene. The method involves a fast, reliable, and effective algorithm that exploits the spatial distribution characteristics of human skin color. A universal skin-color map is derived and used on the chrominance component of the input image to detect pixels with skin-color appearance. Then, based on the spatial distribution of the detected skin-color pixels and their corresponding luminance values, the algorithm employs a set of novel regularization processes to reinforce regions of skin-color pixels that are more likely to belong to the facial regions and eliminate those that are not. The performance of the face-segmentation algorithm is illustrated by some simulation results carried out on various head-and-shoulders test images. The use of face segmentation for video coding in applications such as videotelephony is then presented. We explain how the face-segmentation results can be used to improve the perceptual quality of a videophone sequence encoded by the H.261-compliant coder.

[1]  Venu Govindaraju,et al.  Locating human faces in newspaper photographs , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  K.N. Ngan,et al.  Foreground/background video coding scheme , 1997, Proceedings of 1997 IEEE International Symposium on Circuits and Systems. Circuits and Systems in the Information Age ISCAS '97.

[3]  Alex Waibel,et al.  Face locating and tracking for human-computer interaction , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[4]  Yun He,et al.  Automatic face segmentation using color cues for coding typical videophone scenes , 1997, Electronic Imaging.

[5]  Venu Govindaraju,et al.  A computational model for face location , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[6]  Osamu Nakamura,et al.  Human-face extraction using modified HSV color system and personal identification through facial image based on isodensity maps , 1995, Proceedings 1995 Canadian Conference on Electrical and Computer Engineering.

[7]  Bülent Sankur,et al.  Facial feature localization and adaptation of a generic face model for model-based coding , 1995, Signal Process. Image Commun..

[8]  Itu-T.  Video coding for low bitrate communication , 1996 .

[9]  Jiebo Luo,et al.  Face location in wavelet-based video compression for high perceptual quality videoconferencing , 1995, Proceedings., International Conference on Image Processing.

[10]  Timothy F. Cootes,et al.  Locating faces using statistical feature detectors , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[11]  Manuel M. de Sequeira,et al.  Knowledge-based videotelephone sequence segmentation , 1993, Other Conferences.

[12]  G. Sexton.  Automatic face detection for videoconferencing , 1990 .

[13]  Alexandros Eleftheriadis,et al.  Model-assisted coding of video teleconferencing sequences at low bit rates , 1994, Proceedings of IEEE International Symposium on Circuits and Systems - ISCAS '94.

[14]  King Ngi Ngan,et al.  Automatic face location for videophone images , 1996, Proceedings of Digital Processing Applications (TENCON '96).

[15]  Qian Chen,et al.  Face detection by fuzzy pattern matching , 1995, Proceedings of IEEE International Conference on Computer Vision.

[16]  Ioannis Pitas,et al.  Face localization and facial feature extraction based on shape and color information , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[17]  Satoshi Shimada.  Extraction of scenes containing a specific person from image sequences of a real-world scene , 1992, TENCON'92 - Technology Enabling Tomorrow.

[18]  David C. Gibbon,et al.  Multi-modal system for locating heads and faces , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[19]  Haibo Li.  Segmentation of the facial area for videophone applications , 1992 .

[20]  Kiyoharu Aizawa,et al.  Model-based image coding advanced video coding techniques for very low bit-rate applications , 1995, Proc. IEEE.

[21]  Alexandros Eleftheriadis,et al.  Automatic face location detection and tracking for model-assisted coding of video teleconferencing sequences at low bit-rates , 1995, Signal Process. Image Commun..

[22]  Thomas S. Huang,et al.  Human face detection in a complex background , 1994, Pattern Recognit..

[23]  King Ngi Ngan,et al.  Extraction of VOP from Videophone Scene , 1997 .

[24]  John R. Kender,et al.  Finding skin in color images , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[25]  Richard A. Foulds,et al.  Toward robust skin identification in video images , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.