An efficient face segmentation algorithm based on binary partition tree

This paper presents an efficient face segmentation algorithm based on binary partition tree. Skin-like regions are first obtained by integrating the results of pixel classification and watershed segmentation. Facial features are extracted by the techniques of valley detection and entropic thresholding, and are used to refine the skin-like regions. In order to segment the facial regions from the skin-like regions, a novel region merging algorithm is proposed by considering the impact of the common border ratio between adjacent regions, and the binary partition tree is used to represent the whole region merging process. Then the facial likeness of each node in the binary partition tree is evaluated using a set of fuzzy membership functions devised for a number of facial primitives of geometrical, elliptical and facial features. Finally, an efficient algorithm of node selecting in the binary partition tree is proposed for the final face segmentation, which can exactly segment the faces without any underlying assumption. The performance of the proposed face segmentation algorithm is demonstrated by experimental results carried out on a variety of images in different scenarios.

[1]  Stefanos D. Kollias,et al.  An efficient fully unsupervised video object segmentation scheme using an adaptive neural-network classifier architecture , 2003, IEEE Trans. Neural Networks.

[2]  Chin-Chuan Han,et al.  Facial feature detection using geometrical face model: An efficient approach , 1998, Pattern Recognit..

[3]  Timothy F. Cootes,et al.  Automatic Interpretation and Coding of Face Images Using Flexible Models , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Bernd Menser,et al.  Segmentation of human faces in color images using connected operators , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[5]  Eli Saber,et al.  Frontal-view face detection and facial feature extraction using color, shape and symmetry based cost functions , 1998, Pattern Recognit. Lett..

[6]  Narendra Ahuja,et al.  Detecting human faces in color images , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[7]  Shie-Jue Lee,et al.  A neuro-fuzzy approach for segmentation of human objects in image sequences , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[8]  King Ngi Ngan,et al.  Face segmentation using skin-color map in videophone applications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[9]  Shaogang Gong,et al.  Modelling facial colour and identity with Gaussian mixtures , 1998, Pattern Recognit..

[10]  Kongqiao Wang,et al.  A hierarchical multiscale and multiangle system for human face detection in a complex background using gravity-center template , 1999, Pattern Recognit..

[11]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[13]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Ioannis Pitas,et al.  A novel method for automatic face segmentation, facial feature extraction and tracking , 1998, Signal Process. Image Commun..

[15]  Verónica Vilaplana,et al.  Face segmentation and tracking based on connected operators and partition projection , 2002, Pattern Recognit..

[16]  Kin-Man Lam,et al.  A robust scheme for live detection of human faces in color images , 2003, Signal Process. Image Commun..

[17]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..

[18]  Konstantinos N. Plataniotis,et al.  Automatic location and tracking of the facial region in color video sequences , 1999, Signal Process. Image Commun..

[19]  Yao Wang,et al.  Facial feature extraction and tracking in video sequences , 1997, Proceedings of First Signal Processing Society Workshop on Multimedia Signal Processing.

[20]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[21]  Philippe Salembier,et al.  Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval , 2000, IEEE Trans. Image Process..

[22]  VincentL..  Morphological grayscale reconstruction in image analysis , 1993 .

[23]  Kuo-Chin Fan,et al.  Triangle-based approach to the detection of human face , 2001, Pattern Recognit..

[24]  Jianping Fan,et al.  An automatic algorithm for semantic object generation and temporal tracking , 2002, Signal Process. Image Commun..

[25]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  YangMing-Hsuan,et al.  Detecting Faces in Images , 2002 .

[27]  Jian-Gang Wang,et al.  Frontal-view face detection and facial feature extraction using color and morphological operations , 1999, Pattern Recognit. Lett..

[28]  Hayit Greenspan,et al.  Mixture model for face-color modeling and segmentation , 2001, Pattern Recognit. Lett..

[29]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Alexander H. Waibel,et al.  A real-time face tracker , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[31]  Charles A. Bouman,et al.  Face detection for pseudo-semantic labeling in video databases , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[32]  Shih-Fu Chang,et al.  A highly efficient system for automatic face region detection in MPEG video , 1997, IEEE Trans. Circuits Syst. Video Technol..

[33]  Thomas S. Huang,et al.  Human face detection in a complex background , 1994, Pattern Recognit..

[34]  Charles A. Bouman,et al.  A simple and efficient face detection algorithm for video database applications , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[35]  H. D. Cheng,et al.  Thresholding using two-dimensional histogram and fuzzy entropy principle , 2000, IEEE Trans. Image Process..

[36]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[37]  Shie-Jue Lee,et al.  A neuro-fuzzy approach for multiple human objects segmentation , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[38]  SoillePierre,et al.  Watersheds in Digital Spaces , 1991 .