Multi-features fusion based CRFs for face segmentation

Face segmentation is quite challenging due to the diversity of hair styles, head poses, clothing, occlusions, and other phenomena. To improve the accuracy of face segmentation from the images with complex scenes, we present a method based on Conditional Random Fields (CRFs) in this paper. The CRFs model is defined on a graph, in which each node corresponds to a superpixel and each edge connects a pair of neighboring superpixels. The features of color and texture are used to define the node energy function, and the position distance and differences of features between adjacent superpixels are used to define the edge energy function. Segmentation is performed by inferring the CRFs model built by fusing node energy function and edge energy function. We evaluate the performance of the proposed method on two unconstrained face databases. Experimental results demonstrate that the proposed method can efficiently partition face images into regions of face, hair, and background.

[1]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[2]  Dragomir Anguelov,et al.  Markov random field models for hair and face segmentation , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[3]  Jean-Marc Odobez,et al.  Joint Adaptive Colour Modelling and Skin, Hair and Clothes Segmentation using Coherent Probabilistic Index Maps , 2011, BMVC.

[4]  Ioannis Pitas,et al.  Facial feature extraction and pose determination , 2000, Pattern Recognit..

[5]  Larry S. Davis,et al.  Detection and analysis of hair , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Erik G. Learned-Miller,et al.  Towards unconstrained face recognition , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Ville Ojansivu,et al.  Blur Insensitive Texture Classification Using Local Phase Quantization , 2008, ICISP.

[8]  Michael I. Jordan,et al.  Loopy Belief Propagation for Approximate Inference: An Empirical Study , 1999, UAI.

[9]  S. L. Phung,et al.  A novel skin color model in YCbCr color space and its application to human face detection , 2002, Proceedings. International Conference on Image Processing.

[10]  Jitendra Malik,et al.  Learning to Detect Natural Image Boundaries Using Brightness and Texture , 2002, NIPS.

[11]  Adrien Bartoli,et al.  Automatic Hair Detection in the Wild , 2010, 2010 20th International Conference on Pattern Recognition.

[12]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .