Accurate face segmentation based on fusion of improved GrabCut and ASM

In this paper, we propose a novel algorithm for accurate face segmentation in frontal images. GrabCut has been widely applied in segmentation, however, it needs user interaction and suffers from the inaccurate foreground model. Since Active Shape Model (ASM) is able to approximately locate the face region, this paper introduces ASM into GrabCut to avoid user interaction and improve the foreground extraction. It includes three phases. First, landmarks of face images provided by ASM, instead of user interaction, are utilized to locate the face region. Second, based on the facial masks from ASM, an improved GrabCut is proposed to conduct the face segmentation. Finally, a bank of Gabor filters of different orientations is utilized to refine the extracted face region. Experimental results on CMUPIE database show that the proposed method significantly improves the frontal face segmentation.

[1]  Bo Peng,et al.  Parameter Selection for Graph Cut Based Image Segmentation , 2008, BMVC.

[2]  Chi Fang,et al.  Generic face alignment using an improved Active Shape Model , 2008, 2008 International Conference on Audio, Language and Image Processing.

[3]  Ralph Gross,et al.  Generic vs. person specific active appearance models , 2005, Image Vis. Comput..

[4]  Chi Fang,et al.  2D face fitting-assisted 3D face reconstruction for pose-robust face recognition , 2011, Soft Comput..

[5]  Andrew Zisserman,et al.  OBJCUT: Efficient Segmentation Using Top-Down and Bottom-Up Cues , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Jian Yang,et al.  Iterated Graph Cuts for Image Segmentation , 2009, ACCV.

[7]  Changshui Zhang,et al.  Competitive EM algorithm for finite mixture models , 2004, Pattern Recognit..

[8]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[10]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[11]  Pushmeet Kohli,et al.  PoseCut: Simultaneous Segmentation and 3D Pose Estimation of Humans Using Dynamic Graph-Cuts , 2006, ECCV.

[12]  Tao Zhang,et al.  Interactive graph cut based segmentation with shape priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).