Color balloon snakes for face segmentation

Abstract In this paper, a new color balloon snake model is introduced and used for face segmentation in color images. It is an extension of existing balloon snake models. Based on a coarse detection of facial features, the method combines a skin-tone distribution model and a boundary diffusion model to search for the facial boundary. The skin distribution is a single Gaussian, which is proposed to extract the skin-tone region in the RGB space. The diffusion model, which is invented to diffuse the facial boundary, is a one-dimensional Gauss revolution surface. The parameters are evaluated based on an AdaBoost face detection method. The color snakes are weighted by the distributions, and the external forces evolve dynamically to reach the boundary, which depends on the balance between the internal and external forces. Experiments were conducted, and the results show that the model provides desired segmentation outcomes. It is robust against complex backgrounds and lighting pollution.

[1]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[2]  King Ngi Ngan,et al.  Face segmentation using skin-color map in videophone applications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[3]  L. Farkas,et al.  Proportionality in Asian and North American Caucasian Faces Using Neoclassical Facial Canons as Criteria , 2002, Aesthetic Plastic Surgery.

[4]  Ayoub Al-Hamadi,et al.  Facial feature point detection using simplified gabor wavelets and confidence-based grouping , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[5]  P. Peer,et al.  Human skin color clustering for face detection , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[6]  Zheru Chi,et al.  A robust eye detection method using combined binary edge and intensity information , 2006, Pattern Recognit..

[7]  Jian Sun,et al.  Lazy snapping , 2004, SIGGRAPH 2004.

[8]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[10]  King Ngi Ngan,et al.  FaceSeg: Automatic Face Segmentation for Real-Time Video , 2009, IEEE Transactions on Multimedia.

[11]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[12]  Chaoyi Zhang,et al.  Automatic Face Segmentation Based on the Level Set Method , 2012, ITCS 2012.

[13]  Fei Chen,et al.  A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion Inference , 2010, IEEE Transactions on Multimedia.

[14]  Ashok Samal,et al.  Computation of a face attractiveness index based on neoclassical canons, symmetry, and golden ratios , 2008, Pattern Recognit..

[15]  Maja Pantic,et al.  Fully automatic facial feature point detection using Gabor feature based boosted classifiers , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[16]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[17]  Xiaoping Li,et al.  An automatic facial feature point localization method , 2011, 2011 IEEE International Conference on Cloud Computing and Intelligence Systems.

[18]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[19]  Guillermo Sapiro,et al.  Color Snakes , 1997, Comput. Vis. Image Underst..

[20]  Simon Baker,et al.  Active Appearance Models Revisited , 2004, International Journal of Computer Vision.

[21]  Volkan Atalay,et al.  Projection based method for segmentation of human face and its evaluation , 2002, Pattern Recognit. Lett..

[22]  Jerry L. Prince,et al.  Snakes, shapes, and gradient vector flow , 1998, IEEE Trans. Image Process..

[23]  Marios Savvides,et al.  Facecut - a robust approach for facial feature segmentation , 2012, 2012 19th IEEE International Conference on Image Processing.