Clothing segmentation using foreground and background estimation based on the constrained Delaunay triangulation

This paper proposes a new clothing segmentation method using foreground (clothing) and background (non-clothing) estimation based on the constrained Delaunay triangulation (CDT), without any pre-defined clothing model. In our method, the clothing is extracted by graph cuts, where the foreground seeds and background seeds are determined automatically. The foreground seeds are found by torso detection based on dominant colors determination, and the background seeds are estimated based on CDT. With the determined seeds, the color distributions of the foreground and background are modeled by Gaussian mixture models and filtered by a CDT-based noise suppression algorithm for more robust and accurate segmentation. Experimental results show that our clothing segmentation method is able to extract different clothing from static images with variations in backgrounds and lighting conditions.

[1]  Jeff A. Bilmes,et al.  A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models , 1998 .

[2]  H. Yan,et al.  Torso Detection in Static Images , 2006, 2006 8th international Conference on Signal Processing.

[3]  Yizhou Yu,et al.  Two-Level Image Segmentation Based on Region and Edge Integration , 2003, DICTA.

[4]  David Salesin,et al.  Image-Based Hair Capture by Inverse Lighting , 2002, Graphics Interface.

[5]  David A. Forsyth,et al.  Probabilistic Methods for Finding People , 2001, International Journal of Computer Vision.

[6]  Patrick Pérez,et al.  Interactive Image Segmentation Using an Adaptive GMMRF Model , 2004, ECCV.

[7]  Jiebo Luo,et al.  Clothed people detection in still images , 2002, Object recognition supported by user interaction for service robots.

[8]  Somchai Jitapunkul,et al.  Face segmentation based on Hue-Cr components and morphological technique , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[9]  Mun Wai Lee,et al.  A model-based approach for estimating human 3D poses in static images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jonathan Richard Shewchuk,et al.  Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator , 1996, WACG.

[11]  Hong Chen,et al.  Composite Templates for Cloth Modeling and Sketching , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[13]  L. Paul Chew,et al.  Constrained Delaunay triangulations , 1987, SCG '87.

[14]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[15]  Jitendra Malik,et al.  Scale-invariant contour completion using conditional random fields , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[16]  Hong Yan,et al.  Shape skeletonization by identifying discrete local symmetries , 2001, Pattern Recognit..

[17]  Cordelia Schmid,et al.  Learning to Parse Pictures of People , 2002, ECCV.

[18]  Yuan Li,et al.  Vector boosting for rotation invariant multi-view face detection , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[19]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Gang Hua,et al.  Learning to estimate human pose with data driven belief propagation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.