Clothing Extraction Using Region-Based Segmentation and Pixel-Level Refinement

In this paper, we demonstrate an effective method for automatic extracting clothing object from fashion photographs, an extremely challenging problem due to the non-uniform natural backgrounds, various types of apparel and different poses of human models. This method consists of three phases: (1) coarse clothing area localization by pose estimation and super pixel segmentation, (2) region-level image segmentation, (3) pixel-level refinement using spatial information and Grab cut. Experiments on a dataset with 1000 images crawled from Taobao demonstrate that the proposed method outperforms other methods, which can extract clothing from images with complex background.

[1]  Imen Karoui,et al.  Variational Region-Based Segmentation Using Multiple Texture Statistics , 2010, IEEE Transactions on Image Processing.

[2]  Qiang Peng,et al.  Principal object detection towards product image search , 2012, 2012 International Conference on Audio, Language and Image Processing.

[3]  Tsuhan Chen,et al.  Clothing cosegmentation for recognizing people , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[5]  Xiao Wu,et al.  Interactive product image search with complex scenes , 2012, ICIMCS '12.

[6]  Giovanni Mettivier,et al.  Digital Imaging Processing , 2010 .

[7]  Changsheng Xu,et al.  Hi, magic closet, tell me what to wear! , 2012, ACM Multimedia.

[8]  Lan Xu,et al.  Image retrieval using both color and texture features , 2007 .

[9]  Changsheng Xu,et al.  Street-to-shop: Cross-scenario clothing retrieval via parts alignment and auxiliary set , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Nan Wang,et al.  Who Blocks Who: Simultaneous clothing segmentation for grouping images , 2011, 2011 International Conference on Computer Vision.

[13]  Yi Yang,et al.  Articulated pose estimation with flexible mixtures-of-parts , 2011, CVPR 2011.

[14]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[15]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[16]  Indrajit Chakrabarti,et al.  Flooding-based watershed algorithm and its prototype hardware architecture , 2004 .

[17]  Ji-quan Ma,et al.  Content-Based Image Retrieval with HSV Color Space and Texture Features , 2009, 2009 International Conference on Web Information Systems and Mining.

[18]  Huizhong Chen,et al.  Describing Clothing by Semantic Attributes , 2012, ECCV.

[19]  Luis E. Ortiz,et al.  Parsing clothing in fashion photographs , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.