Clothing Similarity Estimation Using Dominant Color Descriptor and SSIM Index

This paper deals with the problem of estimating the similarity of clothing for the purpose of fashion-related e-commerce systems. The images presenting fashion models are segmented and analyzed in order to detect clothing characteristics. We propose a method based on human pose estimation and body parts segmentation, followed by the analysis of dominant color and structural similarity, independently for particular body segments. The algorithm can be utilized to perform clusterization or in the simpler case—to directly search for similar outfits. The experiments performed using 1800 real-life photos proved the applicability of the proposed approach.

[1]  Zheng Liu,et al.  Clothing similarity computation based on TLAC , 2012 .

[2]  Pawel Forczmanski,et al.  Similarity Estimation of Textile Materials Based on Image Quality Assessment Methods , 2014, ICCVG.

[3]  E. Marder,et al.  Statistics of Neuronal Identification with Open- and Closed-Loop Measures of Intrinsic Excitability , 2012, Front. Neural Circuits.

[4]  Peter J. Rousseeuw,et al.  Clustering by means of medoids , 1987 .

[5]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[6]  Pawel Forczmanski,et al.  Comparing Clothing Styles by Means of Computer Vision Methods , 2014, ICCVG.

[7]  Vittorio Ferrari,et al.  Better Appearance Models for Pictorial Structures , 2009, BMVC.

[8]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Robinson Piramuthu,et al.  Style Finder: Fine-Grained Clothing Style Detection and Retrieval , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[10]  Pawel Forczmanski,et al.  Clustering-Based Retrieval of Similar Outfits Based on Clothes Visual Characteristics , 2014, IP&C.

[11]  James Begole,et al.  Real-time clothes comparison based on multi-view vision , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[12]  Jituo Li,et al.  Measuring clothing image similarity with bundled features , 2013 .

[13]  Andrew Zisserman,et al.  2D Articulated Human Pose Estimation and Retrieval in (Almost) Unconstrained Still Images , 2012, International Journal of Computer Vision.

[14]  Huizhong Chen,et al.  Describing Clothing by Semantic Attributes , 2012, ECCV.

[15]  Jos B. T. M. Roerdink,et al.  The Watershed Transform: Definitions, Algorithms and Parallelization Strategies , 2000, Fundam. Informaticae.