Outfit Recommendation System Based on Deep Learning

In this paper, we propose an outfit recommendation system based on deep learning. Our goal is to use the system not only to judge an outfit if it is good or not but also to recommend good outfit to users when it is given a pool of cloth items. Our proposed model includes two parts: one is feature extractor based on ResNet-50, and the other is a binary classifier which is to classify the outfits into good ones and bad ones. Since our model is based on deep learning, it is necessary to use huge data to train the model. We collected a dataset which consists of 409,776 outfits with 644,192 items from the famous fashion website called Polyvore.com. With this dataset, we trained our model and the performance of it is over 84%. And our model can also recommend daily outfit to users.

[1]  Luis E. Ortiz,et al.  Chic or Social: Visual Popularity Analysis in Online Fashion Networks , 2014, ACM Multimedia.

[2]  C. V. Jawahar,et al.  Parsing Clothes in Unrestricted Images , 2013, BMVC.

[3]  Hanqing Lu,et al.  Street-to-shop: Cross-scenario clothing retrieval via parts alignment and auxiliary set , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[5]  Changsheng Xu,et al.  Hi, magic closet, tell me what to wear! , 2012, ACM Multimedia.

[6]  Francesc Moreno-Noguer,et al.  Neuroaesthetics in fashion: Modeling the perception of fashionability , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Qiang Chen,et al.  Cross-Domain Image Retrieval with a Dual Attribute-Aware Ranking Network , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Jiro Katto,et al.  Deep Residual Learning for Image Compression , 2019, CVPR Workshops.

[9]  Alexander C. Berg,et al.  Runway to Realway: Visual Analysis of Fashion , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[10]  Meng Wang,et al.  Predicting occupation via human clothing and contexts , 2011, 2011 International Conference on Computer Vision.

[11]  Takayuki Okatani,et al.  Mix and Match: Joint Model for Clothing and Attribute Recognition , 2015, BMVC.

[12]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[13]  Xiaogang Wang,et al.  DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Larry S. Davis,et al.  Collaborative Fashion Recommendation: A Functional Tensor Factorization Approach , 2015, ACM Multimedia.

[15]  Huizhong Chen,et al.  Describing Clothing by Semantic Attributes , 2012, ECCV.

[16]  Robinson Piramuthu,et al.  Large scale visual recommendations from street fashion images , 2014, KDD.

[17]  Nan Wang,et al.  Who Blocks Who: Simultaneous clothing segmentation for grouping images , 2011, 2011 International Conference on Computer Vision.