Image Based Fashion Product Recommendation with Deep Learning

We develop a two-stage deep learning framework that recommends fashion images based on other input images of similar style. For that purpose, a neural network classifier is used as a data-driven, visually-aware feature extractor. The latter then serves as input for similarity-based recommendations using a ranking algorithm. Our approach is tested on the publicly available Fashion dataset. Initialization strategies using transfer learning from larger product databases are presented. Combined with more traditional content-based recommendation systems, our framework can help to increase robustness and performance, for example, by better matching a particular customer style.

[1]  John Riedl,et al.  E-Commerce Recommendation Applications , 2004, Data Mining and Knowledge Discovery.

[2]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[3]  Alan Dick,et al.  Customer loyalty: Toward an integrated conceptual framework , 1994 .

[4]  Gerald Häubl,et al.  "Double Agents": Assessing the Role of Electronic Product Recommendation Systems , 2005 .

[5]  Simon J. D. Prince,et al.  Computer Vision: Models, Learning, and Inference , 2012 .

[6]  Stephen M. Omohundro,et al.  Bumptrees for Efficient Function, Constraint and Classification Learning , 1990, NIPS.

[7]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[8]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[10]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[11]  Simone Calderara,et al.  A complete system for garment segmentation and color classification , 2013, Machine Vision and Applications.

[12]  Luyan Chen.  Image-based Product Recommendation System with Convolutional Neural Networks , 2017 .

[13]  Zheng Zhang,et al.  MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems , 2015, ArXiv.

[14]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[15]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[17]  Lina Yao,et al.  Deep Learning Based Recommender System , 2017, ACM Comput. Surv..

[18]  Rolph E. Anderson,et al.  Customer loyalty in e-commerce: an exploration of its antecedents and consequences , 2002 .

[19]  Julian J. McAuley,et al.  VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback , 2015, AAAI.

[20]  Xiaogang Wang,et al.  DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  H. A. Ananya,et al.  Deep Learning based Large Scale Visual Recommendation and Search for E-Commerce , 2017, ArXiv.

[22]  Simon J. D. Prince,et al.  Computer Vision: Index , 2012 .