Apparel-based deep learning system design for apparel style recommendation

The big challenge in apparel recommendation system research is not the exploration of machine learning technologies in fashion, but to really understand clothes, fashion and people, and know what to learn. The purpose of this paper is to explore an advanced apparel style learning and recommendation system that can recognise deep design-associated features of clothes and learn the connotative meanings conveyed by these features relating to style and the body so that it can make recommendations as a skilled human expert.,This study first proposes a type of new clothes style training data. Second, it designs three intelligent apparel-learning models based on newly proposed training data including ATTRIBUTE, MEANING and the raw image data, and compares the models’ performances in order to identify the best learning model. For deep learning, two models are introduced to train the prediction model, one is a convolutional neural network joint with the baseline classifier support vector machine and the other is with a newly proposed classifier later kernel fusion.,The results show that the most accurate model (with average prediction rate of 88.1 per cent) is the third model that is designed with two steps, one is to predict apparel ATTRIBUTEs through the apparel images, and the other is to further predict apparel MEANINGs based on predicted ATTRIBUTEs. The results indicate that adding the proposed ATTRIBUTE data that captures the deep features of clothes design does improve the model performances (e.g. from 73.5 per cent, Model B to 86 per cent, Model C), and the new concept of apparel recommendation based on style meanings is technically applicable.,The apparel data and the design of three training models are originally introduced in this study. The proposed methodology can evaluate the pros and cons of different clothes feature extraction approaches through either images or design attributes and balance different machine learning technologies between the latest CNN and traditional SVM.

[1]  Heitor Silvério Lopes,et al.  Extracting human attributes using a convolutional neural network approach , 2015, Pattern Recognit. Lett..

[2]  Xiaogang Wang,et al.  DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[4]  Roland Vollgraf,et al.  Fashion DNA: Merging Content and Sales Data for Recommendation and Article Mapping , 2016, ArXiv.

[5]  V. Raykar,et al.  Probability Density Function Estimation by different Methods , 2022 .

[6]  Arzu Vuruskan,et al.  Intelligent fashion styling using genetic search and neural classification , 2015 .

[7]  Yannis Kalantidis,et al.  Getting the look: clothing recognition and segmentation for automatic product suggestions in everyday photos , 2013, ICMR.

[8]  Wessie Ling,et al.  Apparel recommendation system evolution: an empirical review , 2016 .

[9]  Xiaojie Wang,et al.  Retrieving real world clothing images via multi-weight deep convolutional neural networks , 2019, Cluster Computing.

[10]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[11]  Emanuele Silva,et al.  Understanding and Personalising Clothing Recommendation for Women , 2017, WorldCIST.

[12]  Huizhong Chen,et al.  Describing Clothing by Semantic Attributes , 2012, ECCV.

[13]  Wen-Huang Cheng,et al.  Clothing genre classification by exploiting the style elements , 2012, ACM Multimedia.

[14]  Robinson Piramuthu,et al.  Fashion apparel detection: The role of deep convolutional neural network and pose-dependent priors , 2014, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[15]  Ching-I Cheng,et al.  An intelligent clothes search system based on fashion styles , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[16]  Nick Landia Building Recommender Systems for Fashion: Industry Talk Abstract , 2017, RecSys.

[17]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[18]  P. Vikkraman,et al.  AN INTELLIGENT APPAREL RECOMMENDATION SYSTEM FOR ONLINE SHOPPING USING STYLE CLASSIFICATION , 2015 .

[19]  Ranjitha Kumar,et al.  The Elements of Fashion Style , 2016, UIST.