Learning to Match Clothing From Textual Feature-Based Compatible Relationships

This paper presents a new framework for matching clothes by considering item in-between compatibility. In contrast to the use of visual features of clothing items, we only utilized their textual descriptions, i.e., title sentences, to constitute the basic features. Specifically, a longshort-term memory (LSTM) network was used for feature embeddings of title sentences. Given item pairs of queries and candidates, their feature embeddings achieved by Siamese LSTMs were integrated into style-compatible space characterized by a compatibility matrix. Our framework is examined on three large-scaled clothing item sets collected from Amazon, Taobao, and Polyvore, respectively. Experiments confirm the efficacy of our approach compared with several baseline methods.

[1]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[2]  Matthew D. Zeiler.  ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[3]  Serge J. Belongie,et al.  Learning Visual Clothing Style with Heterogeneous Dyadic Co-Occurrences , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[4]  Anton van den Hengel,et al.  Image-Based Recommendations on Styles and Substitutes , 2015, SIGIR.

[5]  Jian Pei,et al.  Mining frequent patterns without candidate generation , 2000, SIGMOD '00.

[6]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[7]  Kavita Bala,et al.  Learning visual similarity for product design with convolutional neural networks , 2015, ACM Trans. Graph..

[8]  David M. Pennock,et al.  Categories and Subject Descriptors , 2001 .

[9]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[10]  Tommy W. S. Chow,et al.  Textual and Visual Content-Based Anti-Phishing: A Bayesian Approach , 2011, IEEE Transactions on Neural Networks.

[11]  Yunming Ye,et al.  A Triple Wing Harmonium Model for Movie Recommendation , 2016, IEEE Transactions on Industrial Informatics.

[12]  Jiajun Bu,et al.  Deep Style Match for Complementary Recommendation , 2017, AAAI Workshops.

[13]  Haijun Zhang,et al.  Understanding Subtitles by Character-Level Sequence-to-Sequence Learning , 2017, IEEE Transactions on Industrial Informatics.

[14]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[15]  Jiebo Luo,et al.  Mining Fashion Outfit Composition Using an End-to-End Deep Learning Approach on Set Data , 2016, IEEE Transactions on Multimedia.

[16]  Michael J. Pazzani,et al.  Content-Based Recommendation Systems , 2007, The Adaptive Web.

[17]  David Vázquez,et al.  On-Board Object Detection: Multicue, Multimodal, and Multiview Random Forest of Local Experts , 2017, IEEE Transactions on Cybernetics.

[18]  Björn W. Schuller,et al.  Online Driver Distraction Detection Using Long Short-Term Memory , 2011, IEEE Transactions on Intelligent Transportation Systems.

[19]  Jimmy J. Lin,et al.  Multi-Perspective Sentence Similarity Modeling with Convolutional Neural Networks , 2015, EMNLP.

[20]  Daniel Marcu,et al.  A Noisy-Channel Approach to Question Answering , 2003, ACL.

[21]  Alex Graves,et al.  Supervised Sequence Labelling with Recurrent Neural Networks , 2012, Studies in Computational Intelligence.

[22]  Jonas Mueller,et al.  Siamese Recurrent Architectures for Learning Sentence Similarity , 2016, AAAI.

[23]  Tomoharu Iwata,et al.  Fashion Coordinates Recommender System Using Photographs from Fashion Magazines , 2011, IJCAI.

[24]  Kim-Fung Man,et al.  The Generic Design of a High-Traffic Advanced Metering Infrastructure Using ZigBee , 2014, IEEE Transactions on Industrial Informatics.

[25]  Charles X. Ling,et al.  Using AUC and accuracy in evaluating learning algorithms , 2005, IEEE Transactions on Knowledge and Data Engineering.

[26]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[27]  Feng Xia,et al.  Time-Location-Relationship Combined Service Recommendation Based on Taxi Trajectory Data , 2017, IEEE Transactions on Industrial Informatics.

[28]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.