Recursive Neural Language Architecture for Tag Prediction

We consider the problem of learning distributed representations for tags from their associated content for the task of tag recommendation. Considering tagging information is usually very sparse, effective learning from content and tag association is very crucial and challenging task. Recently, various neural representation learning models such as WSABIE and its variants show promising performance, mainly due to compact feature representations learned in a semantic space. However, their capacity is limited by a linear compositional approach for representing tags as sum of equal parts and hurt their performance. In this work, we propose a neural feedback relevance model for learning tag representations with weighted feature representations. Our experiments on two widely used datasets show significant improvement for quality of recommendations over various baselines.

[1]  Zoubin Ghahramani,et al.  Proceedings of the 24th international conference on Machine learning , 2007, ICML 2007.

[2]  Xuanjing Huang,et al.  Learning Context-Sensitive Word Embeddings with Neural Tensor Skip-Gram Model , 2015, IJCAI.

[3]  Jason Weston,et al.  #TagSpace: Semantic Embeddings from Hashtags , 2014, EMNLP.

[4]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[5]  Emily Denton,et al.  User Conditional Hashtag Prediction for Images , 2015, KDD.

[6]  Danqi Chen,et al.  Reasoning With Neural Tensor Networks for Knowledge Base Completion , 2013, NIPS.

[7]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[8]  Jason Weston,et al.  Large-Scale Music Annotation and Retrieval: Learning to Rank in Joint Semantic Spaces , 2011, ArXiv.

[9]  Wolfgang Nejdl,et al.  Proceedings of the 18th international conference on World wide web , 2009, WWW 2009.

[10]  Alberto Del Bimbo,et al.  Proceedings of the 19th ACM international conference on Multimedia , 2010, MM 2010.

[11]  Yan Liu,et al.  Collaborative Topic Regression with Social Matrix Factorization for Recommendation Systems , 2012, ICML.

[12]  Wu-Jun Li,et al.  Collaborative Topic Regression with Social Regularization for Tag Recommendation , 2013, IJCAI.

[13]  Nenghai Yu,et al.  Learning to tag , 2009, WWW '09.

[14]  Bingbing Ni,et al.  Assistive tagging: A survey of multimedia tagging with human-computer joint exploration , 2012, CSUR.

[15]  Hao Wu,et al.  Hierarchical Neural Language Models for Joint Representation of Streaming Documents and their Content , 2015, WWW.

[16]  Jason Weston,et al.  Learning to rank recommendations with the k-order statistic loss , 2013, RecSys.

[17]  John Langford,et al.  Proceedings of the 29th International Conference on Machine Learning (ICML-12) , 2012, ArXiv.

[18]  Lars Schmidt-Thieme,et al.  Learning optimal ranking with tensor factorization for tag recommendation , 2009, KDD.

[19]  Nikolas Landia Utilising document content for tag recommendation in folksonomies , 2012, RecSys '12.

[20]  Chong Wang,et al.  Collaborative topic modeling for recommending scientific articles , 2011, KDD.

[21]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[22]  Dit-Yan Yeung,et al.  Relational Stacked Denoising Autoencoder for Tag Recommendation , 2015, AAAI.

[23]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[24]  H. J. Mclaughlin,et al.  Learn , 2002 .

[25]  Quoc V. Le,et al.  Distributed Representations of Sentences and Documents , 2014, ICML.

[26]  Jason Weston,et al.  Label Partitioning For Sublinear Ranking , 2013, ICML.

[27]  Wu-Jun Li,et al.  Relation regularized matrix factorization , 2009, IJCAI 2009.

[28]  Alfred Kobsa,et al.  Proceedings of the 8th ACM Conference on Recommender systems , 2014, RecSys 2014.

[29]  Jane Yung-jen Hsu,et al.  A Content-Based Method to Enhance Tag Recommendation , 2009, IJCAI.

[30]  Jason Weston,et al.  WSABIE: Scaling Up to Large Vocabulary Image Annotation , 2011, IJCAI.

[31]  Ingmar Weber,et al.  Personalized, interactive tag recommendation for flickr , 2008, RecSys '08.

[32]  Jianping Fan,et al.  Leveraging loosely-tagged images and inter-object correlations for tag recommendation , 2010, ACM Multimedia.