An Integral Tag Recommendation Model for Textual Content

Recommending suitable tags for online textual content is a key building block for better content organization and consumption. In this paper, we identify three pillars that impact the accuracy of tag recommendation: (1) sequential text modeling meaning that the intrinsic sequential ordering as well as different areas of text might have an important implication on the corresponding tag(s) , (2) tag correlation meaning that the tags for a certain piece of textual content are often semantically correlated with each other, and (3) content-tag overlapping meaning that the vocabularies of content and tags are overlapped. However, none of the existing methods consider all these three aspects, leading to a suboptimal tag recommendation. In this paper, we propose an integral model to encode all the three aspects in a coherent encoder-decoder framework. In particular, (1) the encoder models the semantics of the textual content via Recurrent Neural Networks with the attention mechanism, (2) the decoder tackles the tag correlation with a prediction path, and (3) a shared embedding layer and an indicator function across encoder-decoder address the content-tag overlapping. Experimental results on three realworld datasets demonstrate that the proposed method significantly outperforms the existing methods in terms of recommendation accuracy.

[1]  Yang Li,et al.  Hashtag Recommendation with Topical Attention-Based LSTM , 2016, COLING.

[2]  Jianyong Wang,et al.  Incorporating heterogeneous information for personalized tag recommendation in social tagging systems , 2012, KDD.

[3]  Roelof van Zwol,et al.  Flickr tag recommendation based on collective knowledge , 2008, WWW.

[4]  Rong Pan,et al.  Personalized Tag Recommendation through Nonlinear Tensor Factorization Using Gaussian Kernel , 2015, AAAI.

[5]  Yu Wang,et al.  A Fast KNN Algorithm for Text Categorization , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[6]  Panagiotis Symeonidis,et al.  Tag recommendations based on tensor dimensionality reduction , 2008, RecSys '08.

[7]  Zheng Liu,et al.  Ranking on heterogeneous manifolds for tag recommendation in social tagging services , 2015, Neurocomputing.

[8]  Miao Xu,et al.  Speedup Matrix Completion with Side Information: Application to Multi-Label Learning , 2013, NIPS.

[9]  Xavier Serra,et al.  Class-based tag recommendation and user-based evaluation in online audio clip sharing , 2014, Knowl. Based Syst..

[10]  Jia Li,et al.  Tweet modeling with LSTM recurrent neural networks for hashtag recommendation , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[11]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[12]  David Carmel,et al.  Social media recommendation based on people and tags , 2010, SIGIR.

[13]  Ralf Krestel,et al.  Latent dirichlet allocation for tag recommendation , 2009, RecSys '09.

[14]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[15]  Dit-Yan Yeung,et al.  Relational Stacked Denoising Autoencoder for Tag Recommendation , 2015, AAAI.

[16]  Gilad Mishne,et al.  AutoTag: a collaborative approach to automated tag assignment for weblog posts , 2006, WWW '06.

[17]  Xin Li,et al.  Tag-based social interest discovery , 2008, WWW.

[18]  Ye Wang,et al.  Large-scale music tag recommendation with explicit multiple attributes , 2010, ACM Multimedia.

[19]  Yongkang Xiao,et al.  Automatic Question Tagging with Deep Neural Networks , 2019, IEEE Transactions on Learning Technologies.

[20]  Jussara M. Almeida,et al.  A survey on tag recommendation methods , 2017, J. Assoc. Inf. Sci. Technol..

[21]  Yaxin Bi,et al.  An kNN Model-Based Approach and Its Application in Text Categorization , 2004, CICLing.

[22]  Jing Liu,et al.  Personalized Geo-Specific Tag Recommendation for Photos on Social Websites , 2014, IEEE Transactions on Multimedia.

[23]  Luciano Sbaiz,et al.  Finding meaning on YouTube: Tag recommendation and category discovery , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Jason Weston,et al.  #TagSpace: Semantic Embeddings from Hashtags , 2014, EMNLP.

[25]  Mohan S. Kankanhalli,et al.  ConTagNet: Exploiting User Context for Image Tag Recommendation , 2016, ACM Multimedia.

[26]  Feng Xu,et al.  Tag2Word: Using Tags to Generate Words for Content Based Tag Recommendation , 2016, CIKM.

[27]  Wei Xu,et al.  CNN-RNN: A Unified Framework for Multi-label Image Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Qi Zhang,et al.  Hashtag Recommendation Using Attention-Based Convolutional Neural Network , 2016, IJCAI.

[29]  Dominik Kowald,et al.  Recommending tags with a model of human categorization , 2013, CIKM.

[30]  Ramesh Nallapati,et al.  Labeled LDA: A supervised topic model for credit attribution in multi-labeled corpora , 2009, EMNLP.

[31]  Wu-Jun Li,et al.  Collaborative Topic Regression with Social Regularization for Tag Recommendation , 2013, IJCAI.

[32]  Xuanjing Huang,et al.  Hashtag Recommendation for Multimodal Microblog Using Co-Attention Network , 2017, IJCAI.

[33]  Qiudan Li,et al.  A recommender system based on tag and time information for social tagging systems , 2011, Expert Syst. Appl..

[34]  Feng Xu,et al.  Guiding supervised topic modeling for content based tag recommendation , 2018, Neurocomputing.