Graph Neural Network for Tag Ranking in Tag-enhanced Video Recommendation

In tag-enhanced video recommendation systems, videos are attached with some tags that highlight the contents of videos from different aspects. Tag ranking in such recommendation systems provides personalized tag lists for videos from their tag candidates. A better tag ranking model could attract users to click more tags, enter their corresponding tag channels, and watch more tag-specific videos, which improves both tag click rate and video watching time. However, most conventional tag ranking models merely concentrate on tag-video relevance or tag-related behaviors, ignoring the rich information in video-related behaviors. We should consider user preferences on both tags and videos. In this paper, we propose a novel Graph neural network based tag ranking (GraphTR) framework on a huge heterogeneous network with video, tag, user and media. We design a novel graph neural network that combines multi-field transformer, GraphSAGE and neural FM layers in node aggregation. We also propose a neighbor-similarity based loss to encode various user preferences into heterogeneous node representations. In experiments, we conduct both offline and online evaluations on a real-world video recommendation system in WeChat Top Stories. The significant improvements in both video and tag related metrics confirm the effectiveness and robustness in real-world tag-enhanced video recommendation. Currently, GraphTR has been deployed on WeChat Top Stories for more than six months. The source codes are in https://github.com/lqfarmer/GraphTR.

[1]  Lei Huang,et al.  Saliency detection on sampled images for tag ranking , 2017, Multimedia Systems.

[2]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[3]  Roelof van Zwol,et al.  Flickr tag recommendation based on collective knowledge , 2008, WWW.

[4]  Jussara M. Almeida,et al.  A survey on tag recommendation methods , 2017, J. Assoc. Inf. Sci. Technol..

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[7]  Hebatallah A. Mohamed Hassan,et al.  Semantic-based tag recommendation in scientific bookmarking systems , 2018, RecSys.

[8]  Yuan He,et al.  Graph Neural Networks for Social Recommendation , 2019, WWW.

[9]  Alejandro Bellogín,et al.  Content-based recommendation in social tagging systems , 2010, RecSys '10.

[10]  Lars Schmidt-Thieme,et al.  Pairwise interaction tensor factorization for personalized tag recommendation , 2010, WSDM '10.

[11]  Xing Xie,et al.  Session-based Recommendation with Graph Neural Networks , 2018, AAAI.

[12]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[13]  Ping Jian,et al.  Tag Recommendation by Word-Level Tag Sequence Modeling , 2019, DASFAA.

[14]  Yizhou Sun,et al.  Heterogeneous Graph Transformer , 2020, WWW.

[15]  Wesley De Neve,et al.  Using topic models for Twitter hashtag recommendation , 2013, WWW.

[16]  Haofen Wang,et al.  Personalized Time-Aware Tag Recommendation , 2018, AAAI.

[17]  Nitesh V. Chawla,et al.  Heterogeneous Graph Neural Network , 2019, KDD.

[18]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[19]  Yu He,et al.  The YouTube video recommendation system , 2010, RecSys '10.

[20]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[21]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[22]  Yanfang Ye,et al.  Heterogeneous Graph Attention Network , 2019, WWW.

[23]  Yongliang Li,et al.  Metapath-guided Heterogeneous Graph Neural Network for Intent Recommendation , 2019, KDD.

[24]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[25]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[26]  Dong Liu,et al.  Tag ranking , 2009, WWW '09.

[27]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[28]  Wenyan Liu,et al.  Attention-Based Neural Tag Recommendation , 2019, DASFAA.

[29]  Jian Tang,et al.  AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networks , 2018, CIKM.

[30]  Wei Zhang,et al.  Dynamic Graph Representation Learning via Self-Attention Networks , 2018, ArXiv.

[31]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.