Mention Recommendation for Twitter with End-to-end Memory Network

In this study, we investigated the problem of recommending usernames when people attempt to use the “@” sign to mention other people in twitter-like social media. With the extremely rapid development of social networking services, this problem has received considerable attention in recent years. Previous methods have studied the problem from different aspects. Because most of Twitter-like microblogging services limit the length of posts, statistical learning methods may be affected by the problems of word sparseness and synonyms. Although recent progress in neural word embedding methods have advanced the state-of-the-art in many natural language processing tasks, the benefits of word embedding have not been taken into consideration for this problem. In this work, we proposed a novel end-to-end memory network architecture to perform this task. We incorporated the interests of users with external memory. A hierarchical attention mechanism was also applied to better consider the interests of users. The experimental results on a dataset we collected from Twitter demonstrated that the proposed method could outperform stateof-the-art approaches.

[1]  W. Bruce Croft,et al.  User oriented tweet ranking: a filtering approach to microblogs , 2011, CIKM '11.

[2]  Xiang Zhang,et al.  Evaluating Prerequisite Qualities for Learning End-to-End Dialog Systems , 2015, ICLR.

[3]  Chuang Liu,et al.  A Novel Approach for Generating Personalized Mention List on Micro-Blogging System , 2015, 2015 IEEE International Conference on Data Mining Workshop (ICDMW).

[4]  Danqi Chen,et al.  A Fast and Accurate Dependency Parser using Neural Networks , 2014, EMNLP.

[5]  Richard Socher,et al.  Ask Me Anything: Dynamic Memory Networks for Natural Language Processing , 2015, ICML.

[6]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[7]  Hui Xiong,et al.  Locating targets through mention in Twitter , 2015, World Wide Web.

[8]  Sergey Levine,et al.  End-to-End Training of Deep Visuomotor Policies , 2015, J. Mach. Learn. Res..

[9]  Chun Chen,et al.  Whom to mention: expand the diffusion of tweets by @ recommendation on micro-blogging systems , 2013, WWW '13.

[10]  Mirella Lapata,et al.  Tweet Recommendation with Graph Co-Ranking , 2012, ACL.

[11]  Li Liu,et al.  Personalized Mention Probabilistic Ranking - Recommendation on Mention Behavior of Heterogeneous Social Network , 2015, WAIM Workshops.

[12]  Dinh Phung,et al.  Journal of Machine Learning Research: Preface , 2014 .

[13]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[14]  Jason Weston,et al.  Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks , 2015, ICLR.

[15]  Jun Zhao,et al.  Relation Classification via Convolutional Deep Neural Network , 2014, COLING.

[16]  Jason Weston,et al.  Memory Networks , 2014, ICLR.

[17]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[18]  Lynda L. McGhie,et al.  World Wide Web , 2011, Encyclopedia of Information Assurance.

[19]  Jason Weston,et al.  The Goldilocks Principle: Reading Children's Books with Explicit Memory Representations , 2015, ICLR.

[20]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[21]  Jason Weston,et al.  Key-Value Memory Networks for Directly Reading Documents , 2016, EMNLP.

[22]  Aixin Sun,et al.  Hashtag recommendation for hyperlinked tweets , 2014, SIGIR.

[23]  Jason Weston,et al.  Dialog-based Language Learning , 2016, NIPS.

[24]  Jason Weston,et al.  End-To-End Memory Networks , 2015, NIPS.

[25]  Qi Zhang,et al.  Hashtag Recommendation Using Attention-Based Convolutional Neural Network , 2016, IJCAI.

[26]  Dirk Weissenborn,et al.  Separating Answers from Queries for Neural Reading Comprehension , 2016, ArXiv.