DeepBlue: Bi-layered LSTM for tweet popUlarity Estimation

In social networks, one of the most significant challenges is how to estimate the tweet popularity. Prior studies about this problem focus on leveraging different aspects of just a single tweet, while ignoring the impact of historical tweets. In this paper, we propose to leverage such historical information and rethink the problem of tweet popularity estimation. From historical information, there are two important factors that can be extracted: (1) user reputation feature, which can represent coarse-grained level of tweet popularity; (2) tweet related features, which can represent fine-grained level of tweet popularity. To incorporate two factors from historical information, we design a novel deep neural architecture, a Bi-layered LSTM for tweet popUlarity Estimation, called DeepBlue. Specifically, we first propose a user-reputation aware mechanism to combine coarse-grained and fine-grained level estimation into a unified LSTM model. We then propose a time aware mechanism to address the time interval irregularity issue in standard LSTM. Finally, we apply the Poisson regression model to obtain the overall loss for tweet popularity estimation. Extensive experiments demonstrate the superiority of our proposed approach to other state-of-the-arts in terms of MAE and SRC.

[1]  Xueqi Cheng,et al.  Modeling and Predicting Retweeting Dynamics via a Mixture Process , 2016, WWW.

[2]  Swapnil Mishra,et al.  Feature Driven and Point Process Approaches for Popularity Prediction , 2016, CIKM.

[3]  Mari Ostendorf,et al.  Conversation Modeling on Reddit Using a Graph-Structured LSTM , 2017, TACL.

[4]  Albert-László Barabási,et al.  Modeling and Predicting Popularity Dynamics via Reinforced Poisson Processes , 2014, AAAI.

[5]  Yongdong Zhang,et al.  Time Matters: Multi-scale Temporalization of Social Media Popularity , 2016, ACM Multimedia.

[6]  Nicholas Jing Yuan,et al.  Who Will Reply to/Retweet This Tweet?: The Dynamics of Intimacy from Online Social Interactions , 2016, WSDM.

[7]  E. Rogers,et al.  Diffusion of innovations , 1964, Encyclopedia of Sport Management.

[8]  Alberto Del Bimbo,et al.  Web Video Popularity Prediction using Sentiment and Content Visual Features , 2016, ICMR.

[9]  Dan Cosley,et al.  Predictability of Popularity: Gaps between Prediction and Understanding , 2016, ICWSM.

[10]  Lada A. Adamic,et al.  Detecting Large Reshare Cascades in Social Networks , 2017, WWW.

[11]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[12]  Le Song,et al.  Shaping Social Activity by Incentivizing Users , 2014, NIPS.

[13]  Marcel Worring,et al.  Multimodal Popularity Prediction of Brand-related Social Media Posts , 2016, ACM Multimedia.

[14]  Xuanjing Huang,et al.  Retweet Prediction with Attention-based Deep Neural Network , 2016, CIKM.

[15]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[16]  Niklas Carlsson,et al.  The untold story of the clones: content-agnostic factors that impact YouTube video popularity , 2012, KDD.

[17]  Duncan J. Watts,et al.  Exploring Limits to Prediction in Complex Social Systems , 2016, WWW.

[18]  Meng Zhang,et al.  Multi-feature Fusion for Predicting Social Media Popularity , 2017, ACM Multimedia.

[19]  Xueqi Cheng,et al.  Popularity prediction in microblogging network: a case study on sina weibo , 2013, WWW.

[20]  Amir Globerson,et al.  Discriminative Learning of Infection Models , 2016, WSDM.

[21]  Niloy Ganguly,et al.  LMPP: A Large Margin Point Process Combining Reinforcement and Competition for Modeling Hashtag Popularity , 2017, IJCAI.

[22]  Yongdong Zhang,et al.  Sequential Prediction of Social Media Popularity with Deep Temporal Context Networks , 2017, IJCAI.

[23]  Miles Osborne,et al.  RT to Win! Predicting Message Propagation in Twitter , 2011, ICWSM.

[24]  Renaud Lambiotte,et al.  TiDeH: Time-Dependent Hawkes Process for Predicting Retweet Dynamics , 2016, ICWSM.

[25]  Le Song,et al.  Estimating Diffusion Network Structures: Recovery Conditions, Sample Complexity & Soft-thresholding Algorithm , 2014, ICML.

[26]  Tomasz Trzcinski,et al.  Shallow Reading with Deep Learning: Predicting Popularity of Online Content Using only Its Title , 2017, ISMIS.

[27]  Ralf Herbrich,et al.  Predicting Information Spreading in Twitter , 2010 .

[28]  Le Song,et al.  Learning Networks of Heterogeneous Influence , 2012, NIPS.

[29]  Yongdong Zhang,et al.  Unfolding Temporal Dynamics: Predicting Social Media Popularity Using Multi-scale Temporal Decomposition , 2016, AAAI.

[30]  Luis E. Ortiz,et al.  Chic or Social: Visual Popularity Analysis in Online Fashion Networks , 2014, ACM Multimedia.

[31]  Isabel Valera,et al.  Modeling Adoption and Usage of Competing Products , 2014, 2015 IEEE International Conference on Data Mining.

[32]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[33]  Jan-Michael Frahm,et al.  Retweet Wars: Tweet Popularity Prediction via Dynamic Multimodal Regression , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[34]  Niklas Carlsson,et al.  Characterizing and modelling popularity of user-generated videos , 2011, Perform. Evaluation.

[35]  Gleb Gusev,et al.  Prediction of retweet cascade size over time , 2012, CIKM.

[36]  Jure Leskovec,et al.  SEISMIC: A Self-Exciting Point Process Model for Predicting Tweet Popularity , 2015, KDD.

[37]  Niloy Ganguly,et al.  Learning and Forecasting Opinion Dynamics in Social Networks , 2015, NIPS.

[38]  Rediet Abebe.  Can Cascades be Predicted? , 2014 .

[39]  Cheng-Te Li,et al.  PSEISMIC: A personalized self-exciting point process model for predicting tweet popularity , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[40]  Brian D. Davison,et al.  Predicting popular messages in Twitter , 2011, WWW.

[41]  Tat-Seng Chua,et al.  Micro Tells Macro: Predicting the Popularity of Micro-Videos via a Transductive Model , 2016, ACM Multimedia.

[42]  Bernhard Schölkopf,et al.  Modeling Information Propagation with Survival Theory , 2013, ICML.

[43]  Flavio Figueiredo,et al.  On the prediction of popularity of trends and hits for user generated videos , 2013, WSDM.

[44]  Andrea Tagarelli,et al.  Online popularity and topical interests through the lens of instagram , 2014, HT.

[45]  Jure Leskovec,et al.  Inferring networks of diffusion and influence , 2010, KDD.

[46]  Zhe Zhao,et al.  Predicting bursts and popularity of hashtags in real-time , 2014, SIGIR.

[47]  Thomas Gottron,et al.  Bad news travel fast: a content-based analysis of interestingness on Twitter , 2011, WebSci '11.

[48]  Ari Rappoport,et al.  What's in a hashtag?: content based prediction of the spread of ideas in microblogging communities , 2012, WSDM '12.