Multimodal Context-Aware Recommender for Post Popularity Prediction in Social Media

Millions of multimodal posts are uploaded, shared, viewed and liked every day in different social networks, where users express their opinions about different items such as products and places. While, some user posts become popular, others are ignored. Even different posts related to the same items shared by different users receive different number of likes and views. Existing research on popularity prediction aggregate all user posts related to different items without considering the preferences of individual user for the items in training a popularity model. This often results in limited success. We hypothesize that popularity of posts differs from one user to the other user, one item to the other items, and posts related to the similar users or similar items may be received the same number of likes. In this paper, we present an approach for predicting the popularity of user posts by considering preferences of individual users to the items. We factorize the popularity of posts to the user-item-context and propose a multimodal context-aware recommender for predicting the popularity of posts. Using our proposal we have the ability of predicting the popularity of posts related to different items which are shared by a specific user. Moreover we are able to predict the popularity of posts shared with different users for a specific item. We evaluate our approach on an Instagram user posts dataset with over 600K posts in total related to different touristic places, as items, in The Netherlands for the task of popularity prediction.

[1]  Raffay Hamid,et al.  What makes an image popular? , 2014, WWW.

[2]  Dong Wang,et al.  Click-through Prediction for Advertising in Twitter Timeline , 2015, KDD.

[3]  ThelwallMike,et al.  Sentiment strength detection in short informal text , 2010 .

[4]  Marcel Worring,et al.  Multimodal Popularity Prediction of Brand-related Social Media Posts , 2016, ACM Multimedia.

[5]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[6]  Mike Thelwall,et al.  Sentiment in short strength detection informal text , 2010 .

[7]  Yiqun Liu,et al.  Predicting the popularity of web 2.0 items based on user comments , 2014, SIGIR.

[8]  Yongdong Zhang,et al.  Time Matters: Multi-scale Temporalization of Social Media Popularity , 2016, ACM Multimedia.

[9]  Chris H. Q. Ding,et al.  Robust nonnegative matrix factorization using L21-norm , 2011, CIKM '11.

[10]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[11]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[12]  Rongrong Ji,et al.  Large-scale visual sentiment ontology and detectors using adjective noun pairs , 2013, ACM Multimedia.

[13]  Yongdong Zhang,et al.  Unfolding Temporal Dynamics: Predicting Social Media Popularity Using Multi-scale Temporal Decomposition , 2016, AAAI.

[14]  Tao Mei,et al.  Learning to personalize trending image search suggestion , 2014, SIGIR.

[15]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[16]  Lifeng Sun,et al.  Propagation-based social-aware multimedia content distribution , 2013, TOMCCAP.

[17]  Tao Mei,et al.  Predicting Image Popularity in an Incomplete Social Media Community by a Weighted Bi-partite Graph , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[18]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Dong Liu,et al.  Encoding Concept Prototypes for Video Event Detection and Summarization , 2015, ICMR.

[20]  Joemon M. Jose,et al.  "Nobody comes here anymore, it's too crowded"; Predicting Image Popularity on Flickr , 2014, ICMR.

[21]  Lars Schmidt-Thieme,et al.  Fast context-aware recommendations with factorization machines , 2011, SIGIR.

[22]  Alberto Del Bimbo,et al.  Image Popularity Prediction in Social Media Using Sentiment and Context Features , 2015, ACM Multimedia.

[23]  Brian D. Davison,et al.  Predicting popular messages in Twitter , 2011, WWW.

[24]  Hongchul Lee,et al.  Sentiment analysis of twitter audiences: Measuring the positive or negative influence of popular twitterers , 2012, J. Assoc. Inf. Sci. Technol..

[25]  Cees Snoek,et al.  Latent Factors of Visual Popularity Prediction , 2015, ICMR.

[26]  Xirong Li,et al.  TagBook: A Semantic Video Representation Without Supervision for Event Detection , 2015, IEEE Transactions on Multimedia.

[27]  Ming-Syan Chen,et al.  UbiShop: Commercial item recommendation using visual part-based object representation , 2016, Multimedia Tools and Applications.