Predicting the popularity of micro-videos via a feature-discrimination transductive model

Nowadays, with the development of social media networks, micro-videos, an emerging form of user-generated contents (UGCs), are gradually attracting greater interest. Some of them are widely spread, while others draw little attention. The popular micro-videos have significant commercial potential in many ways, such as online advertising and bandwidth allocation. In recent years, the popularity prediction of long videos, web images and texts have gained abundant theoretical support and made great practical success. However, little research has been conducted on micro-videos. There are three difficulties in dealing with the problem: (1) micro-videos are short in duration; (2) the quality of micro-videos is relatively poor; (3) micro-videos can be described by multiple heterogeneous features involving social, visual, acoustic and textual modalities. For these purposes, we presented a feature-discrimination transductive model (FDTM). The proposed method regards the multi-view features as two properties: the low-level features and the attribute features. We divided the micro-videos into different levels of popularity via the attribute features and predicted the popularity scores via the low-level features precisely. Moreover, in the process of prediction, we sought a latent common feature subspace, where the micro-videos can be comprehensively represented. The latent subspace can aggregate the multiple low-level feature information to alleviate the problem of information insufficiency. Extensive experiments on a public dataset show that the proposed method achieves significant improvements compared with the best-known models.

[1]  Jintao Zhang,et al.  Inductive multi-task learning with multiple view data , 2012, KDD.

[2]  Andrew Y. Ng,et al.  Zero-Shot Learning Through Cross-Modal Transfer , 2013, NIPS.

[3]  J. Shawe-Taylor,et al.  Multi-View Canonical Correlation Analysis , 2010 .

[4]  Yi Yang,et al.  Beyond Doctors: Future Health Prediction from Multimedia and Multimodal Observations , 2015, ACM Multimedia.

[5]  Mi Wang,et al.  Research on Semantic Representation to Promote the Correlation of Instructional Micro Video , 2015, 2015 11th International Conference on Computational Intelligence and Security (CIS).

[6]  Tat-Seng Chua,et al.  Micro Tells Macro: Predicting the Popularity of Micro-Videos via a Transductive Model , 2016, ACM Multimedia.

[7]  Przemysław Rokita,et al.  Predicting Popularity of Online Videos Using Support Vector Regression , 2017, IEEE Transactions on Multimedia.

[8]  Tao Chen,et al.  DeepSentiBank: Visual Sentiment Concept Classification with Deep Convolutional Neural Networks , 2014, ArXiv.

[9]  Yun Fu,et al.  Low-Rank Common Subspace for Multi-view Learning , 2014, 2014 IEEE International Conference on Data Mining.

[10]  J. H. Zar,et al.  Significance Testing of the Spearman Rank Correlation Coefficient , 1972 .

[11]  Dong Liu,et al.  Towards a comprehensive computational model foraesthetic assessment of videos , 2013, MM '13.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[14]  Luming Zhang,et al.  Action2Activity: Recognizing Complex Activities from Sensor Data , 2015, IJCAI.

[15]  Hongbin Zha,et al.  Visual analysis of child-adult interactive behaviors in video sequences , 2010, 2010 16th International Conference on Virtual Systems and Multimedia.

[16]  Ren Liu,et al.  The Impact of Q-Matrix Designs on Diagnostic Classification Accuracy in the Presence of Attribute Hierarchies , 2017, Educational and psychological measurement.

[17]  Gao Cong,et al.  On predicting the popularity of newly emerging hashtags in Twitter , 2013, J. Assoc. Inf. Sci. Technol..

[18]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[19]  Yongdong Zhang,et al.  Community Discovery from Social Media by Low-Rank Matrix Recovery , 2015, ACM Trans. Intell. Syst. Technol..

[20]  Luming Zhang,et al.  Multiple Social Network Learning and Its Application in Volunteerism Tendency Prediction , 2015, SIGIR.

[21]  Yan Liu,et al.  A Unified Framework of Latent Feature Learning in Social Media , 2014, IEEE Transactions on Multimedia.

[22]  Alberto Del Bimbo,et al.  Image Popularity Prediction in Social Media Using Sentiment and Context Features , 2015, ACM Multimedia.

[23]  Ke Xu,et al.  On popularity prediction of videos shared in online social networks , 2013, CIKM.

[24]  Yi-Liang Zhao,et al.  Volunteerism Tendency Prediction via Harvesting Multiple Social Networks , 2016, ACM Trans. Inf. Syst..

[25]  Zi Huang,et al.  Multi-Feature Fusion via Hierarchical Regression for Multimedia Analysis , 2013, IEEE Transactions on Multimedia.

[26]  Lada A. Adamic,et al.  The role of social networks in information diffusion , 2012, WWW.

[27]  Richa Singh,et al.  Attack-Resistant aiCAPTCHA Using a Negative Selection Artificial Immune System , 2017, 2017 IEEE Security and Privacy Workshops (SPW).

[28]  Brian D. Davison,et al.  Predicting popular messages in Twitter , 2011, WWW.

[29]  Tat-Seng Chua,et al.  Shorter-is-Better: Venue Category Estimation from Micro-Video , 2016, ACM Multimedia.

[30]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[31]  Raffay Hamid,et al.  What makes an image popular? , 2014, WWW.

[32]  Shiguang Shan,et al.  Multi-View Discriminant Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Luis E. Ortiz,et al.  Chic or Social: Visual Popularity Analysis in Online Fashion Networks , 2014, ACM Multimedia.

[34]  Lyle H. Ungar,et al.  Beyond Binary Labels: Political Ideology Prediction of Twitter Users , 2017, ACL.

[35]  Virgílio A. F. Almeida,et al.  Characterizing user behavior in online social networks , 2009, IMC '09.

[36]  Alberto Del Bimbo,et al.  Web Video Popularity Prediction using Sentiment and Content Visual Features , 2016, ICMR.

[37]  Airfares 2002Q,et al.  MULTIPLE LINEAR REGRESSION , 2006, Statistical Methods for Biomedical Research.

[38]  Hongbin Zha,et al.  Fusion of low-and high-dimensional approaches by trackers sampling for generic human motion tracking , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[39]  David S. Rosenblum,et al.  From action to activity: Sensor-based activity recognition , 2016, Neurocomputing.

[40]  Christoph H. Lampert,et al.  Attribute-Based Classification for Zero-Shot Visual Object Categorization , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Feiping Nie,et al.  Multi-View Clustering and Feature Learning via Structured Sparsity , 2013, ICML.

[42]  Yu Zheng,et al.  Urban Water Quality Prediction Based on Multi-Task Multi-View Learning , 2016, IJCAI.

[43]  R. Kitai,et al.  The Tandem Etalon Magnetograph of the Solar Magnetic Activity Research Telescope (SMART) at Hida Observatory , 2014 .

[44]  Charless C. Fowlkes,et al.  The Open World of Micro-Videos , 2016, ArXiv.

[45]  Silvio Savarese,et al.  Recognizing human actions by attributes , 2011, CVPR 2011.

[46]  Jingyuan Chen,et al.  Multi-Modal Learning: Study on A Large-Scale Micro-Video Data Collection , 2016, ACM Multimedia.

[47]  Cun-Hui Zhang,et al.  The sparsity and bias of the Lasso selection in high-dimensional linear regression , 2008, 0808.0967.

[48]  Xiaohua Hu,et al.  Video Popularity Prediction by Sentiment Propagation via Implicit Network , 2015, CIKM.

[49]  Bin Zhang,et al.  Micro-video Segmentation Based on Histogram and Local Optimal Solution Method , 2015, IGTA.

[50]  Tao Mei,et al.  Towards Cross-Domain Learning for Social Video Popularity Prediction , 2013, IEEE Transactions on Multimedia.

[51]  Joemon M. Jose,et al.  "Nobody comes here anymore, it's too crowded"; Predicting Image Popularity on Flickr , 2014, ICMR.

[52]  Shiliang Sun,et al.  Multiview Uncorrelated Discriminant Analysis , 2016, IEEE Transactions on Cybernetics.