Real-Time Multimedia Social Event Detection in Microblog

Detecting events from massive social media data in social networks can facilitate browsing, search, and monitoring of real-time events by corporations, governments, and users. The short, conversational, heterogeneous, and real-time characteristics of social media data bring great challenges for event detection. The existing event detection approaches rely mainly on textual information, while the visual content of microblogs and the intrinsic correlation among the heterogeneous data are scarcely explored. To deal with the above challenges, we propose a novel real-time event detection method by generating an intermediate semantic level from social multimedia data, named microblog clique (MC), which is able to explore the high correlations among different microblogs. Specifically, the proposed method comprises three stages. First, the heterogeneous data in microblogs is formulated in a hypergraph structure. Hypergraph cut is conducted to group the highly correlated microblogs with the same topics as the MCs, which can address the information inadequateness and data sparseness issues. Second, a bipartite graph is constructed based on the generated MCs and the transfer cut partition is performed to detect the events. Finally, for new incoming microblogs, incremental hypergraph is constructed based on the latest MCs to generate new MCs, which are classified by bipartite graph partition into existing events or new ones. Extensive experiments are conducted on the events in the Brand-Social-Net dataset and the results demonstrate the superiority of the proposed method, as compared to the state-of-the-art approaches.

[1]  Marti A. Hearst Search User Interfaces , 2009 .

[2]  Chun Chen,et al.  Music recommendation by unified hypergraph: combining social media information and music content , 2010, ACM Multimedia.

[3]  Yue Gao,et al.  Filtering of Brand-Related Microblogs Using Social-Smooth Multiview Embedding , 2016, IEEE Transactions on Multimedia.

[4]  Qingshan Liu,et al.  Image retrieval via probabilistic hypergraph ranking , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Hector Garcia-Molina,et al.  Overview of multidatabase transaction management , 2005, The VLDB Journal.

[6]  Bu-Sung Lee,et al.  Event Detection in Twitter , 2011, ICWSM.

[7]  Yue Gao,et al.  3-D Object Retrieval and Recognition With Hypergraph Analysis , 2012, IEEE Transactions on Image Processing.

[8]  Xiaojun Chang,et al.  Revealing Event Saliency in Unconstrained Video Collection , 2017, IEEE Transactions on Image Processing.

[9]  Liujuan Cao,et al.  Toward Optimal Manifold Hashing via Discrete Locally Linear Embedding , 2017, IEEE Transactions on Image Processing.

[10]  Yue Gao,et al.  Brand Data Gathering From Live Social Media Streams , 2014, ICMR.

[11]  Jungong Han,et al.  Large-scale image retrieval with Sparse Embedded Hashing , 2017, Neurocomputing.

[12]  Yiming Yang,et al.  A study of retrospective and on-line event detection , 1998, SIGIR '98.

[13]  Philip S. Yu,et al.  Parameter Free Bursty Events Detection in Text Streams , 2005, VLDB.

[14]  James Allan,et al.  On-Line New Event Detection and Tracking , 1998, SIGIR Forum.

[15]  Ee-Peng Lim,et al.  Analyzing feature trajectories for event detection , 2007, SIGIR.

[16]  Yang Yang,et al.  Multimedia Summarization for Social Events in Microblog Stream , 2015, IEEE Transactions on Multimedia.

[17]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[18]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[19]  Changsheng Xu,et al.  Multi-Modal Event Topic Model for Social Event Analysis , 2016, IEEE Transactions on Multimedia.

[20]  J. Berger,et al.  The Intrinsic Bayes Factor for Model Selection and Prediction , 1996 .

[21]  Hila Becker,et al.  Learning similarity metrics for event identification in social media , 2010, WSDM '10.

[22]  Yuan Yan Tang,et al.  Social Image Tagging With Diverse Semantics , 2014, IEEE Transactions on Cybernetics.

[23]  Luming Zhang,et al.  Matryoshka Peek: Toward Learning Fine-Grained, Robust, Discriminative Features for Product Search , 2017, IEEE Transactions on Multimedia.

[24]  Timothy W. Finin,et al.  Why we twitter: understanding microblogging usage and communities , 2007, WebKDD/SNA-KDD '07.

[25]  Yue Gao,et al.  Event Classification in Microblogs via Social Tracking , 2017, ACM Trans. Intell. Syst. Technol..

[26]  Emmanouel A. Varvarigos,et al.  Event Detection in Twitter Microblogging , 2016, IEEE Transactions on Cybernetics.

[27]  Munmun De Choudhury,et al.  Discovering multirelational structure in social media streams , 2012, TOMCCAP.

[28]  Jie Tang,et al.  Modeling Emotion Influence in Image Social Networks , 2015, IEEE Transactions on Affective Computing.

[29]  Matthew Hurst,et al.  Event Detection and Tracking in Social Streams , 2009, ICWSM.

[30]  Yue Gao,et al.  Multimedia Social Event Detection in Microblog , 2015, MMM.

[31]  Philipp Cimiano,et al.  Event-based classification of social media streams , 2012, ICMR.

[32]  Jonathon S. Hare,et al.  Analyzing and predicting sentiment of images on the social web , 2010, ACM Multimedia.

[33]  Yue Gao,et al.  Continuous Probability Distribution Prediction of Image Emotions via Multitask Shared Sparse Regression , 2017, IEEE Transactions on Multimedia.

[34]  Yue Gao,et al.  Predicting Personalized Emotion Perceptions of Social Images , 2016, ACM Multimedia.

[35]  Feiping Nie,et al.  Revisiting Co-Saliency Detection: A Novel Approach Based on Two-Stage Multi-View Spectral Rotation Co-clustering , 2017, IEEE Transactions on Image Processing.

[36]  Thomas Gottron,et al.  Searching microblogs: coping with sparsity and document quality , 2011, CIKM '11.

[37]  Julio Gonzalo,et al.  A comparison of extrinsic clustering evaluation metrics based on formal constraints , 2008, Information Retrieval.

[38]  Urbano Nunes,et al.  Probabilistic Social Behavior Analysis by Exploring Body Motion-Based Patterns , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[41]  Mario Cataldi,et al.  Emerging topic detection on Twitter based on temporal and social terms evaluation , 2010, MDMKDD '10.

[42]  M. Shamim Hossain,et al.  Automatic Visual Concept Learning for Social Event Understanding , 2015, IEEE Transactions on Multimedia.

[43]  Hui Zhang,et al.  Propagation of Social Emotion in Cyber Space Based on Cognitive Social Psychology , 2017, IEEE Access.

[44]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[45]  Shih-Fu Chang,et al.  Segmentation using superpixels: A bipartite graph partitioning approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Hongxun Yao,et al.  Multi-modal microblog classification via multi-task learning , 2014, Multimedia Tools and Applications.

[47]  Lars Schmidt-Thieme,et al.  Scalable Event-Based Clustering of Social Media Via Record Linkage Techniques , 2011, ICWSM.

[48]  Xiangyu Wang,et al.  Logo information recognition in large-scale social media data , 2014, Multimedia Systems.

[49]  Bernhard Schölkopf,et al.  Learning with Hypergraphs: Clustering, Classification, and Embedding , 2006, NIPS.

[50]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[51]  Mohamed Daoudi,et al.  A Bayesian 3-D Search Engine Using Adaptive Views Clustering , 2007, IEEE Transactions on Multimedia.

[52]  Xirong Li,et al.  TagBook: A Semantic Video Representation Without Supervision for Event Detection , 2015, IEEE Transactions on Multimedia.

[53]  Maosong Sun,et al.  NExT: NUS-Tsinghua Center for Extreme Search of User-Generated Content , 2012, IEEE MultiMedia.