A hashtag-based sub-event detection framework for social media

Abstract Sub-event detection for social media is getting increasingly important because social media platforms have played key roles in disseminating vital information to the public. However, conventional methods fail to achieve high-quality analysis of events evolution due to the severe sparseness and noise of tweets data. In this paper, we propose an unsupervised sub-event detection model which learns rich information from hashtags with a Text-CNN model. Furthermore, a two steps training method leveraged by KL divergence is introduced to further reduce the negative influence of incoherent semantics. The experiments show that our method achieves very good performance on datasets of different languages. On the Chinese dataset, in terms of NMI, and BCubed F1 precision, our method has a significant increase of 5.1%, and 11.9%, respectively, over the baseline methods. In most cases, our method significantly improves the performance of sub-event detection compared with state-of-the-art methods.

[1]  Durga Toshniwal,et al.  Sub-event detection during natural hazards using features of social media data , 2013, WWW.

[2]  Hermann Hellwagner,et al.  Supporting Crisis Management via Sub-event Detection in Social Networks , 2012, 2012 IEEE 21st International Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises.

[3]  Vasudeva Varma,et al.  Deep Learning for Hate Speech Detection in Tweets , 2017, WWW.

[4]  Michalis Vazirgiannis,et al.  An Optimization Approach for Sub-event Detection and Summarization in Twitter , 2018, ECIR.

[5]  Yiming Yang,et al.  A study of retrospective and on-line event detection , 1998, SIGIR '98.

[6]  Ralph Grishman,et al.  Graph Convolutional Networks With Argument-Aware Pooling for Event Detection , 2018, AAAI.

[7]  Sayan Unankard,et al.  Sub-Events Tracking from Social Network based on the Relationships between Topics , 2020, 2020 Joint International Conference on Digital Arts, Media and Technology with ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering (ECTI DAMT & NCON).

[8]  Ramesh Nallapati,et al.  Labeled LDA: A supervised topic model for credit attribution in multi-labeled corpora , 2009, EMNLP.

[9]  Hassan Sajjad,et al.  Rapid Classification of Crisis-Related Data on Social Networks using Convolutional Neural Networks , 2016, ICWSM 2016.

[10]  Wei-Ying Ma,et al.  Hashtag-Based Sub-Event Discovery Using Mutually Generative LDA in Twitter , 2016, AAAI.

[11]  Jing Li,et al.  Directional Skip-Gram: Explicitly Distinguishing Left and Right Context for Word Embeddings , 2018, NAACL.

[12]  Wenji Mao,et al.  An Encoder-Memory-Decoder Framework for Sub-Event Detection in Social Media , 2018, CIKM.

[13]  Mohammad Ghavami,et al.  A new approach for event detection using k-means clustering and neural networks , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[14]  Dong Yue,et al.  Robust low-resolution face recognition via low-rank representation and locality-constrained regression , 2018, Comput. Electr. Eng..

[15]  Yalou Huang,et al.  Hashtag Graph Based Topic Model for Tweet Mining , 2014, 2014 IEEE International Conference on Data Mining.

[16]  Huan Liu,et al.  Enhancing accessibility of microblogging messages using semantic knowledge , 2011, CIKM '11.

[17]  Hector Garcia-Molina,et al.  Overview of multidatabase transaction management , 2005, The VLDB Journal.

[18]  Huimin Lu,et al.  Motor Anomaly Detection for Unmanned Aerial Vehicles Using Reinforcement Learning , 2018, IEEE Internet of Things Journal.

[19]  Thomas Demeester,et al.  Sub-event detection from twitter streams as a sequence labeling problem , 2019, NAACL.

[20]  Yujie Li,et al.  Deep Fuzzy Hashing Network for Efficient Image Retrieval , 2021, IEEE Transactions on Fuzzy Systems.

[21]  Yujie Li,et al.  User-Oriented Virtual Mobile Network Resource Management for Vehicle Communications , 2021, IEEE Transactions on Intelligent Transportation Systems.

[22]  Hermann Hellwagner,et al.  Automatic sub-event detection in emergency management using social media , 2012, WWW.

[23]  Ali Farhadi,et al.  Unsupervised Deep Embedding for Clustering Analysis , 2015, ICML.

[24]  Yue Zhang,et al.  A Neural Model for Joint Event Detection and Summarization , 2017, IJCAI.