Wide-grained capsule network with sentence-level feature to detect meteorological event in social network

Abstract In recent years, frequent meteorological disasters have caused great concern to people. It is particularly important to timely detect the meteorological events and release early warning information. Most traditional meteorological event detection methods rely on physical sensors, but such practice is usually costly and inflexible. As a new form of lightweight social sensor, social networks make up for the shortcomings of traditional physical sensors. In this paper, we propose a sentence-level feature-based meteorological event detection model to detect 14 types of meteorological events defined by the China Meteorological Administration (CMA) in Sina Weibo. Our joint model consists of two modules: a fine-tuned BERT as the language model and a wide-grained capsule network as the event detection network. The design of our model considers the correlation among meteorological events and achieves the best results on all metrics compared with other baseline models. Moreover, as a practical application, our model has been applied to the meteorological event monitoring platform in the CMA Public Meteorological Service Center to provide online services.

[1]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[2]  Mohamed A. Sharaf,et al.  Emerging event detection in social networks with location sensitivity , 2014, World Wide Web.

[3]  Yutaka Matsuo,et al.  Tweet Analysis for Real-Time Event Detection and Earthquake Reporting System Development , 2013, IEEE Transactions on Knowledge and Data Engineering.

[4]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[5]  Hanan Samet,et al.  TwitterStand: news in tweets , 2009, GIS.

[6]  Erik Cambria,et al.  A tale of two epidemics: Contextual Word2Vec for classifying twitter streams during outbreaks , 2019, Inf. Process. Manag..

[7]  Julio César Hernández Castro,et al.  A Survey of Social Web Mining Applications for Disease Outbreak Detection , 2014, IDC.

[8]  Zhendong Niu,et al.  News topic detection based on hierarchical clustering and named entity , 2011, 2011 7th International Conference on Natural Language Processing and Knowledge Engineering.

[9]  Zhendong Niu,et al.  Automatic construction of domain-specific sentiment lexicon based on constrained label propagation , 2014, Knowl. Based Syst..

[10]  Min Yang,et al.  Investigating Capsule Networks with Dynamic Routing for Text Classification , 2018, EMNLP.

[11]  Antonio González-Pardo,et al.  Extracting Radicalisation Behavioural Patterns from Social Network Data , 2017, 2017 28th International Workshop on Database and Expert Systems Applications (DEXA).

[12]  Ana-Maria Popescu,et al.  Extracting events and event descriptions from Twitter , 2011, WWW.

[13]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[14]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[15]  Haofen Wang,et al.  Towards Effective Event Detection, Tracking and Summarization on Microblog Data , 2011, WAIM.

[16]  Antonio González-Pardo,et al.  Statistical analysis of risk assessment factors and metrics to evaluate radicalisation in Twitter , 2017, Future Gener. Comput. Syst..

[17]  Oladimeji Farri,et al.  Adverse Drug Event Detection in Tweets with Semi-Supervised Convolutional Neural Networks , 2017, WWW.

[18]  Jianxin Li,et al.  An Efficient Approach to Event Detection and Forecasting in Dynamic Multivariate Social Media Networks , 2017, WWW.

[19]  Jing Gao,et al.  A deep learning approach for detecting traffic accidents from social media data , 2018, ArXiv.

[20]  Yiming Yang,et al.  An Evaluation of Statistical Approaches to Text Categorization , 1999, Information Retrieval.

[21]  T. Murata,et al.  Breaking News Detection and Tracking in Twitter , 2010, 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[22]  Zhendong Niu,et al.  Using Adverse Weather Data in Social Media to Assist with City-Level Traffic Situation Awareness and Alerting , 2018, Applied Sciences.

[23]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[24]  Yifan Zhu,et al.  An opinion based cross‐regional meteorological event detection model , 2018, Weather.

[25]  Wenji Mao,et al.  Mining User Intents in Online Interactions: Applying to Discussions About Medical Event on SinaWeibo Platform , 2017, ICSH.

[26]  Zhendong Niu,et al.  Knowledge-based recommendation: a review of ontology-based recommender systems for e-learning , 2017, Artificial Intelligence Review.

[27]  Ana-Maria Popescu,et al.  Detecting controversial events from twitter , 2010, CIKM.

[28]  Kevin Heaslip,et al.  Developing a Twitter-based traffic event detection model using deep learning architectures , 2019, Expert Syst. Appl..

[29]  Liuqing Yang,et al.  Big Data for Social Transportation , 2016, IEEE Transactions on Intelligent Transportation Systems.

[30]  Flora Amato,et al.  Extreme events management using multimedia social networks , 2019, Future Gener. Comput. Syst..

[31]  David Camacho,et al.  Ontology Uses for Radicalisation Detection on Social Networks , 2018, IDEAL.

[32]  Daniel Dajun Zeng,et al.  A survey on big data-driven digital phenotyping of mental health , 2019, Inf. Fusion.

[33]  Bianca Zadrozny,et al.  Correlation analysis of performance measures for multi-label classification , 2018, Inf. Process. Manag..

[34]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[35]  Wael Khreich,et al.  A Survey of Techniques for Event Detection in Twitter , 2015, Comput. Intell..

[36]  Ana M. García-Serrano,et al.  Formal concept analysis for topic detection: A clustering quality experimental analysis , 2017, Inf. Syst..

[37]  Jai E. Jung,et al.  Real-time event detection for online behavioral analysis of big social data , 2017, Future Gener. Comput. Syst..

[38]  Yutaka Matsuo,et al.  Earthquake shakes Twitter users: real-time event detection by social sensors , 2010, WWW '10.

[39]  Djamal Benslimane,et al.  Measuring the Radicalisation Risk in Social Networks , 2017, IEEE Access.

[40]  Ross Maciejewski,et al.  A Visual Analytics Framework for Identifying Topic Drivers in Media Events , 2018, IEEE Transactions on Visualization and Computer Graphics.

[41]  Zhendong Niu,et al.  Sensing Urban Transportation Events from Multi-Channel Social Signals with the Word2vec Fusion Model , 2018, Sensors.

[42]  Zhendong Niu,et al.  A hybrid knowledge-based recommender system for e-learning based on ontology and sequential pattern mining , 2017, Future Gener. Comput. Syst..

[43]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[44]  Yiming Yang,et al.  Deep Learning for Extreme Multi-label Text Classification , 2017, SIGIR.

[45]  Eleonora D'Andrea,et al.  Monitoring the public opinion about the vaccination topic from tweets analysis , 2019, Expert Syst. Appl..