A deep learning-based social media text analysis framework for disaster resource management

Social media has evolved itself as a significant tool used by people for information spread during emergencies like natural or man-made disasters. Real-time analysis of this huge collected data can play a vital role in crisis estimation, response and assistance exercises. We propose a novel prototype system that analyzes the emergency-related tweets to classify them as need or available tweets. The presented system also takes care of non-English tweets as there is no boundary of language for social media users. Several classifiers along with different learning methodologies are used to show their usefulness for an efficient solution. Here, a new supervised learning technique based on word embedding is incorporated in the novel hybrid model that comprises of LSTM and CNN. The system will further give a ranked list of tweets, along with a relevance score for each tweet with respect to the topic. Finally for each of the identified need tweets, its corresponding availability tweets are mapped. For the mapping task, a novel two-word sliding window approach is proposed to generate the combine embedding of two adjacent words. The experimental results show significant improvement in the performance. We evaluate our proposed system with FIRE-2016 and CrisisLex datasets to illustrate its effectiveness during mobilization of needful resources.

[1]  Reda Alhajj,et al.  Machine Learning Techniques for Online Social Networks , 2018 .

[2]  James R. Curran,et al.  NNE: A Dataset for Nested Named Entity Recognition in English Newswire , 2019, ACL.

[3]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[4]  Kyoji Kawagoe,et al.  Tweet-mapping Method for Tourist Spots Based on Now-Tweets and Spot-photos , 2015, KES.

[5]  Carlos Castillo,et al.  What to Expect When the Unexpected Happens: Social Media Communications Across Crises , 2015, CSCW.

[6]  Heba Kurdi,et al.  A Tweet-Ranking System Using Sentiment Scores and Popularity Measures , 2019 .

[7]  Lawrence Philips,et al.  The double metaphone search algorithm , 2000 .

[8]  Rajendra Akerkar,et al.  A framework to integrate social media and authoritative data for disaster relief detection and distribution optimization , 2019, International Journal of Disaster Risk Reduction.

[9]  Jiebo Luo,et al.  Twitter Sentiment Analysis via Bi-sense Emoji Embedding and Attention-based LSTM , 2018, ACM Multimedia.

[10]  Nadia Nedjah,et al.  Sentiment analysis using convolutional neural network with fastText embeddings , 2017, 2017 IEEE Latin American Conference on Computational Intelligence (LA-CCI).

[11]  Anuradha Goswami,et al.  A survey of event detection techniques in online social networks , 2016, Social Network Analysis and Mining.

[12]  Henry Leung,et al.  Dynamically identifying roles in social media by mapping real world , 2013, 2013 International Joint Conference on Awareness Science and Technology & Ubi-Media Computing (iCAST 2013 & UMEDIA 2013).

[13]  Simon Andrews,et al.  Creating corroborated crisis reports from social media data through formal concept analysis , 2016, Journal of Intelligent Information Systems.

[14]  Shan Suthaharan,et al.  Support Vector Machine , 2016 .

[15]  Jacob Ratkiewicz,et al.  Detecting and Tracking the Spread of Astroturf Memes in Microblog Streams , 2010, ArXiv.

[16]  Srinivasu Badugu,et al.  A Review on Different Question Answering System Approaches , 2020 .

[17]  Leysia Palen,et al.  Identifying and Categorizing Disaster-Related Tweets , 2016, SocialNLP@EMNLP.

[18]  Daniel Dajun Zeng,et al.  Mapping users across social media platforms by integrating text and structure information , 2017, 2017 IEEE International Conference on Intelligence and Security Informatics (ISI).

[19]  Mourad Abed,et al.  Online social network analysis: detection of communities of interest , 2018, Journal of Intelligent Information Systems.

[20]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[21]  Sergey V. Kovalchuk,et al.  Unified domain-specific language for collecting and processing data of social media , 2018, Journal of Intelligent Information Systems.

[22]  Harry Shum,et al.  Twitter Topic Summarization by Ranking Tweets using Social Influence and Content Quality , 2012, COLING.

[23]  Timothy Baldwin,et al.  Lexical normalization for social media text , 2013, TIST.

[24]  Miles Osborne,et al.  Ranking Financial Tweets , 2016, SIGIR.

[25]  Sachin Deshpande,et al.  Tweets Analysis for Disaster Management: Preparedness, Emergency Response, Impact, and Recovery , 2020 .

[26]  Kripabandhu Ghosh,et al.  Automatic Matching of Resource Needs and Availabilities in Microblogs for Post-Disaster Relief , 2018, WWW.

[27]  Rong Zeng,et al.  Tweets Ranking Considering Dynamic Social Influence and Personal Interests , 2018, ICMLC.

[28]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[29]  A. Pethalakshmi,et al.  A novel framework based on bi-objective optimization and LAN2FIS for Twitter sentiment analysis , 2020, Social Network Analysis and Mining.

[30]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[31]  Zhenchang Xing,et al.  Ensemble application of convolutional and recurrent neural networks for multi-label text categorization , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[32]  Hongseok Choi,et al.  Deep recurrent convolutional networks for inferring user interests from social media , 2018, Journal of Intelligent Information Systems.

[33]  Vineet Kansal,et al.  Character level embedding with deep convolutional neural network for text normalization of unstructured data for Twitter sentiment analysis , 2019, Social Network Analysis and Mining.

[34]  Subbarao Kambhampati,et al.  Ranking tweets considering trust and relevance , 2012, IIWeb '12.

[35]  J. Rokne,et al.  Emergency Detection and Evacuation Planning Using Social Media , 2018, Lecture Notes in Social Networks.

[36]  Jun Zhao,et al.  Recurrent Convolutional Neural Networks for Text Classification , 2015, AAAI.

[37]  K. Crawford,et al.  The limits of crisis data: analytical and ethical challenges of using social and mobile data to understand disasters , 2015 .

[38]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[39]  Cyrus Shahabi,et al.  On Identifying Disaster-Related Tweets: Matching-Based or Learning-Based? , 2017, 2017 IEEE Third International Conference on Multimedia Big Data (BigMM).

[40]  Franck Dernoncourt,et al.  Sequential Short-Text Classification with Recurrent and Convolutional Neural Networks , 2016, NAACL.

[41]  Reda Alhajj,et al.  Emotion and sentiment analysis from Twitter text , 2019, J. Comput. Sci..

[42]  ChengXiang Zhai,et al.  Adapting Sequence to Sequence models for Text Normalization in Social Media , 2019, ICWSM.

[43]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[44]  Hemant Purohit,et al.  Ranking and grouping social media requests for emergency services using serviceability model , 2020, Social Network Analysis and Mining.

[45]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[46]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[47]  Sotiris Ioannidis,et al.  A fine-grained social network recommender system , 2019, Social Network Analysis and Mining.

[48]  Ammar Mohammed,et al.  Deep learning approaches for Arabic sentiment analysis , 2019, Social Network Analysis and Mining.

[49]  Michael J. Pennock,et al.  Social media applications and emergency management: A literature review and research agenda , 2018, International Journal of Disaster Risk Reduction.

[50]  Madichetty Sreenivasulu,et al.  Disaster damage assessment from the tweets using the combination of statistical features and informative words , 2019, Social Network Analysis and Mining.

[51]  Jacob Ratkiewicz,et al.  Truthy: mapping the spread of astroturf in microblog streams , 2010, WWW.

[52]  Mimmo Parente,et al.  Time-aware adaptive tweets ranking through deep learning , 2017, Future Gener. Comput. Syst..

[53]  Sebastian Bruch,et al.  TF-Ranking: Scalable TensorFlow Library for Learning-to-Rank , 2018, KDD.

[54]  B. Rienties,et al.  Reviewing Mixed Methods Approaches Using Social Network Analysis for Learning and Education , 2019, Lecture Notes in Social Networks.

[55]  Timothy Baldwin,et al.  Automatically Constructing a Normalisation Dictionary for Microblogs , 2012, EMNLP.