Flood Relevance Estimation from Visual and Textual Content in Social Media Streams

Disaster monitoring based on social media posts has raised a lot of interest in the domain of computer science the last decade, mainly due to the wide area of applications in public safety and security and due to the pervasiveness not solely on daily communication but also in life-threating situations. Social media can be used as a valuable source for producing early warnings of eminent disasters. This paper presents a framework to analyse social media multimodal content, in order to decide if the content is relevant to flooding. This is very important since it enhances the crisis situational awareness and supports various crisis management procedures such as preparedness. Evaluation on a benchmark dataset shows very good performance in both text and image classification modules.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Claudio Rossi,et al.  Filtering informative tweets during emergencies: a machine learning approach , 2017, I-TENDER@CoNEXT.

[3]  R. Merchant,et al.  Integrating social media into emergency-preparedness efforts. , 2011, The New England journal of medicine.

[4]  Vijaymeena M.K,et al.  A Survey on Similarity Measures in Text Mining , 2016 .

[5]  S. Satyanarayana,et al.  An algorithm for identification of natural disaster affected area , 2017, Journal of Big Data.

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  Ioannis Patras,et al.  Comparison of Fine-Tuning and Extension Strategies for Deep Convolutional Neural Networks , 2017, MMM.

[8]  Cornelia Caragea,et al.  Identifying valuable information from twitter during natural disasters , 2014, ASIST.

[9]  Than Nwe Aung,et al.  Target oriented tweets monitoring system during natural disasters , 2017, 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS).

[10]  Jun Yan.  Text Representation , 2009, Encyclopedia of Database Systems.

[11]  Charu C. Aggarwal,et al.  Mining Text Data , 2012, Springer US.

[12]  Kathryn Boar.  Text representations , 1990 .

[13]  Yiannis Kompatsiaris,et al.  Towards Air Quality Estimation Using Collected Multimodal Environmental Data , 2016, IFIN/ISEM@INSCI.

[14]  Xiaolin Du,et al.  Short Text Classification: A Survey , 2014, J. Multim..

[15]  Pablo N. Mendes,et al.  Improving efficiency and accuracy in multilingual entity extraction , 2013, I-SEMANTICS '13.

[16]  Stuart E. Middleton,et al.  Real-Time Crisis Mapping of Natural Disasters Using Social Media , 2014, IEEE Intelligent Systems.

[17]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[18]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[19]  A. Suruliandi,et al.  A short message classification algorithm for tweet classification , 2014, 2014 International Conference on Recent Trends in Information Technology.

[20]  Sarah Vieweg,et al.  Processing Social Media Messages in Mass Emergency , 2014, ACM Comput. Surv..

[21]  Ioannis Patras,et al.  Cascade of classifiers based on binary, non-binary and deep convolutional network descriptors for video concept detection , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[22]  Stephen Jarvis,et al.  Predicting floods with Flickr tags , 2017, PloS one.

[23]  Jie Yin,et al.  Using Social Media to Enhance Emergency Situation Awareness , 2012, IEEE Intelligent Systems.

[24]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.