#Outage: Detecting Power and Communication Outages from Social Networks

Natural disasters are increasing worldwide at an alarming rate. To aid relief operations during and post disaster, humanitarian organizations rely on various types of situational information such as missing, trapped or injured people and damaged infrastructure in an area. Crucial and timely identification of infrastructure and utility damage is critical to properly plan and execute search and rescue operations. However, in the wake of natural disasters, real-time identification of this information becomes challenging. In this research, we investigate the use of tweets posted on the Twitter social media platform to detect power and communication outages during natural disasters. We first curate a data set of 18,097 tweets based on domain-specific keywords obtained using Latent Dirichlet Allocation. We annotate the gathered data set to separate the tweets into different types of outage-related events: power outage, communication outage and both power-communication outage. We analyze the tweets to identify information such as popular words, length of words and hashtags as well as sentiments that are associated with tweets in these outage-related categories. Furthermore, we apply machine learning algorithms to classify these tweets into their respective categories. Our results show that simple classifiers such as the boosting algorithm are able to classify outage related tweets from unrelated tweets with close to 100% f1-score. Additionally, we observe that the transfer learning model, BERT, is able to classify different categories of outage-related tweets with close to 90% accuracy in less than 90 seconds of training and testing time, demonstrating that tweets can be mined in real-time to assist first responders during natural disasters.

[1]  Muhammad Imran,et al.  Classifying Information from Microblogs during Epidemics , 2017, DH.

[2]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[3]  Qunying Huang,et al.  Using nightlight remote sensing imagery and Twitter data to study power outages , 2015, EM-GIS.

[4]  Leysia Palen,et al.  Identifying and Categorizing Disaster-Related Tweets , 2016, SocialNLP@EMNLP.

[5]  J. Fowler,et al.  Rapid assessment of disaster damage using social media activity , 2016, Science Advances.

[6]  Carlos Castillo,et al.  AIDR: artificial intelligence for disaster response , 2014, WWW.

[7]  Muhammad Imran,et al.  Twitter as a Lifeline: Human-annotated Twitter Corpora for NLP of Crisis-related Messages , 2016, LREC.

[8]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[9]  Amanda Lee Hughes,et al.  Social Media in Disaster Communication , 2018 .

[10]  Devanandham Henry,et al.  On the Impacts of Power Outages during Hurricane Sandy—A Resilience‐Based Analysis , 2016, Syst. Eng..

[11]  Leysia Palen,et al.  Twitter adoption and use in mass convergence and emergency events , 2009 .

[12]  Muhammad Imran,et al.  Identifying Sub-events and Summarizing Disaster-Related Information from Microblogs , 2018, SIGIR.

[13]  Claire Cardie,et al.  39. Opinion mining and sentiment analysis , 2014 .

[14]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Alexander Tuzhilin,et al.  Virtual Power Outage Detection Using Social Sensors , 2015 .

[16]  Bin Yan,et al.  Weighted Focal Loss: An Effective Loss Function to Overcome Unbalance Problem of Chest X-ray14 , 2018, IOP Conference Series: Materials Science and Engineering.

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  Axel Schulz,et al.  Evaluating Multi-label Classification of Incident-related Tweet , 2014, #MSM.

[19]  Sarah Vieweg,et al.  Processing Social Media Messages in Mass Emergency , 2014, ACM Comput. Surv..

[20]  Xia Feng,et al.  Latent Dirichlet allocation (LDA) and topic modeling: models, applications, a survey , 2017, Multimedia Tools and Applications.

[21]  Derek Ruths,et al.  Humanitarian Technology : Science , Systems and Global Impact 2015 , HumTech 2015 Tackling the challenges of situational awareness extraction in Twitter with an adaptive approach , 2017 .

[22]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[23]  Yutaka Matsuo,et al.  Tweet Analysis for Real-Time Event Detection and Earthquake Reporting System Development , 2013, IEEE Transactions on Knowledge and Data Engineering.

[24]  Michael D. Buhrmester,et al.  Amazon's Mechanical Turk , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[25]  Christian Reuter,et al.  Social Media in Crisis Management: An Evaluation and Analysis of Crisis Informatics Research , 2018, Int. J. Hum. Comput. Interact..

[26]  Muhammad Imran,et al.  From Situational Awareness to Actionability , 2018, Proc. ACM Hum. Comput. Interact..

[27]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[28]  Jianhui Wang,et al.  Data-Driven Power Outage Detection by Social Sensors , 2016, IEEE Transactions on Smart Grid.

[29]  Lewis Mitchell,et al.  Event Detection in Twitter: A Keyword Volume Approach , 2018, 2018 IEEE International Conference on Data Mining Workshops (ICDMW).

[30]  Diyi Yang,et al.  Hierarchical Attention Networks for Document Classification , 2016, NAACL.

[31]  Shafiq R. Joty,et al.  Applications of Online Deep Learning for Crisis Response Using Social Media Information , 2016, ArXiv.

[32]  Firoj Alam,et al.  A Twitter Tale of Three Hurricanes: Harvey, Irma, and Maria , 2018, ISCRAM.

[33]  Jin Wei,et al.  Real-Time Power Outage Detection System using Social Sensing and Neural Networks , 2018, 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[34]  Cyrus Shahabi,et al.  On Identifying Disaster-Related Tweets: Matching-Based or Learning-Based? , 2017, 2017 IEEE Third International Conference on Multimedia Big Data (BigMM).

[35]  Alexander Tuzhilin,et al.  Using Social Sensors for Detecting Emergency Events , 2017, ACM Trans. Manag. Inf. Syst..

[36]  Kripabandhu Ghosh,et al.  Automatic Matching of Resource Needs and Availabilities in Microblogs for Post-Disaster Relief , 2018, WWW.