Event classification and location prediction from tweets during disasters

Social media is a platform to express one’s view in real time. This real time nature of social media makes it an attractive tool for disaster management, as both victims and officials can put their problems and solutions at the same place in real time. We investigate the Twitter post in a flood related disaster and propose an algorithm to identify victims asking for help. The developed system takes tweets as inputs and categorizes them into high or low priority tweets. User location of high priority tweets with no location information is predicted based on historical locations of the users using the Markov model. The system is working well, with its classification accuracy of 81%, and location prediction accuracy of 87%. The present system can be extended for use in other natural disaster situations, such as earthquake, tsunami, etc., as well as man-made disasters such as riots, terrorist attacks etc. The present system is first of its kind, aimed at helping victims during disasters based on their tweets.

[1]  Yusuke Hara,et al.  Behaviour Analysis Using Tweet Data and geo-tag Data in a Natural Disaster , 2015 .

[2]  Timothy Baldwin,et al.  Geolocation Prediction in Social Media Data by Finding Location Indicative Words , 2012, COLING.

[3]  Mark Dredze,et al.  You Are What You Tweet: Analyzing Twitter for Public Health , 2011, ICWSM.

[4]  Fernando Diaz,et al.  Extracting information nuggets from disaster- Related messages in social media , 2013, ISCRAM.

[5]  Gisele L. Pappa,et al.  Exploring Multiple Evidences to Infer Users Location in Twitter , 2014 .

[6]  Kathleen M. Carley,et al.  Crowd sourcing disaster management: The complex nature of Twitter usage in Padang Indonesia , 2016 .

[7]  Leysia Palen,et al.  Supporting “Everyday Analysts” in Safety- and Time-Critical Situations , 2011, Inf. Soc..

[8]  Angappa Gunasekaran,et al.  Vision, applications and future challenges of Internet of Things: A bibliometric study of the recent literature , 2016, Ind. Manag. Data Syst..

[9]  Virgílio A. F. Almeida,et al.  Detecting Spammers on Twitter , 2010 .

[10]  Huan Liu,et al.  Is the Sample Good Enough? Comparing Data from Twitter's Streaming API with Twitter's Firehose , 2013, ICWSM.

[11]  Olga Simek,et al.  Searching for Twitter Posts by Location , 2015, ICTIR.

[12]  M. Ali Ülkü,et al.  Modeling the impact of donor behavior on humanitarian aid operations , 2015, Ann. Oper. Res..

[13]  Michael Grossniklaus,et al.  An evaluation of the run-time and task-based performance of event detection techniques for Twitter , 2015, Inf. Syst..

[14]  Kenta Oku,et al.  Mapping Geotagged Tweets to Tourist Spots for Recommender Systems , 2014, 2014 IIAI 3rd International Conference on Advanced Applied Informatics.

[15]  Mohamed Medhat Gaber,et al.  A rule dynamics approach to event detection in Twitter with its application to sports and politics , 2016, Expert Syst. Appl..

[16]  Panos Panagiotopoulos,et al.  Beyond positive or negative: Qualitative sentiment analysis of social media reactions to unexpected stressful events , 2016, Comput. Hum. Behav..

[17]  B. Chae,et al.  Insights from hashtag #supplychain and Twitter Analytics: Considering Twitter and Twitter data for supply chain practice and research , 2015 .

[18]  Gaurav Kabra,et al.  Analyzing ICT Issues in Humanitarian Supply Chain Management: A SAP-LAP Linkages Framework , 2015, Global Journal of Flexible Systems Management.

[19]  Walter J. Gutjahr,et al.  Modelling beneficiaries’ choice in disaster relief logistics , 2017, Ann. Oper. Res..

[20]  Dongman Lee,et al.  EventRadar: A Real-Time Local Event Detection Scheme Using Twitter Stream , 2012, 2012 IEEE International Conference on Green Computing and Communications.

[21]  Ee-Peng Lim,et al.  Tweets and Votes: A Study of the 2011 Singapore General Election , 2012, 2012 45th Hawaii International Conference on System Sciences.

[22]  Danah Boyd,et al.  Detecting Spam in a Twitter Network , 2009, First Monday.

[23]  Stuart E. Middleton,et al.  Real-Time Crisis Mapping of Natural Disasters Using Social Media , 2014, IEEE Intelligent Systems.

[24]  Youngok Kang,et al.  Risk analysis and visualization for detecting signs of flood disaster in Twitter , 2016, Spatial Information Research.

[25]  Daniel Gayo-Avello,et al.  Nepotistic relationships in Twitter and their impact on rank prestige algorithms , 2010, Inf. Process. Manag..

[26]  Starr Roxanne Hiltz,et al.  Multiple perspectives on planning for emergencies: An introduction to the special issue on planning and foresight for emergency preparedness and management , 2013 .

[27]  Qunying Huang,et al.  Understanding social media data for disaster management , 2015, Natural Hazards.

[28]  Peter Simmons,et al.  Social media in Saudi Arabia: Exploring its use during two natural disasters , 2015 .

[29]  Patric R. Spence,et al.  Exploring extreme events on social media: A comparison of user reposting/retweeting behaviors on Twitter and Weibo , 2016, Comput. Hum. Behav..

[30]  Brendan T. O'Connor,et al.  A Latent Variable Model for Geographic Lexical Variation , 2010, EMNLP.

[31]  Marko Jurmu,et al.  Detection, classification and visualization of place-triggered geotagged tweets , 2012, UbiComp.

[32]  Kazufumi Watanabe,et al.  Jasmine: a real-time local-event detection system based on geolocation information propagated to microblogs , 2011, CIKM '11.

[33]  Feng Li,et al.  Listen to me - Evaluating the influence of micro-blogs , 2014, Decis. Support Syst..

[34]  Alexander Zipf,et al.  An Advanced Systematic Literature Review on Spatiotemporal Analyses of Twitter Data , 2015, Trans. GIS.

[35]  Louise K. Comfort,et al.  Emergency Management Research and Practice in Public Administration: Emergence, Evolution, Expansion, and Future Directions , 2012 .

[36]  Babiga Birregah,et al.  Connecting a population dynamic model with a multi-period location-allocation problem for post-disaster relief operations , 2016, Ann. Oper. Res..

[37]  Daniel E. O'Leary,et al.  Twitter Mining for Discovery, Prediction and Causality: Applications and Methodologies , 2015, Intell. Syst. Account. Finance Manag..

[38]  Ken R. Smith,et al.  Leveraging geotagged Twitter data to examine neighborhood happiness, diet, and physical activity. , 2016, Applied geography.

[39]  A. Gunasekaran,et al.  The role of Big Data in explaining disaster resilience in supply chains for sustainability , 2017 .

[40]  Jason Baldridge,et al.  Simple supervised document geolocation with geodesic grids , 2011, ACL.

[41]  Wendy Macias,et al.  Blog Functions as Risk and Crisis Communication During Hurricane Katrina , 2009, J. Comput. Mediat. Commun..

[42]  Rui Li,et al.  TEDAS: A Twitter-based Event Detection and Analysis System , 2012, 2012 IEEE 28th International Conference on Data Engineering.

[43]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[44]  Sushil Theory building using SAP-LAP linkages: an application in the context of disaster management , 2019, Ann. Oper. Res..

[45]  David S. Ebert,et al.  Public behavior response analysis in disaster events utilizing visual analytics of microblog data , 2014, Comput. Graph..

[46]  Yutaka Matsuo,et al.  Earthquake shakes Twitter users: real-time event detection by social sensors , 2010, WWW '10.

[47]  Pascal Frossard,et al.  Multiscale event detection in social media , 2014, Data Mining and Knowledge Discovery.

[48]  Lars Schmidt-Thieme,et al.  Near Real-time Geolocation Prediction in Twitter Streams via Matrix Factorization Based Regression , 2016, CIKM.

[49]  Ed H. Chi,et al.  Tweets from Justin Bieber's heart: the dynamics of the location field in user profiles , 2011, CHI.

[50]  Linet Özdamar,et al.  Emergency Logistics Planning in Natural Disasters , 2004, Ann. Oper. Res..

[51]  Abbas Rajabifard,et al.  Event relatedness assessment of Twitter messages for emergency response , 2017, Inf. Process. Manag..

[52]  H. Raghav Rao,et al.  Community Intelligence and Social Media Services: A Rumor Theoretic Analysis of Tweets During Social Crises , 2013, MIS Q..

[53]  Jomon Aliyas Paul,et al.  Location-allocation planning of stockpiles for effective disaster mitigation , 2012, Annals of Operations Research.

[54]  Abbas Rajabifard,et al.  A Multi-Element Approach to Location Inference of Twitter: A Case for Emergency Response , 2016, ISPRS Int. J. Geo Inf..

[55]  Scott A. Hale,et al.  Where in the World Are You? Geolocation and Language Identification in Twitter* , 2013, ArXiv.

[56]  Max Mühlhäuser,et al.  A Multi-Indicator Approach for Geolocalization of Tweets , 2013, ICWSM.

[57]  Kyumin Lee,et al.  You are where you tweet: a content-based approach to geo-locating twitter users , 2010, CIKM.

[58]  Nicole C. Krämer,et al.  Psychosocial functions of social media usage in a disaster situation: A multi-methodological approach , 2014, Comput. Hum. Behav..

[59]  Jian Yang,et al.  Personnel scheduling and supplies provisioning in emergency relief operations , 2015, Ann. Oper. Res..

[60]  Lisl Zach,et al.  Use of microblogging for collective sense-making during violent crises: A study of three campus shootings , 2012, J. Assoc. Inf. Sci. Technol..

[61]  Shuning Wang,et al.  Computerized support systems for emergency decision making , 1994, Ann. Oper. Res..

[62]  Timothy Baldwin,et al.  Text-Based Twitter User Geolocation Prediction , 2014, J. Artif. Intell. Res..

[63]  Jure Leskovec,et al.  Friendship and mobility: user movement in location-based social networks , 2011, KDD.

[64]  Lei Chen,et al.  Event detection over twitter social media streams , 2013, The VLDB Journal.

[65]  Alessandro Vespignani,et al.  Beating the news using social media: the case study of American Idol , 2012, EPJ Data Science.

[66]  Qunying Huang,et al.  Geographic Situational Awareness: Mining Tweets for Disaster Preparedness, Emergency Response, Impact, and Recovery , 2015, ISPRS Int. J. Geo Inf..

[67]  Xiaoming Zhang,et al.  Event detection and popularity prediction in microblogging , 2015, Neurocomputing.

[68]  Yutaka Matsuo,et al.  Tweet Analysis for Real-Time Event Detection and Earthquake Reporting System Development , 2013, IEEE Transactions on Knowledge and Data Engineering.

[69]  Nishikant Mishra,et al.  Use of twitter data for waste minimisation in beef supply chain , 2018, Ann. Oper. Res..

[70]  Weiru Liu,et al.  A survey of location inference techniques on Twitter , 2015, J. Inf. Sci..

[71]  Milton Halem,et al.  Human Sensor Networks for Improved Modeling of Natural Disasters , 2012, Proceedings of the IEEE.

[72]  Scott A. Longwell,et al.  TWITTER AND DISASTERS , 2013 .

[73]  Wael Khreich,et al.  A Survey of Techniques for Event Detection in Twitter , 2015, Comput. Intell..

[74]  Ravi Kumar,et al.  Object matching in tweets with spatial models , 2012, WSDM '12.

[75]  Serkan Günal,et al.  The impact of preprocessing on text classification , 2014, Inf. Process. Manag..

[76]  Michelle R. Guy,et al.  Twitter earthquake detection: earthquake monitoring in a social world , 2012 .