Geo-Spatial Multimedia Sentiment Analysis in Disasters

Sentiment analysis of disaster-related posts in social media can contribute to the situation awareness and better understanding of the dynamics of disaster events by identifying the polarity of sentiments expressed by the public. However, Even though many sentiment analysis techniques have been developed and available, there are still limitations in reliably using sentiment analysis since there is no dominantly accepted technique in disasters. Taking advantage of existing state-of-the-art sentiment classifiers, this paper proposes a novel framework for geo-spatial sentiment analysis of disaster-related social media data objects. Our framework addresses three types of challenges: the inaccuracy and discrepancy associated with various text and image sentiment classifiers, the geo-sentiment discrepancy among data objects in a local geographical area, and observing diverse sentiments from multimedia data objects (i.e., text and image). The extracted sentiments are aggregated geographically for the purpose of extracting more accurate local regional insights. For the evaluation of the framework, we explored Twitter and Flickr datasets at the time of Hurricane Sandy and Napa Earthquake and showed how our approach can provide a better understanding of disaster events.

[1]  Steven Bird,et al.  NLTK: The Natural Language Toolkit , 2002, ACL.

[2]  Syin Chan,et al.  Effectiveness of Simple Linguistic Processing in Automatic Sentiment Classification of Product Reviews , 2004 .

[3]  Isabell M. Welpe,et al.  Predicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment , 2010, ICWSM.

[4]  Andrea Esuli,et al.  SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining , 2006, LREC.

[5]  Bernard J. Jansen,et al.  Twitter power: Tweets as electronic word of mouth , 2009, J. Assoc. Inf. Sci. Technol..

[6]  Jie Tang,et al.  Can we understand van gogh's mood?: learning to infer affects from images in social networks , 2012, ACM Multimedia.

[7]  Peter A. Gloor,et al.  Predicting Movie Success and Academy Awards through Sentiment and Social Network Analysis , 2008, ECIS.

[8]  Jiebo Luo,et al.  Sentribute: image sentiment analysis from a mid-level perspective , 2013, WISDOM '13.

[9]  Jonathon S. Hare,et al.  Analyzing and predicting sentiment of images on the social web , 2010, ACM Multimedia.

[10]  Xiaohui Yu,et al.  ARSA: a sentiment-aware model for predicting sales performance using blogs , 2007, SIGIR.

[11]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[12]  A. Culotta,et al.  A Demographic Analysis of Online Sentiment during Hurricane Irene , 2012 .

[13]  Jiebo Luo,et al.  Robust Image Sentiment Analysis Using Progressively Trained and Domain Transferred Deep Networks , 2015, AAAI.

[14]  C. Haruechaiyasak,et al.  The role of Twitter during a natural disaster: Case study of 2011 Thai Flood , 2012, 2012 Proceedings of PICMET '12: Technology Management for Emerging Technologies.

[15]  Mark Dredze,et al.  You Are What You Tweet: Analyzing Twitter for Public Health , 2011, ICWSM.

[16]  ThelwallMike,et al.  Sentiment strength detection for the social web , 2012 .

[17]  Jeannie A. Stamberger,et al.  Crowd sentiment detection during disasters and crises , 2012, ISCRAM.

[18]  Axel Schulz,et al.  A fine-grained sentiment analysis approach for detecting crisis related microposts , 2013, ISCRAM.

[19]  Xavier Giró-i-Nieto,et al.  From pixels to sentiment: Fine-tuning CNNs for visual sentiment prediction , 2016, Image Vis. Comput..

[20]  Ponnurangam Kumaraguru,et al.  Visual Themes and Sentiment on Social Networks To Aid First Responders During Crisis Events , 2016, ArXiv.

[21]  Shrikanth S. Narayanan,et al.  A System for Real-time Twitter Sentiment Analysis of 2012 U.S. Presidential Election Cycle , 2012, ACL.

[22]  Mike Thelwall,et al.  Sentiment strength detection for the social web , 2012, J. Assoc. Inf. Sci. Technol..

[23]  Li-Jia Li,et al.  Visual Sentiment Prediction with Deep Convolutional Neural Networks , 2014, ArXiv.

[24]  Cyrus Shahabi,et al.  On Identifying Disaster-Related Tweets: Matching-Based or Learning-Based? , 2017, 2017 IEEE Third International Conference on Multimedia Big Data (BigMM).

[25]  Shlomo Argamon,et al.  Committee-Based Sampling For Training Probabilistic Classi(cid:12)ers , 1995 .

[26]  Sarah Vieweg,et al.  Situational Awareness in Mass Emergency: A Behavioral and Linguistic Analysis of Microblogged Communications , 2012 .

[27]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[28]  A. Comber,et al.  Does Flickr work in disaster management ? – a case study of Typhoon Morakot in Taiwan , 2017 .

[29]  Wolfgang Zenk-Möltgen,et al.  Geotagged Twitter posts from the United States: A tweet collection to investigate representativeness , 2016 .

[30]  Ross Maciejewski,et al.  Visualizing Social Media Sentiment in Disaster Scenarios , 2015, WWW.

[31]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[32]  Christopher M. Danforth,et al.  The Geography of Happiness: Connecting Twitter Sentiment and Expression, Demographics, and Objective Characteristics of Place , 2013, PloS one.

[33]  Haoyu Wang,et al.  The Hurricane Sandy Twitter Corpus , 2015, AAAI Workshop: WWW and Public Health Intelligence.

[34]  Yutaka Matsuo,et al.  Earthquake shakes Twitter users: real-time event detection by social sensors , 2010, WWW '10.

[35]  Rongrong Ji,et al.  Large-scale visual sentiment ontology and detectors using adjective noun pairs , 2013, ACM Multimedia.

[36]  Kazutoshi Sumiya,et al.  Crowd-based urban characterization: extracting crowd behavioral patterns in urban areas from Twitter , 2011, LBSN '11.

[37]  Marcel Worring,et al.  What Multimedia Sentiment Analysis Says About City Liveability , 2016, ECIR.