Evidential estimation of event locations in microblogs using the Dempster-Shafer theory

We estimate locations of events detected in Twitter using Dempster-Shafer theory.Our method combines evidence from multiple tweet features using combination rules.Our method is applicable to any event type and does not require training.Comparisons were made with the Bayesian methods under different settings.Estimations are made for two levels of location granularity with enhanced accuracy. Detecting real-world events by following posts in microblogs has been the motivation of numerous recent studies. In this work, we focus on the spatio-temporal characteristics of events detected in microblogs, and propose a method to estimate their locations using the Dempster-Shafer theory. We utilize three basic location-related features of the posts, namely the latitude-longitude metadata provided by the GPS sensor of the user's device, the textual content of the post, and the location attribute in the user profile, as three independent sources of evidence. Considering this evidence in a complementary way, we apply combination rules in the Dempster-Shafer theory to fuse them into a single model, and estimate the whereabouts of a detected event. Locations are treated at two levels of granularity, namely, city and town. Using the Dempster-Shafer theory to solve this problem allows uncertainty and missing data to be tolerated, and estimations to be made for sets of locations in terms of upper and lower probabilities. We demonstrate our solution using public tweets on Twitter posted in Turkey. The experimental evaluations conducted on a wide range of events including earthquakes, sports, weather, and street protests indicate higher success rates than the existing state of the art methods.

[1]  Zhenhua Wang,et al.  Sumblr: continuous summarization of evolving tweet streams , 2013, SIGIR.

[2]  Pavel V. Sevastjanov,et al.  A new approach to the rule-base evidential reasoning: Stock trading expert system application , 2010, Expert Syst. Appl..

[3]  Steven Schockaert,et al.  Georeferencing Flickr photos using language models at different levels of granularity: An evidence based approach , 2012, J. Web Semant..

[4]  James Allan,et al.  Topic detection and tracking: event-based information organization , 2002 .

[5]  Yiming Yang,et al.  A study of retrospective and on-line event detection , 1998, SIGIR '98.

[6]  Robin R. Murphy,et al.  Comparison of Bayesian and Dempster-Shafer theory for sensing: a practitioner's approach , 1993, Optics & Photonics.

[7]  Philippe Smets,et al.  The Combination of Evidence in the Transferable Belief Model , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Lei Gao,et al.  The Dempster-Shafer Theory: An Introduction and Fraud Risk Assessment Illustration , 2011 .

[9]  Ronald R. Yager,et al.  Classic Works of the Dempster-Shafer Theory of Belief Functions: An Introduction , 2008, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[10]  Benyuan Liu,et al.  Online Social Networks Flu Trend Tracker: A Novel Sensory Approach to Predict Flu Trends , 2012, BIOSTEC.

[11]  Peng Zhang,et al.  Estimating the Locations of Emergency Events from Twitter Streams , 2014, ITQM.

[12]  Shiguang Wang,et al.  Joint Localization of Events and Sources in Social Networks , 2015, 2015 International Conference on Distributed Computing in Sensor Systems.

[13]  Dongwon Lee,et al.  @Phillies Tweeting from Philly? Predicting Twitter User Locations with Spatial Word Usage , 2012, 2012 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining.

[14]  Wael Khreich,et al.  A Survey of Techniques for Event Detection in Twitter , 2015, Comput. Intell..

[15]  Stuart E. Middleton,et al.  Real-Time Crisis Mapping of Natural Disasters Using Social Media , 2014, IEEE Intelligent Systems.

[16]  Arthur P. Dempster,et al.  A Generalization of Bayesian Inference , 1968, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[17]  Dibo Hou,et al.  Detection of water-quality contamination events based on multi-sensor fusion using an extented Dempster–Shafer method , 2013 .

[18]  Steven Schockaert,et al.  Georeferencing Wikipedia Documents Using Data from Social Media Sources , 2014, ACM Trans. Inf. Syst..

[19]  Ron Sivan,et al.  Web-a-where: geotagging web content , 2004, SIGIR '04.

[20]  Sarah Vieweg,et al.  Processing Social Media Messages in Mass Emergency , 2014, ACM Comput. Surv..

[21]  Hanan Samet,et al.  TwitterStand: news in tweets , 2009, GIS.

[22]  Mohamed A. Sharaf,et al.  Emerging event detection in social networks with location sensitivity , 2014, World Wide Web.

[23]  Sharon Myrtle Paradesi,et al.  Geotagging Tweets Using Their Content , 2011, FLAIRS.

[24]  Jie Yin,et al.  Location extraction from disaster-related microblogs , 2013, WWW.

[25]  Shaowen Wang,et al.  FluMapper: A cyberGIS application for interactive analysis of massive location‐based social media , 2014, Concurr. Comput. Pract. Exp..

[26]  Rui Li,et al.  TEDAS: A Twitter-based Event Detection and Analysis System , 2012, 2012 IEEE 28th International Conference on Data Engineering.

[27]  Henri Prade,et al.  Representation and combination of uncertainty with belief functions and possibility measures , 1988, Comput. Intell..

[28]  S. Curley The application of Dempster-Shafer theory demonstrated with justification provided by legal evidence , 2007, Judgment and Decision Making.

[29]  Ed H. Chi,et al.  Tweets from Justin Bieber's heart: the dynamics of the location field in user profiles , 2011, CHI.

[30]  Halit Oguztüzün,et al.  Evidential location estimation for events detected in Twitter , 2013, GIR '13.

[31]  Gao Cong,et al.  Who, Where, When, and What , 2015, ACM Trans. Inf. Syst..

[32]  Arthur P. Dempster,et al.  Upper and Lower Probabilities Induced by a Multivalued Mapping , 1967, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[33]  Halit Oguztüzün,et al.  Semantic Expansion of Tweet Contents for Enhanced Event Detection in Twitter , 2012, 2012 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining.

[34]  Bu-Sung Lee,et al.  TwiNER: named entity recognition in targeted twitter stream , 2012, SIGIR '12.

[35]  Carlos J. Martín-Dancausa,et al.  Spot the Ball: Detecting Sports Events on Twitter , 2014, ECIR.

[36]  Shanlin Yang,et al.  The group consensus based evidential reasoning approach for multiple attributive group decision analysis , 2010, Eur. J. Oper. Res..

[37]  Anthony Stefanidis,et al.  #Earthquake: Twitter as a Distributed Sensor System , 2013, Trans. GIS.

[38]  Kyumin Lee,et al.  You are where you tweet: a content-based approach to geo-locating twitter users , 2010, CIKM.

[39]  John D. Lowrance,et al.  A Framework for Evidential-Reasoning Systems , 1990, AAAI.

[40]  Tarek F. Abdelzaher,et al.  On quality of event localization from social network feeds , 2015, 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[41]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[42]  Yutaka Matsuo,et al.  Earthquake shakes Twitter users: real-time event detection by social sensors , 2010, WWW '10.

[43]  Jie Yin,et al.  Using Social Media to Enhance Emergency Situation Awareness , 2012, IEEE Intelligent Systems.

[44]  R. Yager On the dempster-shafer framework and new combination rules , 1987, Inf. Sci..

[45]  Arthur P. Dempster,et al.  Classic Works on the Dempster-Shafer Theory of Belief Functions (Studies in Fuzziness and Soft Computing) , 2007 .

[46]  Daqing He,et al.  Combining evidence for automatic Web session identification , 2002, Inf. Process. Manag..

[47]  Mudhakar Srivatsa,et al.  When twitter meets foursquare: tweet location prediction using foursquare , 2014, MobiQuitous.

[48]  Yutaka Matsuo,et al.  Tweet Analysis for Real-Time Event Detection and Earthquake Reporting System Development , 2013, IEEE Transactions on Knowledge and Data Engineering.

[49]  Ming Zhou,et al.  Two-stage NER for tweets with clustering , 2013, Inf. Process. Manag..

[50]  Mohamed A. Deriche,et al.  A New Technique for Combining Multiple Classifiers using The Dempster-Shafer Theory of Evidence , 2002, J. Artif. Intell. Res..

[51]  Bu-Sung Lee,et al.  Event Detection in Twitter , 2011, ICWSM.

[52]  Kazufumi Watanabe,et al.  Jasmine: a real-time local-event detection system based on geolocation information propagated to microblogs , 2011, CIKM '11.

[53]  Kimberly Coombs,et al.  Using Dempster-Shafer methods for object classification in the theater ballistic missile environment , 1999, Defense, Security, and Sensing.

[54]  Pinar Senkul,et al.  Context Based Semantic Relations in Tweets , 2014 .

[55]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..

[56]  A. Stefanidis,et al.  Harvesting ambient geospatial information from social media feeds , 2011, GeoJournal.

[57]  Samuel S. Blackman,et al.  Design and Analysis of Modern Tracking Systems , 1999 .

[58]  Dieter Fox,et al.  Bayesian Filtering for Location Estimation , 2003, IEEE Pervasive Comput..

[59]  Timothy W. Finin,et al.  Why we twitter: understanding microblogging usage and communities , 2007, WebKDD/SNA-KDD '07.

[60]  Jonathan G. Fiscus,et al.  Topic detection and tracking evaluation overview , 2002 .