The JORD System: Linking Sky and Social Multimedia Data to Natural Disasters

Being able to automatically link social media information and data to remote-sensed data holds large possibilities for society and research. In this paper, we present a system called JORD that is able to autonomously collect social media data about technological and environmental disasters, and link it automatically to remote-sensed data. In addition, we demonstrate that queries in local languages that are relevant to the exact position of natural disasters retrieve more accurate information about a disaster event. To show the capabilities of the system, we present some examples of disaster events detected by the system. To evaluate the quality of the provided information and usefulness of JORD from the potential users point of view we include a crowdsourced user study.

[1]  Ravindra S. Hegadi,et al.  A Survey on Multimedia Data Mining and Its Relevance Today , 2010 .

[2]  John Leonard Kansas,et al.  Using Landsat imagery to backcast fire and post-fire residuals in the Boreal Shield of Saskatchewan: implications for woodland caribou management , 2016 .

[3]  Marc Cheong,et al.  Twittering for Earth: A Study on the Impact of Microblogging Activism on Earth Hour 2009 in Australia , 2010, ACIIDS.

[4]  A. Fisher,et al.  Comparing Landsat water index methods for automated water classification in eastern Australia , 2016 .

[5]  E. LESTER SMITH,et al.  AND OTHERS , 2005 .

[6]  Wael Khreich,et al.  A Survey of Techniques for Event Detection in Twitter , 2015, Comput. Intell..

[7]  Martha Larson,et al.  Crowdsourcing as self-fulfilling prophecy: Influence of discarding workers in subjective assessment tasks , 2016, 2016 14th International Workshop on Content-Based Multimedia Indexing (CBMI).

[8]  Nicu Sebe,et al.  Event-based media processing and analysis: A survey of the literature , 2016, Image Vis. Comput..

[9]  Pascal Frossard,et al.  Multiscale event detection in social media , 2014, Data Mining and Knowledge Discovery.

[10]  Jie Yin,et al.  Using Social Media to Enhance Emergency Situation Awareness , 2012, IEEE Intelligent Systems.

[11]  Berna Erol,et al.  Linking multimedia presentations with their symbolic source documents: algorithm and applications , 2003, ACM Multimedia.

[12]  Shih-Fu Chang.  New Frontiers of Large Scale Multimedia Information Retrieval , 2016, ICMR.