Flood Level Estimation from News Articles and Flood Detection from Satellite Image Sequences

This paper presents the solutions of team EVUS-ikg for the Multimedia Satellite Task at MediaEval 2019. We addressed two of the subtasks, namely multimodal flood level estimation (MFLE) and city-centered satellite sequences (CCSS). For MFLE, a two-step approach was proposed, which retrieves flood relevant images based on global deep features and then detects severe flood images based on self-defined distance features, which can be extracted from human body keypoints and semantic segments. For CCSS, a neural network, which combines CNN and LSTM, was used to detect floods in satellite image sequences. Both methods have achieved a good performance on the test set, which shows a great potential to improve the current flood monitoring applications.

[1]  Bolei Zhou,et al.  Scene Parsing through ADE20K Dataset , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Monika Sester,et al.  Ensembled Convolutional Neural Network Models for Retrieving Flood Relevant Tweets , 2018, MediaEval.

[3]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[5]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[6]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[7]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Monika Sester,et al.  Extraction of Pluvial Flood Relevant Volunteered Geographic Information (VGI) by Deep Learning from User Generated Texts and Photos , 2018, ISPRS Int. J. Geo Inf..

[9]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[10]  Benjamin Bischke,et al.  The Multimedia Satellite Task at MediaEval 2018: Emergency Response for Flooding Events , 2018 .

[11]  Huan Ning,et al.  A visual–textual fused approach to automated tagging of flood-related tweets during a flood event , 2018, Int. J. Digit. Earth.

[12]  Tomas Mikolov,et al.  Enriching Word Vectors with Subword Information , 2016, TACL.

[13]  Bolei Zhou,et al.  Places: A 10 Million Image Database for Scene Recognition , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.