Human-Guided Flood Mapping: From Experts to the Crowd

Hurricane-induced flooding can lead to substantial loss of life and huge damage to infrastructure. Mapping flood extent from satellite or aerial imagery is essential for prioritizing relief efforts and for assessing future flood risk. Identification of water extent in such images can be challenging considering the heterogeneity in water body size and shape, cloud cover, and natural variations in land cover. In this effort, we introduce a novel cognitive framework based on a semi-supervised learning algorithm, called HUman-Guided Flood Mapping (HUG-FM), specifically designed to tackle the flood mapping problem. Our framework first divides the satellite or aerial image into patches leveraging a graph-based clustering approach. A domain expert is then asked to provide labels for a few patches (as opposed to pixels which are harder to discern). Subsequently, we learn a classifier based on the provided labels to map flood extent. We test the efficacy and efficiency of our framework on imagery from several recent flood-induced emergencies and results show that our algorithm can robustly and correctly detect water areas compared to the state-of-the-art. We then evaluate whether expert guidance can be replaced by the wisdom of a crowd (e.g., crisis volunteers). We design an online crowdsourcing platform based on HUG-FM and propose a novel ensemble method to leverage crowdsourcing efforts. We conduct an experiment with over $50$ participants and show that crowdsourced HUG-FM (CHUG-FM) can approach or even exceed the performance of a single expert providing guidance (HUG-FM).

[1]  Nizar Grira,et al.  Unsupervised and Semi-supervised Clustering : a Brief Survey ∗ , 2004 .

[2]  Srinivasan Parthasarathy,et al.  Scalable graph clustering using stochastic flows: applications to community discovery , 2009, KDD.

[3]  Claire Cardie,et al.  Clustering with Instance-Level Constraints , 2000, AAAI/IAAI.

[4]  Vijayan Sugumaran,et al.  Building knowledge base of urban emergency events based on crowdsourcing of social media , 2016, Concurr. Comput. Pract. Exp..

[5]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[6]  Tomas Holderness du Chemin,et al.  From Social Media to GeoSocial Intelligence: Crowdsourcing Civic Co-management for Flood Response in Jakarta, Indonesia , 2015, Social Media for Government Services.

[7]  Arnaud Browet,et al.  Community Detection for Hierarchical Image Segmentation , 2011, IWCIA.

[8]  Jianbo Shi,et al.  Spectral segmentation with multiscale graph decomposition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Gergana Angelova Lazarova Semi-supervised Image Segmentation , 2014, AIMSA.

[10]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[11]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Srinivasan Parthasarathy,et al.  SEANO: Semi-supervised Embedding in Attributed Networks with Outliers , 2017, SDM.

[13]  Yoav Freund,et al.  Boosting the margin: A new explanation for the effectiveness of voting methods , 1997, ICML.

[14]  Andrew K. C. Wong,et al.  A new method for gray-level picture thresholding using the entropy of the histogram , 1985, Comput. Vis. Graph. Image Process..

[15]  Huiji Gao,et al.  Harnessing the Crowdsourcing Power of Social Media for Disaster Relief , 2011, IEEE Intelligent Systems.

[16]  Jiongqian Liang,et al.  Human-guided Flood Mapping on Satellite Images , 2016 .

[17]  J. A. Glennona Crowdsourcing geographic information for disaster response: a research , 2010 .

[18]  Salem Saleh Al-amri,et al.  Image Segmentation by Using Threshold Techniques , 2010, ArXiv.

[19]  Cheng-Chien Liu,et al.  Rapid Response to a Typhoon-Induced Flood with an SAR-Derived Map of Inundated Areas: Case Study and Validation , 2015, Remote. Sens..

[20]  David Fuhry,et al.  Community Discovery: Simple and Scalable Approaches , 2015 .

[21]  David Yarowsky,et al.  Unsupervised Word Sense Disambiguation Rivaling Supervised Methods , 1995, ACL.

[22]  Simon Plank,et al.  Sentinel-1-based flood mapping: a fully automated processing chain , 2016 .

[23]  Michael F. Goodchild,et al.  Please Scroll down for Article International Journal of Digital Earth Crowdsourcing Geographic Information for Disaster Response: a Research Frontier Crowdsourcing Geographic Information for Disaster Response: a Research Frontier , 2022 .

[24]  Sebastian Thrun,et al.  Text Classification from Labeled and Unlabeled Documents using EM , 2000, Machine Learning.

[25]  James C. Bezdek,et al.  Partially supervised clustering for image segmentation , 1996, Pattern Recognit..

[26]  T. L. Toan,et al.  Mapping of flood dynamics and spatial distribution of vegetation in the Amazon floodplain using multitemporal SAR data , 2007 .

[27]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[28]  Du-Ming Tsai,et al.  A fast thresholding selection procedure for multimodal and unimodal histograms , 1995, Pattern Recognit. Lett..

[29]  Serge Beucher,et al.  The Morphological Approach to Segmentation: The Watershed Transformation , 2018, Mathematical Morphology in Image Processing.

[30]  Dmitri Kavetski,et al.  Probabilistic Flood Mapping Using Synthetic Aperture Radar Data , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Slobodan P. Simonovic,et al.  Role of Remote Sensing in Disaster Management , 2002 .

[32]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[33]  R. Nicholls,et al.  Future flood losses in major coastal cities , 2013 .

[34]  João Porto de Albuquerque,et al.  Flood Citizen Observatory: a crowdsourcing-based approach for flood risk management in Brazil , 2014, SEKE.

[35]  Avrim Blum,et al.  Learning from Labeled and Unlabeled Data using Graph Mincuts , 2001, ICML.

[36]  Ruslan Salakhutdinov,et al.  Revisiting Semi-Supervised Learning with Graph Embeddings , 2016, ICML.

[37]  Gabriele Moser,et al.  Information Extraction From Remote Sensing Images for Flood Monitoring and Damage Evaluation , 2012, Proceedings of the IEEE.

[38]  Inderjit S. Dhillon,et al.  Weighted Graph Cuts without Eigenvectors A Multilevel Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  M. Ibrahim Sezan,et al.  A Peak Detection Algorithm and its Application to Histogram-Based Image Data Reduction , 1990, Comput. Vis. Graph. Image Process..

[40]  A. Winsor Sampling techniques. , 2000, Nursing times.

[41]  Kyle M. Brown,et al.  Progress in operational flood mapping using satellite synthetic aperture radar (SAR) and airborne light detection and ranging (LiDAR) data , 2016 .

[42]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[43]  Azriel Rosenfeld,et al.  Histogram concavity analysis as an aid in threshold selection , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[44]  Sandro Martinis,et al.  Towards operational near real-time flood detection using a split-based automatic thresholding procedure on high resolution TerraSAR-X data , 2009 .