Sen1Floods11: a georeferenced dataset to train and test deep learning flood algorithms for Sentinel-1

Accurate flood mapping at global scale can support disaster relief and recovery efforts. Improving flood relief efforts with more accurate data is of great importance due to expected increases in the frequency and magnitude of flood events due to climate change. To assist efforts to operationalize deep learning algorithms for flood mapping at global scale, we introduce Sen1Floods11, a surface water data set including raw Sentinel-1 imagery and classified permanent water and flood water. This dataset consists of 4,831 512x512 chips covering 120,406 km2 and spans all 14 biomes, 357 ecoregions, and 6 continents of the world across 11 flood events. We used Sen1Floods11 to train, validate, and test fully convolutional neural networks (FCNNs) to segment permanent and flood water. We compare results of classifying permanent, flood, and total surface water from training a FCNN model on four subsets of this data: i) 446 hand labeled chips of surface water from flood events; ii) 814 chips of publicly available permanent water data labels from Landsat (JRC surface water dataset); iii) 4,385 chips of surface water classified from Sentinel-2 images from flood events and iv) 4,385 chips of surface water classified from Sentinel-1 imagery from flood events. We compare these four models to a common remote sensing approach of thresholding radar backscatter to identify surface water. Results show the FCNN model trained on classifications of Sentinel-2 flood events performs best to identify flood and total surface water, while backscatter thresholding yielded the best result to identify permanent water classes only. Our results suggest deep learning models for flood detection of radar data can outperform threshold based remote sensing algorithms, and perform better with training labels that include flood water specifically, not just permanent surface water. We also find that FCNN models trained on plentiful automatically generated labels from optical remote sensing algorithms perform better than models trained on scarce hand labeled data. Future research to operationalize computer vision approaches to mapping flood and surface water could build new models from Sen1Floods11 and expand this dataset to include additional sensors and flood events. We provide Sen1Floods11, as well as our training and evaluation code at: https://github.com/cloudtostreet/Sen1Floods11.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  Frank Hutter,et al.  SGDR: Stochastic Gradient Descent with Warm Restarts , 2016, ICLR.

[3]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[4]  Robin R. Murphy,et al.  Flooded Area Detection from Uav Images Based on Densely Connected Recurrent Neural Networks , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[5]  Rasmus Fensholt,et al.  Automated Water Extraction Index: A new technique for surface water mapping using Landsat imagery , 2014 .

[6]  Nazzareno Pierdicca,et al.  Sentinel-1 InSAR Coherence to Detect Floodwater in Urban Areas: Houston and Hurricane Harvey as A Test Case , 2019, Remote. Sens..

[7]  Changsheng Li,et al.  Mapping paddy rice agriculture in South and Southeast Asia using multi-temporal MODIS images , 2006 .

[8]  Jong-Sen Lee,et al.  Refined filtering of image noise using local statistics , 1981 .

[9]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[10]  Alan C. Bovik,et al.  Surface Water Mapping by Deep Learning , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Chengquan Huang,et al.  Automated Quantification of Surface Water Inundation in Wetlands Using Optical Satellite Imagery , 2017, Remote. Sens..

[12]  Yu Li,et al.  Multi-sensor cloud and cloud shadow segmentation with a convolutional neural network , 2019, Remote Sensing of Environment.

[13]  David C. Mason,et al.  etection of flooded urban areas in high resolution Synthetic perture Radar images using double scattering , 2013 .

[14]  Manchun Li,et al.  River Delineation from Remotely Sensed Imagery Using a Multi-Scale Classification Approach , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[16]  Perry C. Oddo,et al.  The Value of Near Real-Time Earth Observations for Improved Flood Disaster Response , 2019, Front. Environ. Sci..

[17]  Hanqiu Xu Modification of normalised difference water index (NDWI) to enhance open water features in remotely sensed imagery , 2006 .

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  J. Pekel,et al.  High-resolution mapping of global surface water and its long-term changes , 2016, Nature.

[20]  Sam Weber,et al.  From publishable to operational: new metrics to more honestly measure the ability of remote sensing algorithms to consistently monitor flooded assets and populations in near real time , 2019 .

[21]  Paul D. Bates,et al.  A Change Detection Approach to Flood Mapping in Urban Areas Using TerraSAR-X , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Stephen M. Chignell,et al.  Multi-Temporal Independent Component Analysis and Landsat 8 for Delineating Maximum Extent of the 2013 Colorado Front Range Flood , 2015, Remote. Sens..

[23]  A. Montanari,et al.  Satellite nighttime lights reveal increasing human exposure to floods worldwide , 2014 .

[24]  Martha C. Anderson,et al.  Exploiting the Convergence of Evidence in Satellite Data for Advanced Weather Index Insurance Design , 2018, Weather, Climate, and Society.

[25]  Matt J. Kusner,et al.  Cumulo: A Dataset for Learning Cloud Classes , 2019, ArXiv.

[26]  Xiaodong Li,et al.  Water Bodies' Mapping from Sentinel-2 Imagery with Modified Normalized Difference Water Index at 10-m Spatial Resolution Produced by Sharpening the SWIR Band , 2016, Remote. Sens..

[27]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[28]  Frank Hutter,et al.  Decoupled Weight Decay Regularization , 2017, ICLR.

[29]  Sujit Kumar Bala,et al.  FLOOD INUNDATION MAP OF BANGLADESH USING MODIS SURFACE REFLECTANCE DATA , 2009 .

[30]  Chengquan Huang,et al.  Rapid and robust monitoring of flood events using Sentinel-1 and Landsat data on the Google Earth Engine , 2020 .

[31]  Marc Rußwurm,et al.  Multi3Net: Segmenting Flooded Buildings via Fusion of Multiresolution, Multisensor, and Multitemporal Satellite Imagery , 2019, AAAI.

[32]  Benjamin H. Strauss,et al.  New elevation data triple estimates of global vulnerability to sea-level rise and coastal flooding , 2019, Nature Communications.

[33]  Marco Chini,et al.  A Hierarchical Split-Based Approach for Parametric Thresholding of SAR Images: Flood Inundation as a Test Case , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Julie Rozenberg,et al.  Unbreakable: Building the Resilience of the Poor in the Face of Natural Disasters , 2016 .

[35]  Yu Li,et al.  Urban flood mapping with an active self-learning convolutional neural network based on TerraSAR-X intensity and interferometric coherence , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[36]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .

[37]  David P. Roy,et al.  A Global Analysis of Sentinel-2A, Sentinel-2B and Landsat-8 Data Revisit Intervals and Implications for Terrestrial Monitoring , 2017, Remote. Sens..

[38]  Kaiming He,et al.  Group Normalization , 2018, ECCV.

[39]  Zhe Zhu,et al.  Current status of Landsat program, science, and applications , 2019, Remote Sensing of Environment.

[40]  Stefan Dech,et al.  Results of the Global WaterPack: a novel product to assess inland water body dynamics on a daily basis , 2015 .

[41]  Sandro Martinis,et al.  Towards operational near real-time flood detection using a split-based automatic thresholding procedure on high resolution TerraSAR-X data , 2009 .

[42]  Patrick Matgen,et al.  Flood detection from multi-temporal SAR data using harmonic analysis and change detection , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[43]  Xiaoling Chen,et al.  Assessment of inundation changes of Poyang Lake using MODIS observations between 2000 and 2010 , 2012 .

[44]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[45]  David B. Lobell,et al.  Weakly Supervised Deep Learning for Segmentation of Remote Sensing Imagery , 2020, Remote. Sens..

[46]  Elmar Eisemann,et al.  A 30 m Resolution Surface Water Mask Including Estimation of Positional and Thematic Differences Using Landsat 8, SRTM and OpenStreetMap: A Case Study in the Murray-Darling Basin, Australia , 2016, Remote. Sens..

[47]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  M. Marconcini,et al.  Normalized Difference Flood Index for rapid flood mapping: Taking advantage of EO big data , 2018 .

[49]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[50]  M. Boschetti,et al.  Comparative Analysis of Normalised Difference Spectral Indices Derived from MODIS for Detecting Surface Water in Flooded Rice Cropping Systems , 2014, PloS one.

[51]  Albert J. Kettner,et al.  Near-real-time non-obstructed flood inundation mapping using synthetic aperture radar , 2019, Remote Sensing of Environment.

[52]  Roberto Rudari,et al.  A global network for operational flood risk reduction , 2018, Environmental Science & Policy.

[53]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[54]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[55]  Xiao Xiang Zhu,et al.  SEN12MS - A Curated Dataset of Georeferenced Multi-Spectral Sentinel-1/2 Imagery for Deep Learning and Data Fusion , 2019, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[56]  E. Anderson,et al.  MODIS-BASED FLOOD DETECTION, MAPPING AND MEASUREMENT: THE POTENTIAL FOR OPERATIONAL HYDROLOGICAL APPLICATIONS , 2006 .