Deep learning approach for Sentinel-1 surface water mapping leveraging Google Earth Engine

Abstract Satellite remote sensing plays an important role in mapping the location and extent of surface water. A variety of approaches are available for mapping surface water, but deep learning approaches are not commonplace as they are ‘data hungry’ and require large amounts of computational resources. However, with the availability of various satellite sensors and rapid development in cloud computing, the remote sensing scientific community is adapting modern deep learning approaches. The new integration of cloud-based Google AI platform and Google Earth Engine enables users to deploy calculations at scale. In this paper, we investigate two methods of automatic data labeling: 1. the Joint Research Centre (JRC) surface water maps; 2. an Edge-Otsu dynamic threshold approach. We deployed a U-Net convolutional neural network to map surface water from Sentinel-1 Synthetic Aperture Radar (SAR) data and tested the model performance using different hyperparameter tuning combinations to identify the optimal learning rate and loss function. The performance was then evaluated using an independent validation data set. We tested 12 models overall and found that the models utilizing the JRC data labels showed a better model performance, with F1-scores ranging from 0.972 to 0.986 for the training test and validation efforts. Additionally, an independently sampled high-resolution data set was used to further evaluate model performance. From this independent validation effort we observed models leveraging JRC data labels produced F1-Scores ranging from 0.9130.922. A pairwise comparison of models, through varying input data, learning rates, and loss functions constituents, revealed the JRC Adjusted Binary Cross Entropy Dice model to be statistically different than the 66 other model combinations and displayed the highest relative evaluations metrics including accuracy, precision score, Cohen Kappa coefficient, and F1-score. These results are in the same range as many of the conventional methods. We observed that the integration of Google AI Platform into Google Earth Engine can be a powerful tool to deploy deep-learning algorithms at scale and that automatic data labeling can be an effective strategy in the development of deep-learning models, however independent data validation remains an important step in model evaluation.

[1]  R. Srikant,et al.  Why Deep Neural Networks for Function Approximation? , 2016, ICLR.

[2]  David Saah,et al.  Collect Earth: An online tool for systematic reference data collection in land cover and use applications , 2019, Environ. Model. Softw..

[3]  Matthew Patterson,et al.  Land Cover Mapping in Data Scarce Environments: Challenges and Opportunities , 2019, Front. Environ. Sci..

[4]  Preliminary Study on the Radar Vegetation Index (RVI) Application to Actual Paddy Fields by ALOS/PALSAR Full-polarimetry SAR Data , 2015 .

[5]  J. Pekel,et al.  High-resolution mapping of global surface water and its long-term changes , 2016, Nature.

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  Maggi Kelly,et al.  Remotely Sensed Water Limitation in Vegetation: Insights from an Experiment with Unmanned Aerial Vehicles (UAVs) , 2019, Remote. Sens..

[8]  Jonathan Tompson,et al.  Efficient object localization using Convolutional Networks , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  B. Gao NDWI—A normalized difference water index for remote sensing of vegetation liquid water from space , 1996 .

[10]  M. Hansen,et al.  Annual continuous fields of woody vegetation structure in the Lower Mekong region from 2000‐2017 Landsat time-series , 2019, Remote Sensing of Environment.

[11]  Q. Mcnemar Note on the sampling error of the difference between correlated proportions or percentages , 1947, Psychometrika.

[12]  Betlem Rosich,et al.  Sentinel-1 mission operations concept , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[13]  Chengquan Huang,et al.  Automated Extraction of Surface Water Extent from Sentinel-1 Data , 2018, Remote. Sens..

[14]  N. C. Dom Habitat characterization of Anopheles sp. mosquito larvae in Malaria risk areas , 2019 .

[15]  Xiuwen Liu,et al.  A patch-based convolutional neural network for remote sensing image classification , 2017, Neural Networks.

[16]  M. Kummu,et al.  Water balance analysis for the Tonle Sap Lake–floodplain system , 2014 .

[17]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[18]  Vincent Dumoulin,et al.  Deconvolution and Checkerboard Artifacts , 2016 .

[19]  Kel Markert,et al.  Operational Flood Risk Index Mapping for Disaster Risk Reduction Using Earth Observations and Cloud Computing Technologies: A Case Study on Myanmar , 2019, Front. Environ. Sci..

[20]  M. Lefsky,et al.  Mapping tropical forest biomass with radar and spaceborne LiDAR in Lopé National Park, Gabon: Overcoming problems of high biomass and persistent cloud , 2012 .

[21]  D. Chicco,et al.  The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation , 2020, BMC Genomics.

[22]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[23]  Y. Yao,et al.  On Early Stopping in Gradient Descent Learning , 2007 .

[24]  Malcolm Davidson,et al.  GMES Sentinel-1 mission , 2012 .

[25]  Thomas L. Ainsworth,et al.  Improved Sigma Filter for Speckle Filtering of SAR Imagery , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Michael Dixon,et al.  Google Earth Engine: Planetary-scale geospatial analysis for everyone , 2017 .

[27]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[28]  Kristen O'Shea,et al.  Improved Remote Sensing Methods to Detect Northern Wild Rice (Zizania palustris L.) , 2020, Remote. Sens..

[29]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[30]  Yeong-Sun Song,et al.  Efficient water area classification using radarsat-1 SAR imagery in a high relief mountainous environment , 2007 .

[31]  Nathaniel P. Robinson,et al.  Mean Composite Fire Severity Metrics Computed with Google Earth Engine Offer Improved Accuracy and Expanded Mapping Potential , 2018, Remote. Sens..

[32]  W. Jetz,et al.  Remotely Sensed High-Resolution Global Cloud Dynamics for Predicting Ecosystem and Biodiversity Distributions , 2016, PLoS biology.

[33]  Z. Çakır,et al.  Sensitivity Analysis of Multi-Temporal Sentinel-1 SAR Parameters to Crop Height and Canopy Coverage , 2019, Applied Sciences.

[34]  L. Jorge,et al.  A Review on Deep Learning in UAV Remote Sensing , 2021, Int. J. Appl. Earth Obs. Geoinformation.

[35]  K. Tockner,et al.  Riverine flood plains: present state and future trends , 2002, Environmental Conservation.

[36]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[37]  Xiao Xiang Zhu,et al.  Deep learning in remote sensing: a review , 2017, ArXiv.

[38]  David Saah,et al.  A Self-Calibrating Runoff and Streamflow Remote Sensing Model for Ungauged Basins Using Open-Access Earth Observation Data , 2017, Remote. Sens..

[39]  David Saah,et al.  Comparing Sentinel-1 Surface Water Mapping Algorithms and Radiometric Terrain Correction Processing in Southeast Asia Utilizing Google Earth Engine , 2020, Remote. Sens..

[40]  Perry C. Oddo,et al.  The Value of Near Real-Time Earth Observations for Improved Flood Disaster Response , 2019, Front. Environ. Sci..

[41]  Ryan Anderson,et al.  CO-RIP: A Riparian Vegetation and Corridor Extent Dataset for Colorado River Basin Streams and Rivers , 2018, ISPRS Int. J. Geo Inf..

[42]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[43]  T. Jackson,et al.  Multitemporal monitoring of soil moisture with RADARSAT SAR during the 1997 Southern Great Plains hydrology experiment , 2001 .

[44]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Masanobu Shimada,et al.  Mapping Regional Inundation with Spaceborne L-Band SAR , 2015, Remote. Sens..

[46]  David Saah,et al.  A publicly available GIS-based web platform for reservoir inundation mapping in the lower Mekong region , 2020, Environ. Model. Softw..

[47]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[48]  Rohan Mahadev,et al.  Learning From Less Data: A Unified Data Subset Selection and Active Learning Framework for Computer Vision , 2019, 2019 IEEE Winter Conference on Applications of Computer Vision (WACV).

[49]  Andrea Tassi,et al.  Object-Oriented LULC Classification in Google Earth Engine Combining SNIC, GLCM, and Machine Learning Algorithms , 2020, Remote. Sens..

[50]  Franz J. Meyer,et al.  Operational Flood Mapping Using Multi-Temporal Sentinel-1 SAR Images: A Case Study from Bangladesh , 2019, Remote. Sens..

[51]  W. G. Cochran The comparison of percentages in matched samples. , 1950, Biometrika.

[52]  W. L. Ellenburg,et al.  Flood inundation mapping- Kerala 2018; Harnessing the power of SAR, automatic threshold detection method and Google Earth Engine , 2020, PloS one.

[53]  Xixi Lu,et al.  Application of Remote Sensing in Flood Management with Special Reference to Monsoon Asia: A Review , 2004 .

[54]  Bei Jiang,et al.  Negative Log Likelihood Ratio Loss for Deep Neural Network Classification , 2018, Advances in Intelligent Systems and Computing.

[55]  David Saah,et al.  Mapping Plantations in Myanmar by Fusing Landsat-8, Sentinel-2 and Sentinel-1 Data along with Systematic Error Quantification , 2019, Remote. Sens..

[56]  David J. Ganz,et al.  On Spatially Distributed Hydrological Ecosystem Services: Bridging the Quantitative Information Gap using Remote Sensing and Hydrological Models , 2017 .

[57]  W. L. Ellenburg,et al.  Linking Earth Observations for Assessing the Food Security Situation in Vietnam: A Landscape Approach , 2019, Front. Environ. Sci..

[58]  B. Brisco,et al.  Evaluation of C-band polarization diversity and polarimetry for wetland mapping , 2011 .

[59]  Paul D. Bates,et al.  Waterline mapping in flooded vegetation from airborne SAR imagery , 2003 .

[60]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[61]  David A. Seal,et al.  The Shuttle Radar Topography Mission , 2007 .

[62]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[63]  P. Podwojewski,et al.  Runoff and sediment losses from 27 upland catchments in Southeast Asia: impact of rapid land use changes and conservation practices. , 2008 .

[64]  Andrew J. Lister,et al.  Land use change monitoring in Maryland using a probabilistic sample and rapid photointerpretation , 2014 .

[65]  Stuart E. Marsh,et al.  Cover- and density-based vegetation classifications of the Sonoran Desert using Landsat TM and ERS-1 SAR imagery , 2004 .

[66]  Upendra Oli,et al.  Generation of High Resolution DSM Using UAV Images , 2015 .

[67]  Austin Troy,et al.  An Operational Before-After-Control-Impact (BACI) Designed Platform for Vegetation Monitoring at Planetary Scale , 2018, Remote. Sens..

[68]  B. Brisco,et al.  The application of C-band polarimetric SAR for agriculture: a review , 2004 .

[69]  Emma Izquierdo-Verdiguier,et al.  A Cloud-Based Multi-Temporal Ensemble Classifier to Map Smallholder Farming Systems , 2018, Remote. Sens..

[70]  Alireza Fathi,et al.  The Devil is in the Decoder: Classification, Regression and GANs , 2017, International Journal of Computer Vision.

[71]  V. Misra,et al.  The variability of the Southeast Asian summer monsoon , 2014 .

[72]  Chengquan Huang,et al.  Automated extraction of inland surface water extent from Sentinel-1 data , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[73]  Elmar Eisemann,et al.  A 30 m Resolution Surface Water Mask Including Estimation of Positional and Thematic Differences Using Landsat 8, SRTM and OpenStreetMap: A Case Study in the Murray-Darling Basin, Australia , 2016, Remote. Sens..

[74]  Álvaro Moreno-Martínez,et al.  Numerical Terradynamic Simulation Group 7-2018 Global Estimation of Biophysical Variables from Google Earth Engine Platform , 2018 .

[75]  David Small,et al.  Flattening Gamma: Radiometric Terrain Correction for SAR Imagery , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[76]  Corpetti Thomas,et al.  UAV & satellite synergies for optical remote sensing applications: A literature review , 2021, Science of Remote Sensing.

[77]  S. Lek,et al.  Spatio-temporal variation of fish taxonomic composition in a South-East Asian flood-pulse system , 2017, PloS one.

[78]  Thomas J. Jackson,et al.  Radar Vegetation Index for Estimating the Vegetation Water Content of Rice and Soybean , 2012, IEEE Geoscience and Remote Sensing Letters.

[79]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[80]  Guozhong An,et al.  The Effects of Adding Noise During Backpropagation Training on a Generalization Performance , 1996, Neural Computation.

[81]  Michał Grochowski,et al.  Data augmentation for improving deep learning in image classification problem , 2018, 2018 International Interdisciplinary PhD Workshop (IIPhDW).

[82]  Joseph Bullock,et al.  Fully Convolutional Neural Network for Rapid Flood Segmentation in Synthetic Aperture Radar Imagery , 2020, Remote. Sens..

[83]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[84]  David J. Ganz,et al.  Historical and Operational Monitoring of Surface Sediments in the Lower Mekong Basin Using Landsat and Google Earth Engine Cloud Computing , 2018, Remote. Sens..