A novel water body extraction neural network (WBE-NN) for optical high-resolution multispectral imagery

Abstract Surface water mapping is very important for studying its role in global water cycle, flooding dynamic monitoring, and water resources management. The most famous techniques for water body extraction like those based on water spectral indices (WSI) require rich spectral information. However, the WSI methods are no longer practical in high-resolution multispectral (MS) images due to insufficient spectral information. In addition, surface water mapping faces an utmost overestimation issue because shadows are misclassified as water bodies. To address the above-mentioned problems, in this paper, a novel refined water body extraction neural network (WBE-NN) is proposed. The global spatial-spectral convolution (GSSC) module is developed to enhance surface water body features. A novel multiscale learning module is designed to extract multi-scale contextual information. In addition, the surface water body boundary refinement (SWBBR) module is adopted to enhance surface water body boundaries. The results show that the proposed method achieved good performance with a mean overall accuracy of 98.97%, a mean Kappa coefficient of 94.78%, and a mean boundary overall accuracy of 98.01%. Therefore, WBE-NN can be used for mapping surface water with high accuracy in complex areas.

[1]  Liangpei Zhang,et al.  Combining Pixel- and Object-Based Machine Learning for Identification of Water-Body Types From Urban High-Resolution Remote-Sensing Imagery , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Hanqiu Xu.  Modification of normalised difference water index (NDWI) to enhance open water features in remotely sensed imagery , 2006 .

[3]  Xiangyun Hu,et al.  Multiscale Refinement Network for Water-Body Segmentation in High-Resolution Satellite Imagery , 2020, IEEE Geoscience and Remote Sensing Letters.

[4]  Na Zhao,et al.  Mapping of Urban Surface Water Bodies from Sentinel-2 MSI Imagery at 10 m Resolution via NDWI-Based Image Sharpening , 2017, Remote. Sens..

[5]  Ying Li,et al.  Spectral-Spatial Classification of Hyperspectral Imagery with 3D Convolutional Neural Network , 2017, Remote. Sens..

[6]  Pierre Grussenmeyer,et al.  Urban surface water body detection with suppressed built-up noise based on water indices from Sentinel-2 MSI imagery , 2018, Remote Sensing of Environment.

[7]  Yang Chen,et al.  Road Extraction from High-Resolution Remote Sensing Imagery Using Refined Deep Residual Convolutional Neural Network , 2019, Remote. Sens..

[8]  LianLin Li,et al.  Fusion Feature Multi-Scale Pooling for Water Body Extraction from Optical Panchromatic Images , 2019, Remote. Sens..

[9]  Kavita Shah,et al.  Floodplain Mapping through Support Vector Machine and Optical/Infrared Images from Landsat 8 OLI/TIRS Sensors: Case Study from Varanasi , 2017, Water Resources Management.

[10]  Alan C. Bovik,et al.  Surface Water Mapping by Deep Learning , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Feng Li,et al.  Fusion of Multiscale Convolutional Neural Networks for Building Extraction in Very High-Resolution Images , 2019, Remote. Sens..

[12]  Gui-Song Xia,et al.  Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery , 2015, Remote. Sens..

[13]  Haigang Sui,et al.  Water Body Extraction From Very High-Resolution Remote Sensing Imagery Using Deep U-Net and a Superpixel-Based Conditional Random Field Model , 2019, IEEE Geoscience and Remote Sensing Letters.

[14]  J. Pekel,et al.  High-resolution mapping of global surface water and its long-term changes , 2016, Nature.

[15]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[16]  M. Tulbure,et al.  Spatiotemporal dynamic of surface water bodies using Landsat time-series data from 1999 to 2011 , 2013 .

[17]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[18]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[19]  Yang Chen,et al.  Extraction of Urban Water Bodies from High-Resolution Remote-Sensing Imagery Using Deep Learning , 2018 .

[20]  Tara N. Sainath,et al.  Improving deep neural networks for LVCSR using rectified linear units and dropout , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[21]  Rasmus Fensholt,et al.  Automated Water Extraction Index: A new technique for surface water mapping using Landsat imagery , 2014 .

[22]  Menglong Yan,et al.  Automatic Water-Body Segmentation From High-Resolution Satellite Images via Deep Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[23]  Muhammad Bilal,et al.  Multilevel Cloud Detection for High-Resolution Remote Sensing Imagery Using Multiple Convolutional Neural Networks , 2018, ISPRS Int. J. Geo Inf..

[24]  Parisa Kordjamshidi,et al.  Deep Convolutional Neural Network for Flood Extent Mapping Using Unmanned Aerial Vehicles Data , 2019, Sensors.

[25]  Jun Kong,et al.  Convolutional Neural Networks for Water Body Extraction from Landsat Imagery , 2017, Int. J. Comput. Intell. Appl..

[26]  Tong Zhang,et al.  Deep Learning Based Feature Selection for Remote Sensing Scene Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[27]  Olli Varis,et al.  China's 8 challenges to water resources management in the first quarter of the 21st Century , 2001 .

[28]  Yan Peng,et al.  Multilayer Perceptron Neural Network for Surface Water Extraction in Landsat 8 OLI Satellite Images , 2018, Remote. Sens..

[29]  T. Huntington.  Evidence for intensification of the global water cycle: Review and synthesis , 2006 .

[30]  R. Pontius,et al.  Death to Kappa: birth of quantity disagreement and allocation disagreement for accuracy assessment , 2011 .

[31]  Ali Selamat,et al.  Water Feature Extraction and Change Detection Using Multitemporal Landsat Imagery , 2014, Remote. Sens..

[32]  Wei Lee Woon,et al.  Simultaneous extraction of roads and buildings in remote sensing imagery with convolutional neural networks , 2017 .

[33]  Lei Wang,et al.  Object-Based Convolutional Neural Networks for Cloud and Snow Detection in High-Resolution Multispectral Imagers , 2018, Water.

[34]  Pierre Alliez,et al.  Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[35]  S. K. McFeeters.  The use of the Normalized Difference Water Index (NDWI) in the delineation of open water features , 1996 .

[36]  A. Vetrivel,et al.  Disaster damage detection through synergistic use of deep learning and 3D point cloud features derived from very high resolution oblique aerial images, and multiple-kernel-learning , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.