Recognizing Global Reservoirs From Landsat 8 Images: A Deep Learning Approach

Man-made reservoirs are key components of terrestrial hydrological systems. Identifying the location and number of reservoirs is the premise for studying the impact of human activities on water resources and environmental changes. While complete bottom-up censuses can provide a comprehensive view of the reservoir landscape, they are time-consuming and laborious and are thus infeasible on a global scale. Moreover, it is challenging to distinguish man-made reservoirs from natural lakes in remote sensing images. This study proposes a convolutional neural network (CNN)-based framework to recognize global reservoirs from Landsat 8 imageries. On the basis of the HydroLAKES dataset, a Landsat 8 cloud-free mosaic of 2017 was clipped for each feature (reservoir or lake) and was resized into 224 × 224 patches, which were collected as training and testing samples. Compared to other deep learning methods (Alexnet and VGG) and state-of-the-art traditional machine learning methods (support vector machine, random forest, gradient boosting, and bag-of-visual-words), we found that fine-tuning the pretrained CNN model, ResNet-50, could reach the highest accuracy (91.45%). Application cases in Kansas (USA, North America), Mpumalanga (South Africa, Africa), and Kostanay (Kazakhstan, Asia) resulted in classification accuracies of better than 99%, which showed the applicability of the proposed ResNet-50 model to the extraction of reservoirs from a vast amount of moderate resolution images. The framework that was developed in this paper is the first attempt to combine remote sensing big data and the deep learning technique to the recognition of reservoirs at a global scale.

[1]  F. Schwartz,et al.  Direct anthropogenic contributions to sea level rise in the twentieth century , 1994, Nature.

[2]  B. Chao.  Anthropogenic impact on global geodynamics due to reservoir water impoundment , 1995 .

[3]  L. S. Davis,et al.  An assessment of support vector machines for land cover classi(cid:142) cation , 2002 .

[4]  P. Döll,et al.  Development and validation of a global database of lakes, reservoirs and wetlands , 2004 .

[5]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[6]  D. Lettenmaier,et al.  Anthropogenic impacts on continental surface water fluxes , 2006 .

[7]  Hanqiu Xu.  Modification of normalised difference water index (NDWI) to enhance open water features in remotely sensed imagery , 2006 .

[8]  B. Chao,et al.  Impact of Artificial Reservoir Water Impoundment on Global Sea Level , 2008, Science.

[9]  B. Markham,et al.  Summary of Current Radiometric Calibration Coefficients for Landsat MSS, TM, ETM+, and EO-1 ALI Sensors , 2009 .

[10]  Shawn D. Newsam,et al.  Bag-of-visual-words and spatial extensions for land-use classification , 2010, GIS '10.

[11]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[12]  P. Döll,et al.  High‐resolution mapping of the world's reservoirs and dams for sustainable river‐flow management , 2011 .

[13]  T. Steenhuis,et al.  Estimation of Small Reservoir Storage Capacities with Remote Sensing in the Brazilian Savannah Region , 2012, Water Resources Management.

[14]  D. Lettenmaier,et al.  Global monitoring of large reservoir storage from satellite remote sensing , 2011 .

[15]  Wen Yang,et al.  High-resolution satellite scene classification using a sparse coding based multiple feature combination , 2012 .

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[17]  Ral Garreta,et al.  Learning scikit-learn: Machine Learning in Python , 2013 .

[18]  Zhao Baojun,et al.  Airport target detection algorithm in remote sensing images based on JPEG2000 compressed domain , 2013 .

[19]  Xixi Lu,et al.  Drastic change in China's lakes and reservoirs over the past decades , 2014, Scientific Reports.

[20]  Hong Sun,et al.  Unsupervised feature coding on local patch manifold for satellite image scene classification , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[21]  Tong Zhang,et al.  Deep Learning Based Feature Selection for Remote Sensing Scene Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[22]  Nagesh Poojary,et al.  Automatic target detection in hyperspectral image processing: A review of algorithms , 2015, 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[23]  P. Gong,et al.  Target Detection Method for Water Mapping Using Landsat 8 OLI/TIRS Imagery , 2015 .

[24]  J. Crétaux,et al.  Global surveys of reservoirs and lakes from satellites and regional application to the Syrdarya river basin , 2015 .

[25]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[26]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[27]  Liangpei Zhang,et al.  Combining Pixel- and Object-Based Machine Learning for Identification of Water-Body Types From Urban High-Resolution Remote-Sensing Imagery , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Zhenwei Shi,et al.  Ship Detection in Spaceborne Optical Image With SVD Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Heng-Ming Tai,et al.  Rotation and scale invariant target detection in optical remote sensing images based on pose-consistency voting , 2016, Multimedia Tools and Applications.

[30]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Uwe Stilla,et al.  Deep Learning Earth Observation Classification Using ImageNet Pretrained Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[32]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[33]  B. Lehner,et al.  Estimating the volume and age of water stored in global lakes using a geo-statistical approach , 2016, Nature Communications.

[34]  J. Schmidt,et al.  How dams can go with the flow , 2016, Science.

[35]  X. Tong,et al.  Evaluation of Landsat 8 OLI imagery for unsupervised inland water extraction , 2016 .

[36]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[37]  Aoxue Li,et al.  Global and Local Saliency Analysis for the Extraction of Residential Areas in High-Spatial-Resolution Remote Sensing Image , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Hong Huo,et al.  Integrating saliency and ResNet for airport detection in large-size remote sensing images , 2017, 2017 2nd International Conference on Image, Vision and Computing (ICIVC).

[39]  Michael Dixon,et al.  Google Earth Engine: Planetary-scale geospatial analysis for everyone , 2017 .

[40]  Hamid R. Tizhoosh,et al.  A comparative study of CNN, BoVW and LBP for classification of histopathological images , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[41]  Jin-Hee Lee,et al.  ResNet-Based Vehicle Classification and Localization in Traffic Surveillance Systems , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[42]  Alan C. Bovik,et al.  Surface Water Mapping by Deep Learning , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[43]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[44]  Fabio Tozeto Ramos,et al.  Malicious Software Classification Using Transfer Learning of ResNet-50 Deep Neural Network , 2017, 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA).

[45]  B. Deemer,et al.  Key differences between lakes and reservoirs modify climate signals: A case for a new conceptual model , 2017 .

[46]  Gui-Song Xia,et al.  AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Xuan Wang,et al.  A Hierarchical Maritime Target Detection Method for Optical Remote Sensing Imagery , 2017, Remote. Sens..

[48]  S. Gorelick,et al.  A remote sensing method for estimating regional reservoir area and evaporative loss , 2017 .

[49]  Yong Dou,et al.  Airport Detection on Optical Satellite Images Using Deep Convolutional Neural Networks , 2017, IEEE Geoscience and Remote Sensing Letters.

[50]  Ronald Kemker,et al.  Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[51]  Xin Pan,et al.  VPRS-Based Regional Decision Fusion of CNN and MRF Classifications for Very Fine Resolution Remotely Sensed Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Jie Geng,et al.  SAR Image Classification via Deep Recurrent Encoding Neural Networks , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Guangluan Xu,et al.  Aircraft Type Recognition Based on Segmentation With Deep Convolutional Neural Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[54]  Brian Brisco,et al.  Remote sensing for wetland classification: a comprehensive review , 2018 .

[55]  Jiebo Luo,et al.  DOTA: A Large-Scale Dataset for Object Detection in Aerial Images , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[56]  Chao Yang,et al.  A Survey on Deep Transfer Learning , 2018, ICANN.

[57]  Qian Du,et al.  Classification of Hyperspectral Imagery Using a New Fully Convolutional Neural Network , 2018, IEEE Geoscience and Remote Sensing Letters.

[58]  Yishu Liu,et al.  Scene Classification Based on Two-Stage Deep Feature Fusion , 2018, IEEE Geoscience and Remote Sensing Letters.

[59]  Richa Singh,et al.  Learning Structure and Strength of CNN Filters for Small Sample Size Training , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.