Achieving Higher Resolution Lake Area from Remote Sensing Images Through an Unsupervised Deep Learning Super-Resolution Method

Lakes have been identified as an important indicator of climate change and a finer lake area can better reflect the changes. In this paper, we propose an effective unsupervised deep gradient network (UDGN) to generate a higher resolution lake area from remote sensing images. By exploiting the power of deep learning, UDGN models the internal recurrence of information inside the single image and its corresponding gradient map to generate images with higher spatial resolution. The gradient map is derived from the input image to provide important geographical information. Since the training samples are only extracted from the input image, UDGN can adapt to different settings per image. Based on the superior adaptability of the UDGN model, two strategies are proposed for super-resolution (SR) mapping of lakes from multispectral remote sensing images. Finally, Landsat 8 and MODIS (moderate-resolution imaging spectroradiometer) images from two study areas on the Tibetan Plateau in China were used to evaluate the performance of UDGN. Compared with four unsupervised SR methods, UDGN obtained the best SR results as well as lake extraction results in terms of both quantitative and visual aspects. The experiments prove that our approach provides a promising way to break through the limitations of median-low resolution remote sensing images in lake change monitoring, and ultimately support finer lake applications.

[1]  Yun Chen,et al.  Improved Urban Flooding Mapping from Remote Sensing Images Using Generalized Regression Neural Network-Based Super-Resolution Algorithm , 2016, Remote. Sens..

[2]  Yongwei Sheng,et al.  Response of inland lake dynamics over the Tibetan Plateau to climate change , 2014, Climatic Change.

[3]  Hanqiu Xu.  Modification of normalised difference water index (NDWI) to enhance open water features in remotely sensed imagery , 2006 .

[4]  Zongxu Pan,et al.  Achieving Super-Resolution Remote Sensing Images via the Wavelet Transform Combined With the Recursive Res-Net , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Yongwei Sheng,et al.  Lake seasonality across the Tibetan Plateau and their varying relationship with regional mass changes and local hydrology , 2017 .

[6]  Haihua Shen,et al.  Rapid loss of lakes on the Mongolian Plateau , 2015, Proceedings of the National Academy of Sciences.

[7]  Xia Wang,et al.  Unsupervised Sub-Pixel Water Body Mapping with Sentinel-3 OLCI Image , 2019, Remote. Sens..

[8]  Thomas S. Huang,et al.  Image Super-Resolution via Dual-State Recurrent Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Gregory Shakhnarovich,et al.  Deep Back-Projection Networks for Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Konrad Schindler,et al.  Super-Resolution of Sentinel-2 Images: Learning a Globally Applicable Deep Neural Network , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[11]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Xu Zekai,et al.  Deep gradient prior network for DEM super-resolution: Transfer learning from image to DEM , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[13]  G. Weyhenmeyer,et al.  Lakes as sentinels of climate change , 2009, Limnology and oceanography.

[14]  Yang Hong,et al.  A lake data set for the Tibetan Plateau from the 1960s, 2005, and 2014 , 2016, Scientific Data.

[15]  Shilong Piao,et al.  Regional differences of lake evolution across China during 1960s–2015 and its natural and anthropogenic causes , 2019, Remote Sensing of Environment.

[16]  Chang Huang,et al.  Super-resolution mapping of wetland inundation from remote sensing imagery based on integration of back-propagation neural network and genetic algorithm , 2015 .

[17]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Filiberto Pla,et al.  A New Deep Generative Network for Unsupervised Remote Sensing Single-Image Super-Resolution , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Xiaodong Liu,et al.  Distinct impacts of the Mongolian and Tibetan Plateaus on the evolution of the East Asian monsoon , 2015 .

[20]  S. K. McFeeters.  The use of the Normalized Difference Water Index (NDWI) in the delineation of open water features , 1996 .

[21]  Takio Kurita,et al.  Fast and Accurate Image Super Resolution by Deep CNN with Skip Connection and Network in Network , 2017, ICONIP.

[22]  Michal Irani,et al.  Internal statistics of a single natural image , 2011, CVPR 2011.

[23]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[24]  Yunsong Li,et al.  Hyperspectral Image Super-Resolution Using Deep Feature Matrix Factorization , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Zhenhong Du,et al.  Remote Sensing Single-Image Resolution Improvement Using A Deep Gradient-Aware Network with Image-Specific Enhancement , 2020, Remote. Sens..

[26]  Hongjie Xie,et al.  Extensive and drastically different alpine lake changes on Asia's high plateaus during the past four decades , 2017, Geophysical Research Letters.

[27]  David P. Hamilton,et al.  Rapid and highly variable warming of lake surface waters around the globe , 2015 .

[28]  Steven C. H. Hoi,et al.  Deep Learning for Image Super-Resolution: A Survey , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Narendra Ahuja,et al.  Single image super-resolution from transformed self-exemplars , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[31]  Bo Huang,et al.  Modeling and analysis of lake water storage changes on the Tibetan Plateau using multi-mission satellite data , 2013 .

[32]  Baojin Qiao,et al.  Temporal-spatial differences in lake water storage changes and their links to climate change throughout the Tibetan Plateau , 2019, Remote Sensing of Environment.

[33]  Michal Irani,et al.  "Zero-Shot" Super-Resolution Using Deep Internal Learning , 2017, CVPR.

[34]  Siyuan Liu,et al.  Unsupervised Image Super-Resolution Using Cycle-in-Cycle Generative Adversarial Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[35]  Chen Zixuan,et al.  Nonlocal similarity based DEM super resolution , 2015 .

[36]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.