U-Net-STN: A Novel End-to-End Lake Boundary Prediction Model

Detecting changes in land cover is a critical task in remote sensing image interpretation, with particular significance placed on accurately determining the boundaries of lakes. Lake boundaries are closely tied to land resources, and any alterations can have substantial implications for the surrounding environment and ecosystem. This paper introduces an innovative end-to-end model that combines U-Net and spatial transformation network (STN) to predict changes in lake boundaries and investigate the evolution of the Lake Urmia boundary. The proposed approach involves pre-processing annual panoramic remote sensing images of Lake Urmia, obtained from 1996 to 2014 through Google Earth Pro Version 7.3 software, using image segmentation and grayscale filling techniques. The results of the experiments demonstrate the model’s ability to accurately forecast the evolution of lake boundaries in remote sensing images. Additionally, the model exhibits a high degree of adaptability, effectively learning and adjusting to changing patterns over time. The study also evaluates the influence of varying time series lengths on prediction accuracy and reveals that longer time series provide a larger number of samples, resulting in more precise predictions. The maximum achieved accuracy reaches 89.3%. The findings and methodologies presented in this study offer valuable insights into the utilization of deep learning techniques for investigating and managing lake boundary changes, thereby contributing to the effective management and conservation of this significant ecosystem.

[1]  Xiuhong Li,et al.  A Multi-Objective Semantic Segmentation Algorithm Based on Improved U-Net Networks , 2023, Remote. Sens..

[2]  B. Liu,et al.  A Lake Extraction Method Combining the Object-Oriented Method with Boundary Recognition , 2023, Land.

[3]  Qing Tian,et al.  TMF-Net: Aircraft detection of remote sensing images using transformer and multi-scale fusion , 2022, Other Conferences.

[4]  Ruisheng Jia,et al.  Lake water body extraction of optical remote sensing images based on semantic segmentation , 2022, Applied Intelligence.

[5]  Jinlong Fan,et al.  Improved U-Net Remote Sensing Classification Algorithm Based on Multi-Feature Fusion Perception , 2022, Remote. Sens..

[6]  Joon Huang Chuah,et al.  Structural crack detection using deep convolutional neural networks , 2022, Automation in Construction.

[7]  Zhaobin Wang,et al.  HA-Net: A Lake Water Body Extraction Network Based on Hybrid-Scale Attention and Transfer Learning , 2021, Remote. Sens..

[8]  Haonan Chen,et al.  Convective precipitation nowcasting using U-Net Model , 2021, 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS.

[9]  A. Julzarika,et al.  Integration of the latest Digital Terrain Model (DTM) with Synthetic Aperture Radar (SAR) Bathymetry , 2021, Journal of Degraded and Mining Lands Management.

[10]  Øivind Due Trier,et al.  Automated mapping of cultural heritage in Norway from airborne lidar data using faster R-CNN , 2021, Int. J. Appl. Earth Obs. Geoinformation.

[11]  Maria Lazaridou,et al.  Remote sensing image segmentation advances: A meta-analysis , 2021 .

[12]  Qiang Wang,et al.  LaeNet: A Novel Lightweight Multitask CNN for Automatically Extracting Lake Area and Shoreline from Remote Sensing Images , 2020, Remote. Sens..

[13]  Yaonan Zhang,et al.  MSLWENet: A Novel Deep Learning Network for Lake Water Body Extraction of Google Remote Sensing Images , 2020, Remote. Sens..

[14]  Harintaka,et al.  Utilization of DSM and DTM for Spatial Information in Lake Border , 2020, IOP Conference Series: Earth and Environmental Science.

[15]  J. Lenters,et al.  Global lake responses to climate change , 2020, Nature Reviews Earth & Environment.

[16]  Vivekananda G N,et al.  Multi-temporal image analysis for LULC classification and change detection , 2020 .

[17]  Yueming Hu,et al.  Deep Learning Segmentation and Classification for Urban Village Using a Worldview Satellite Image Based on U-Net , 2020, Remote. Sens..

[18]  Min Xia,et al.  Water Areas Segmentation from Remote Sensing Images Using a Separable Residual SegNet Network , 2020, ISPRS Int. J. Geo Inf..

[19]  Jimin Liang,et al.  Medical Image Segmentation based on U-Net: A Review , 2020, Journal of Imaging Science and Technology.

[20]  Liang Zhu,et al.  How Well Do Deep Learning-Based Methods for Land Cover Classification and Object Detection Perform on High Resolution Remote Sensing Imagery? , 2020, Remote. Sens..

[21]  Junwei Han,et al.  Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmark , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[22]  A. Alam,et al.  Using Landsat satellite data for assessing the land use and land cover change in Kashmir valley , 2019, GeoJournal.

[23]  Rongsheng Dong,et al.  DenseU-Net-Based Semantic Segmentation of Small Objects in Urban Remote Sensing Images , 2019, IEEE Access.

[24]  Armando Barreto,et al.  A comprehensive survey on impulse and Gaussian denoising filters for digital images , 2019, Signal Process..

[25]  Baojin Qiao,et al.  Temporal-spatial differences in lake water storage changes and their links to climate change throughout the Tibetan Plateau , 2019, Remote Sensing of Environment.

[26]  Shilong Piao,et al.  Regional differences of lake evolution across China during 1960s–2015 and its natural and anthropogenic causes , 2019, Remote Sensing of Environment.

[27]  Yange Li,et al.  Noncontact detection of earthquake-induced landslides by an enhanced image binarization method incorporating with Monte-Carlo simulation , 2019, Geomatics, Natural Hazards and Risk.

[28]  Yunhong Wang,et al.  Change Detection Based on Deep Features and Low Rank , 2017, IEEE Geoscience and Remote Sensing Letters.

[29]  Giorgos Mountrakis,et al.  A meta-analysis of remote sensing research on supervised pixel-based land-cover image classification processes: General guidelines for practitioners and future research , 2016 .

[30]  Max Jaderberg,et al.  Spatial Transformer Networks , 2015, NIPS.

[31]  Shubham Joshi,et al.  Image Segmentation using Morphological Operations , 2015 .

[32]  Ronghua Ma,et al.  Monitoring lake changes of Qinghai-Tibetan Plateau over the past 30 years using satellite remote sensing data , 2014 .

[33]  Peng Gong,et al.  Modelling spatial‐temporal change of Poyang Lake using multitemporal Landsat imagery , 2008 .

[34]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[35]  G. Petsko Transformation , 2006, Genome Biology.

[36]  Ram M. Narayanan,et al.  A shape-based approach to change detection of lakes using time series remote sensing images , 2003, IEEE Trans. Geosci. Remote. Sens..

[37]  D. Bolinger According to , 1990 .

[38]  Liqiang Zhang,et al.  Multispectral Scene Classification via Cross-Modal Knowledge Distillation , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Ying Cui,et al.  RSSGL: Statistical Loss Regularized 3-D ConvLSTM for Hyperspectral Image Classification , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[40]  C. Jamet,et al.  LiDAR Remote Sensing for Vertical Distribution of Seawater Optical Properties and Chlorophyll-a From the East China Sea to the South China Sea , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[41]  A. Brand,et al.  SEMANTIC SEGMENTATION OF BURNED AREAS IN SATELLITE IMAGES USING A U-NET-BASED CONVOLUTIONAL NEURAL NETWORK , 2021 .

[42]  George Vosselman,et al.  Silvi-Net - A dual-CNN approach for combined classification of tree species and standing dead trees from remote sensing data , 2021, Int. J. Appl. Earth Obs. Geoinformation.

[43]  Hengchao Li,et al.  Research Progress on Few-Shot Learning for Remote Sensing Image Interpretation , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[44]  Tao Ke,et al.  Robust Radiometric Normalization of Multitemporal Satellite Images Via Block Adjustment Without Master Images , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[45]  Jamal Jokar Arsanjani,et al.  Characterizing, monitoring, and simulating land cover dynamics using GlobeLand30: A case study from 2000 to 2030. , 2018, Journal of environmental management.

[46]  Feature Fusion , 2009, Encyclopedia of Biometrics.

[47]  Alejandro Erickson,et al.  Input , 2002, SLA Applied.