ACFNet: A Feature Fusion Network for Glacial Lake Extraction Based on Optical and Synthetic Aperture Radar Images

Glacial lake extraction is essential for studying the response of glacial lakes to climate change and assessing the risks of glacial lake outburst floods. Most methods for glacial lake extraction are based on either optical images or synthetic aperture radar (SAR) images. Although deep learning methods can extract features of optical and SAR images well, efficiently fusing two modality features for glacial lake extraction with high accuracy is challenging. In this study, to make full use of the spectral characteristics of optical images and the geometric characteristics of SAR images, we propose an atrous convolution fusion network (ACFNet) to extract glacial lakes based on Landsat 8 optical images and Sentinel-1 SAR images. ACFNet adequately fuses high-level features of optical and SAR data in different receptive fields using atrous convolution. Compared with four fusion models in which data fusion occurs at the input, encoder, decoder, and output stages, two classical semantic segmentation models (SegNet and DeepLabV3+), and a recently proposed model based on U-Net, our model achieves the best results with an intersection-over-union of 0.8278. The experiments show that fully extracting the characteristics of optical and SAR data and appropriately fusing them are vital steps in a network’s performance of glacial lake extraction.

[1]  Amin Taheri-Garavand,et al.  Deep learning-based appearance features extraction for automated carp species identification , 2020 .

[2]  S. Jain,et al.  Expansion of a glacial lake, Tsho Chubda, Chamkhar Chu Basin, Hindukush Himalaya, Bhutan , 2014, Natural Hazards.

[3]  N. Eckert,et al.  Global glacier mass changes and their contributions to sea-level rise from 1961 to 2016 , 2019, Nature.

[4]  Y. Sheng,et al.  A regional-scale assessment of Himalayan glacial lake changes using satellite observations from 1990 to 2015 , 2017 .

[5]  A. Ashraf,et al.  Glacial lake outburst flood hazards in Hindukush, Karakoram and Himalayan Ranges of Pakistan: implications and risk analysis , 2012 .

[6]  T. Yao,et al.  Rapid expansion of glacial lakes caused by climate and glacier retreat in the Central Himalayas , 2015 .

[7]  H. Xie,et al.  An inventory of glacial lakes in the Third Pole region and their changes in response to global warming , 2015 .

[8]  J. Carrivick,et al.  Proglacial lakes: character, behaviour and geological importance , 2013 .

[9]  Claudio Smiraglia,et al.  Inventory of glaciers and glacial lakes of the Central Karakoram National Park (CKNP – Pakistan) , 2018 .

[10]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[11]  Manfred F. Buchroithner,et al.  Identification of glacier motion and potentially dangerous glacial lakes in the Mt. Everest region/Nepal using spaceborne imagery , 2008 .

[12]  Xiaowen Wang,et al.  A Deep Learning Method for Mapping Glacial Lakes from the Combined Use of Synthetic-Aperture Radar and Optical Satellite Images , 2020, Remote. Sens..

[13]  S. Allen,et al.  Annual 30 m dataset for glacial lakes in High Mountain Asia from 2008 to 2017 , 2021 .

[14]  Fei Wu,et al.  Dice Loss for Data-imbalanced NLP Tasks , 2019, ACL.

[15]  T. Bolch,et al.  Glacial lakes exacerbate Himalayan glacier mass loss , 2019, Scientific Reports.

[16]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[17]  Andreas Kääb,et al.  Remote sensing based assessment of hazards from glacier lake outbursts: a case study in the Swiss Alps , 2002 .

[18]  Shi-yin Liu,et al.  Heterogeneity of glacial lake expansion and its contrasting signals with climate change in Tarim Basin, Central Asia , 2016, Environmental Earth Sciences.

[19]  Naoto Yokoya,et al.  Learning from Multimodal and Multitemporal Earth Observation Data for Building Damage Mapping , 2020, ISPRS Journal of Photogrammetry and Remote Sensing.

[20]  Shi-yin Liu,et al.  Changes of glaciers and glacial lakes implying corridor-barrier effects and climate change in the Hengduan Shan, southeastern Tibetan Plateau , 2017, Journal of Glaciology.

[21]  Fang Chen,et al.  Comparing Methods for Segmenting Supra-Glacial Lakes and Surface Features in the Mount Everest Region of the Himalayas Using Chinese GaoFen-3 SAR Images , 2021, Remote. Sens..

[22]  Huadong Guo,et al.  Big Earth Data: a practice of sustainability science to achieve the Sustainable Development Goals. , 2021, Science bulletin.

[23]  Daniel Cremers,et al.  FuseNet: Incorporating Depth into Semantic Segmentation via Fusion-Based CNN Architecture , 2016, ACCV.

[24]  Yongwei Sheng,et al.  Heterogeneous glacial lake changes and links of lake expansions to the rapid thinning of adjacent glacier termini in the Himalayas , 2017 .

[25]  Yves Arnaud,et al.  Contrasted evolution of glacial lakes along the Hindu Kush Himalaya mountain range between 1990 and 2009 , 2011 .

[26]  E. Berthier,et al.  A spatially resolved estimate of High Mountain Asia glacier mass balances, 2000-2016 , 2017, Nature geoscience.

[27]  R. Nagarajan,et al.  Glacial lake changes and outburst flood hazard in Chandra basin, North-Western Indian Himalaya , 2018 .

[28]  Georg Veh,et al.  Detecting Himalayan glacial lake outburst floods from Landsat time series , 2018 .

[29]  Aparna Shukla,et al.  Evolution of Glacial and High-Altitude Lakes in the Sikkim, Eastern Himalaya Over the Past Four Decades (1975–2017) , 2018, Front. Environ. Sci..

[30]  T. Bolch,et al.  The State and Fate of Himalayan Glaciers , 2012, Science.

[31]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[32]  Rajendra Bahadur Shrestha,et al.  A comprehensive approach and methods for glacial lake outburst flood risk assessment, with examples from Nepal and the transboundary area , 2015 .

[33]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[34]  Florian Siegert,et al.  Glacier and glacial lake changes and their relationship in the context of climate change, Central Tibetan Plateau 1972–2010 , 2013 .

[35]  Bo Yu,et al.  A practical trial of landslide detection from single-temporal Landsat8 images using contour-based proposals and random forest: a case study of national Nepal , 2018, Landslides.

[36]  Christian Huggel,et al.  Glacial lakes in the Indian Himalayas--from an area-wide glacial lake inventory to on-site and modeling based risk assessment of critical glacial lakes. , 2013, The Science of the total environment.

[37]  Yann LeCun,et al.  Indoor Semantic Segmentation using depth information , 2013, ICLR.

[38]  Yongwei Sheng,et al.  Glacial lake evolution in the southeastern Tibetan Plateau and the cause of rapid expansion of proglacial lakes linked to glacial-hydrogeomorphic processes , 2016 .

[39]  Fang Chen,et al.  Landslide detection based on contour-based deep learning framework in case of national scale of Nepal in 2015 , 2020, Comput. Geosci..

[40]  Jeffrey S. Kargel,et al.  Rapid worldwide growth of glacial lakes since 1990 , 2020, Nature Climate Change.

[41]  K. Vinod Kumar,et al.  Inventory of Glacial Lakes and its Evolution in Uttarakhand Himalaya Using Time Series Satellite Data , 2016, Journal of the Indian Society of Remote Sensing.

[42]  Kaishan Song,et al.  Convolutional neural network model for soil moisture prediction and its transferability analysis based on laboratory Vis-NIR spectral data , 2021, Int. J. Appl. Earth Obs. Geoinformation.

[43]  S. K. McFeeters The use of the Normalized Difference Water Index (NDWI) in the delineation of open water features , 1996 .

[44]  Bo Yu,et al.  Segmentation of large-scale remotely sensed images on a Spark platform: A strategy for handling massive image tiles with the MapReduce model , 2020 .

[45]  Bo Yu,et al.  Matrix SegNet: A Practical Deep Learning Framework for Landslide Mapping from Images of Different Areas with Different Spatial Resolutions , 2021, Remote. Sens..

[46]  Duncan J. Quincey,et al.  Contrasting geometric and dynamic evolution of lake and land-terminating glaciers in the central Himalaya , 2018 .

[47]  R. D. Gupta,et al.  A lake detection algorithm (LDA) using Landsat 8 data: A comparative approach in glacial environment , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[48]  Giorgos Mountrakis,et al.  Glacial lake inventory and lake outburst potential in Uzbekistan. , 2017, The Science of the total environment.

[49]  Li Junli,et al.  Automatic extraction of himalayan glacial lakes with remote sensing , 2011, National Remote Sensing Bulletin.

[50]  Adeel Yousaf,et al.  Glacial Lakes Mapping Using Multi Satellite PlanetScope Imagery and Deep Learning , 2020, ISPRS Int. J. Geo Inf..

[51]  Takeo Tadono,et al.  Glacial lake inventory of Bhutan using ALOS data: methods and preliminary results , 2011, Annals of Glaciology.

[52]  Yong Zhang,et al.  Glacial lake inventory of high-mountain Asia in 1990 and 2018 derived from Landsat images , 2020 .