Use of Very High Spatial Resolution Commercial Satellite Imagery and Deep Learning to Automatically Map Ice-Wedge Polygons across Tundra Vegetation Types

We developed a high-throughput mapping workflow, which centers on deep learning (DL) convolutional neural network (CNN) algorithms on high-performance distributed computing resources, to automatically characterize ice-wedge polygons (IWPs) from sub-meter resolution commercial satellite imagery. We applied a region-based CNN object instance segmentation algorithm, namely the Mask R-CNN, to automatically detect and classify IWPs in North Slope of Alaska. The central goal of our study was to systematically expound the DLCNN model interoperability across varying tundra types (sedge, tussock sedge, and non-tussock sedge) and image scene complexities to refine the understanding of opportunities and challenges for regional-scale mapping applications. We corroborated quantitative error statistics along with detailed visual inspections to gauge the IWP detection accuracies. We found promising model performances (detection accuracies: 89% to 96% and classification accuracies: 94% to 97%) for all candidate image scenes with varying tundra types. The mapping workflow discerned the IWPs by exhibiting low absolute mean relative error (AMRE) values (0.17–0.23). Results further suggest the importance of increasing the variability of training samples when practicing transfer-learning strategy to map IWPs across heterogeneous tundra cover types. Overall, our findings demonstrate the robust performances of IWPs mapping workflow in multiple tundra landscapes.

[1]  Marcel Schwieder,et al.  Ground-Based Hyperspectral Characterization of Alaska Tundra Vegetation along Environmental Gradients , 2013, Remote. Sens..

[2]  Lina J. Karam,et al.  DeepCorrect: Correcting DNN Models Against Image Distortions , 2017, IEEE Transactions on Image Processing.

[3]  Ingmar Nitze,et al.  Tundra landform and vegetation productivity trend maps for the Arctic Coastal Plain of northern Alaska , 2018, Scientific Data.

[4]  Francesca Bovolo,et al.  A detail-preserving scale-driven approach to change detection in multitemporal SAR images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Donatella Zona,et al.  Numerical Terradynamic Simulation Group 11-2016 Mapping Arctic Tundra Vegetation Communities Using Field Spectroscopy and Multispectral Satellite Data in North Alaska , USA , 2017 .

[6]  Patrick Lambert,et al.  3-D Deep Learning Approach for Remote Sensing Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Lei Gao,et al.  Aircraft detection in remote sensing images based on a deep residual network and Super-Vector coding , 2018 .

[8]  Zhenfeng Shao,et al.  Remote Sensing Image Fusion With Deep Convolutional Neural Network , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Hai Su,et al.  Deep Learning in Microscopy Image Analysis: A Survey , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[11]  C. Burnett,et al.  A multi-scale segmentation/object relationship modelling methodology for landscape analysis , 2003 .

[12]  B. Jones,et al.  Rapid initialization of retrogressive thaw slumps in the Canadian high Arctic and their response to climate and terrain factors , 2019, Environmental Research Letters.

[13]  Guido Grosse,et al.  Quantifying Wedge‐Ice Volumes in Yedoma and Thermokarst Basin Deposits , 2014 .

[14]  Yu Liu,et al.  Hourglass-ShapeNetwork Based Semantic Segmentation for High Resolution Aerial Imagery , 2017, Remote. Sens..

[15]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[16]  Howard E. Epstein,et al.  Differentiating among Four Arctic Tundra Plant Communities at Ivotuk, Alaska Using Field Spectroscopy , 2016, Remote. Sens..

[17]  Serge J. Belongie,et al.  Context based object categorization: A critical survey , 2010, Comput. Vis. Image Underst..

[18]  Weixing Zhang,et al.  Deep Convolutional Neural Networks for Automated Characterization of Arctic Ice-Wedge Polygons in Very High Spatial Resolution Aerial Imagery , 2018, Remote. Sens..

[19]  P. Quézel,et al.  Les grandes structures de végétation en région méditerranéenne: Facteurs déterminants dans leur mise en place post-glaciaire , 1999 .

[20]  Benjamin M. Jones,et al.  Understanding the Effects of Optimal Combination of Spectral Bands on Deep Learning Model Predictions: A Case Study Based on Permafrost Tundra Landform Mapping Using High Resolution Multispectral Satellite Imagery , 2020, J. Imaging.

[21]  Lizhe Wang,et al.  A semi-supervised generative framework with deep learning features for high-resolution remote sensing image scene classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[22]  A. Rango,et al.  Object-oriented image analysis for mapping shrub encroachment from 1937 to 2003 in southern New Mexico , 2004 .

[23]  Anna Liljedahl,et al.  Understanding the synergies of deep learning and data fusion of multispectral and panchromatic high resolution commercial satellite imagery for automated ice-wedge polygon detection , 2020 .

[24]  E. S. Melnikov,et al.  The Circumpolar Arctic vegetation map , 2005 .

[25]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[26]  Anna Liljedahl,et al.  Pan-Arctic ice-wedge degradation in warming permafrost and its influence on tundra hydrology , 2016 .

[27]  Lennart Nilsen,et al.  Circumpolar Arctic Vegetation Classification , 2017 .

[28]  Leena Matikainen,et al.  An Object-Based Approach for Mapping Shrub and Tree Cover on Grassland Habitats by Use of LiDAR and CIR Orthoimages , 2013, Remote. Sens..

[29]  Pedro Pina,et al.  Evaluation of the use of very high resolution aerial imagery for accurate ice-wedge polygon mapping (Adventdalen, Svalbard). , 2017, The Science of the total environment.

[30]  Trevor C. Lantz,et al.  Spatio‐Temporal Variation in High‐Centre Polygons and Ice‐Wedge Melt Ponds, Tuktoyaktuk Coastlands, Northwest Territories , 2017 .

[31]  Francesca Bovolo,et al.  Multidimensional Probability Density Function Matching for Preprocessing of Multitemporal Remote Sensing Images , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Ian Olthof,et al.  A raster version of the Circumpolar Arctic Vegetation Map (CAVM) , 2019, Remote Sensing of Environment.

[33]  J. Eitel,et al.  20 cm resolution mapping of tundra vegetation communities provides an ecological baseline for important research areas in a changing Arctic environment , 2019, Environmental Research Communications.

[34]  Menglong Yan,et al.  Semantic pixel labelling in remote sensing images using a deep convolutional encoder-decoder model , 2018 .

[35]  Shuang Wang,et al.  A deep learning framework for remote sensing image registration , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[36]  François Pitié,et al.  Automated colour grading using colour distribution transfer , 2007, Comput. Vis. Image Underst..

[37]  Fatema Begum,et al.  Advanced wind speed prediction using convective weather variables through machine learning application , 2019, Applied Computing and Geosciences.

[38]  Birgit Heim,et al.  Water Body Distributions Across Scales: A Remote Sensing Based Comparison of Three Arctic Tundra Wetlands , 2013, Remote. Sens..

[39]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[40]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[41]  Lei Guo,et al.  When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Emmanouil N. Anagnostou,et al.  Machine Learning–Based Blending of Satellite and Reanalysis Precipitation Datasets: A Multiregional Tropical Complex Terrain Evaluation , 2019, Journal of Hydrometeorology.

[43]  Jun Guo,et al.  Cascaded classification of high resolution remote sensing images using multiple contexts , 2013, Inf. Sci..

[44]  R. F. Black,et al.  PERMAFROST: A REVIEW , 1954 .

[45]  Rabab Kreidieh Ward,et al.  Deep learning for pixel-level image fusion: Recent advances and future prospects , 2018, Inf. Fusion.

[46]  Benjamin M. Jones,et al.  Transferability of the Deep Learning Mask R-CNN Model for Automated Mapping of Ice-Wedge Polygons in High-Resolution Satellite and UAV Images , 2020, Remote. Sens..

[47]  Qian Du,et al.  Multisource Remote Sensing Data Classification Based on Convolutional Neural Network , 2018, IEEE Transactions on Geoscience and Remote Sensing.