Deep Tiered Image Segmentation for Detecting Internal ICE Layers in Radar Imagery

Understanding the structure of the ice at the Earth's poles is important for modeling how global warming will impact polar ice and, in turn, the Earth's climate. Ground-penetrating radar is able to collect observations of the internal structure of snow and ice, but the process of manually labeling these observations with layer boundaries is slow and laborious. Recent work has developed automatic techniques for finding ice-bed boundaries, but finding internal boundaries is much more challenging because the number of layers is unknown and the layers can disappear, reappear, merge, and split. In this paper, we propose a novel deep neural network-based model for solving a general class of tiered segmentation problems. We then apply it to detecting internal layers in polar ice, and evaluate on a large-scale dataset of polar ice radar data with human-labeled annotations as ground truth.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[4]  Richard R. Forster,et al.  Annual Greenland accumulation rates (2009–2012) from airborne snow radar , 2015 .

[5]  J. Paden,et al.  Radiostratigraphy and age structure of the Greenland Ice Sheet , 2015, Journal of geophysical research. Earth surface.

[6]  Josef Kittler,et al.  On the accuracy of the Sobel edge detector , 1983, Image Vis. Comput..

[7]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Geoffrey C. Fox,et al.  Multi-task Spatiotemporal Neural Networks for Structured Surface Reconstruction , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[9]  Xiaojuan Qi,et al.  ICNet for Real-Time Semantic Segmentation on High-Resolution Images , 2017, ECCV.

[10]  Maryam Rahnemoonfar,et al.  Deep Ice Layer Tracking and Thickness Estimation using Fully Convolutional Networks , 2020, 2020 IEEE International Conference on Big Data (Big Data).

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[13]  Xiang Bai,et al.  Richer Convolutional Features for Edge Detection , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Zhuowen Tu,et al.  Deeply-Supervised Nets , 2014, AISTATS.

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[16]  Yoshua Bengio,et al.  Gated Feedback Recurrent Neural Networks , 2015, ICML.

[17]  Lorenzo Bruzzone,et al.  Automatic Enhancement and Detection of Layering in Radar Sounder Data Based on a Local Scale Hidden Markov Model and the Viterbi Algorithm , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Geoffrey C. Fox,et al.  Automated Tracking of 2D and 3D Ice Radar Imagery Using Viterbi and TRW-S , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[19]  Jianbo Shi,et al.  DeepEdge: A multi-scale bifurcated deep network for top-down contour detection , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Geoffrey C. Fox,et al.  Estimating bedrock and surface layer boundaries and confidence intervals in ice sheet radar imagery using MCMC , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[22]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[23]  J. Paden,et al.  Multi-Scale and Temporal Transfer Learning for Automatic Tracking of Internal Ice Layers , 2020, IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium.

[24]  Geoffrey C. Fox,et al.  Deep Hybrid Wavelet Network for Ice Boundary Detection in Radra Imagery , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[25]  C. Lawrence Zitnick,et al.  Fast Edge Detection Using Structured Forests , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Geoffrey C. Fox,et al.  A semi-automatic approach for estimating near surface internal layers from snow radar imagery , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[27]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[28]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[29]  Geoffrey Fox,et al.  Layer-finding in radar echograms using probabilistic graphical models , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[30]  Geoffrey C. Fox,et al.  Automatic estimation of ice bottom surfaces from radar imagery , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[31]  Olga Veksler,et al.  Tiered scene labeling with dynamic programming , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  John Theodore Houghton,et al.  Global Warming: The Complete Briefing , 1994 .