BT-RoadNet: A boundary and topologically-aware neural network for road extraction from high-resolution remote sensing imagery

Abstract Automatic road extraction from high-resolution remote sensing imagery has various applications like urban planning and automatic navigation. Existing methods for automatic road extraction however, focus on regional accuracy but not on the boundary quality; and most of these road extraction methods yield discontinuous results due to noise and occlusions. To address these two problems, a Boundary and Topological-aware Road extraction Network (BT-RoadNet) is proposed. BT-RoadNet is a coarse-to-fine architecture composed of two encoder-to-decoder networks, a Coarse Map Predicting Module (CMPM) and Fine Map Predicting Module (FMPM). The CMPM learns to predict coarse road segmentation maps, in which a Spatial Context Module (SCM) is employed as a bridge to solve discontinuous problems. The FMPM is used to refine the coarse road maps by learning the difference between the coarse road extraction result and the ground truth. Experiments were conducted on the open Massachusetts Road Dataset, a newly annotated Wuhan University (WHU) Road Dataset, and three large satellite images. Quantitative and qualitative analysis demonstrate that the proposed BT-RoadNet can enhance road network extraction to deal with interruptions caused by shadows and occlusions, extract roads with different scales and materials, and handle roads under construction that have incomplete spectral and geometric properties.

[1]  Paolo Gamba,et al.  An Object-Based Method for Road Network Extraction in VHR Satellite Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Jie Yang,et al.  Multi-Scale and Multi-Task Deep Learning Framework for Automatic Road Extraction , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Jianhua Wang,et al.  A New Approach to Urban Road Extraction Using High-Resolution Aerial Image , 2016, ISPRS Int. J. Geo Inf..

[4]  Yonghong Jia,et al.  An Adaptive Multifeature Method for Semiautomatic Road Extraction From High-Resolution Stereo Mapping Satellite Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[5]  Qing Zhu,et al.  Road Extraction from VHR Remote-Sensing Imagery via Object Segmentation Constrained by Gabor Features , 2018, ISPRS Int. J. Geo Inf..

[6]  Saeid Nahavandi,et al.  On Detecting Road Regions in a Single UAV Image , 2017, IEEE Transactions on Intelligent Transportation Systems.

[7]  Liujuan Cao,et al.  Road Network Extraction via Aperiodic Directional Structure Measurement , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Shiming Xiang,et al.  Automatic Road Detection and Centerline Extraction via Cascaded End-to-End Convolutional Neural Network , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Jiao Jiao,et al.  An End-to-End Neural Network for Road Extraction From Remote Sensing Imagery by Multiple Feature Pyramid Network , 2018, IEEE Access.

[10]  Yifang Ban,et al.  Improving SAR-Based Urban Change Detection by Combining MAP-MRF Classifier and Nonlocal Means Similarity Weights , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Yang Chen,et al.  Road Extraction from High-Resolution Remote Sensing Imagery Using Refined Deep Residual Convolutional Neural Network , 2019, Remote. Sens..

[12]  Wenji Zhao,et al.  An improved probabilistic relaxation method for matching multi-scale road networks , 2018, Int. J. Digit. Earth.

[13]  Georgios Tziritas,et al.  MRF-based segmentation and unsupervised classification for building and road detection in peri-urban areas of high-resolution satellite images , 2016 .

[14]  Geoffrey E. Hinton,et al.  Machine Learning for Aerial Image Labeling , 2013 .

[15]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[16]  Raymond Y. K. Lau,et al.  Road Detection and Centerline Extraction Via Deep Recurrent Convolutional Neural Network U-Net , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Xiang Li,et al.  Topology-Aware Road Network Extraction via Multi-Supervised Generative Adversarial Networks , 2019, Remote. Sens..

[18]  Yonghong Jia,et al.  An Adaptive Multifeature Sparsity-Based Model for Semiautomatic Road Extraction From High-Resolution Satellite Images in Urban Areas , 2017, IEEE Geoscience and Remote Sensing Letters.

[19]  Xinchang Zhang,et al.  Road Extraction of High-Resolution Remote Sensing Images Derived from DenseUNet , 2019, Remote. Sens..

[20]  Richard Lepage,et al.  Road Extraction From Very High Resolution Remote Sensing Optical Images Based on Texture Analysis and Beamlet Transform , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Abolfazl Abdollahi,et al.  Semi automatic road extraction from digital images , 2017 .

[22]  Jian Yao,et al.  RoadNet: Learning to Comprehensively Analyze Road Networks in Complex Urban Scenes From High-Resolution Remotely Sensed Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Hao He,et al.  Road Extraction by Using Atrous Spatial Pyramid Pooling Integrated Encoder-Decoder Network and Structural Similarity Loss , 2019, Remote. Sens..

[24]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[25]  Shaowen Wang,et al.  A Direction-Guided Ant Colony Optimization Method for Extraction of Urban Road Information From Very-High-Resolution Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[27]  Zhaoning Gong,et al.  Island Road Centerline Extraction Based on a Multiscale United Feature , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Yunhong Wang,et al.  JointNet: A Common Neural Network for Road and Building Extraction , 2019, Remote. Sens..

[29]  Wenzhong Shi,et al.  Spectral–Spatial Classification and Shape Features for Urban Road Centerline Extraction , 2014, IEEE Geoscience and Remote Sensing Letters.