Learning From GPS Trajectories of Floating Car for CNN-Based Urban Road Extraction With High-Resolution Satellite Imagery

Deep learning has achieved great success in recent years, among which the convolutional neural network (CNN) method is outstanding in image segmentation and image recognition. It is also widely used in satellite imagery road extraction and, generally, can obtain accurate and extraction results. However, at present, the extraction of roads based on CNN still requires a lot of manual preparation work, and a large number of samples can be marked to achieve extraction, which has to take long drawing cycle and high production cost. In this article, a new CNN sample set production method is proposed, which uses the GPS trajectories of floating car as training set (GPSTasST), for the multilevel urban roads extraction from high-resolution remote sensing imagery. This method rasterizes the GPS trajectories of floating car into a raster map and uses the processed raster map to label the satellite image to obtain a road extraction sample set. CNN can extract roads from remote sensing imagery by learning the training set. The results show that the method achieves a harmonic mean of precision and recall higher than road extraction method from single data source while eliminating the manual labeling work, which shows the effectiveness of this work.

[1]  Chun Liu,et al.  Leveraging Crowdsourced GPS Data for Road Extraction From Aerial Imagery , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Ming Wu,et al.  D-LinkNet: LinkNet with Pretrained Encoder and Dilated Convolution for High Resolution Satellite Imagery Road Extraction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Yin Wang,et al.  Stacked U-Nets with Multi-output for Road Extraction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[4]  Oleksandr Filin,et al.  Road Detection with EOSResUNet and Post Vectorizing Algorithm , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[5]  Ilja Radusch,et al.  Early Fusion of Camera and Lidar for robust road detection based on U-Net FCN , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[6]  Alexey Shvets,et al.  Fully Convolutional Network for Automatic Road Extraction from Satellite Imagery , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Jing Huang,et al.  DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[8]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[9]  Eugenio Culurciello,et al.  LinkNet: Exploiting encoder representations for efficient semantic segmentation , 2017, 2017 IEEE Visual Communications and Image Processing (VCIP).

[10]  Lun Luo,et al.  A weakly supervised road extraction approach via deep convolutional nets based image segmentation , 2017, 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP).

[11]  Pengfei Xu,et al.  Road centerlines extraction from high resolution images based on an improved directional segmentation and road probability , 2016, Neurocomputing.

[12]  Jia Qiu,et al.  Automatic Extraction of Road Networks from GPS Traces , 2016 .

[13]  Igor Sevo,et al.  Convolutional Neural Network Based Automatic Object Detection on Aerial Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[14]  Takayoshi Yamashita,et al.  Multiple Object Extraction from Aerial Imagery with Convolutional Neural Networks , 2016, IRIACV.

[15]  Hui Wu,et al.  Fast aircraft detection in satellite images based on convolutional neural networks , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[16]  Hamid K. Aghajan,et al.  Inferring Directed Road Networks from GPS Traces by Track Alignment , 2015, ISPRS Int. J. Geo Inf..

[17]  Jun Wang,et al.  Road network extraction: a neural-dynamic framework based on deep learning and a finite state machine , 2015 .

[18]  Yoshihiko Mochizuki,et al.  Surface object recognition with CNN and SVM in Landsat 8 images , 2015, 2015 14th IAPR International Conference on Machine Vision Applications (MVA).

[19]  Liang Wang,et al.  Detecting Road Intersections from Coarse-gained GPS Traces Based on Clustering , 2013, J. Comput..

[20]  Geoffrey E. Hinton,et al.  Machine Learning for Aerial Image Labeling , 2013 .

[21]  James Biagioni,et al.  Map inference in the face of noise and disparity , 2012, SIGSPATIAL/GIS.

[22]  Yin Wang,et al.  Mining large-scale, sparse GPS traces for map inference: comparison of approaches , 2012, KDD.

[23]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Chen Chen,et al.  Roads Digital Map Generation with Multi-track GPS Data , 2008, 2008 International Workshop on Education Technology and Training & 2008 International Workshop on Geoscience and Remote Sensing.

[25]  Tao Guo,et al.  Towards high accuracy road maps generation from massive GPS Traces data , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[26]  Ji Ke-Feng,et al.  Road extraction from high-resolution SAR imagery using Hough transform , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[27]  Dongmei Yan,et al.  Road detection from Quickbird fused image using IHS transform and morphology , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[28]  Ellen Riloff Bootstrapping for text learning tasks , 1999 .

[29]  MICHAEL F. GOODCHILD,et al.  A Simple Positional Accuracy Measure for Linear Features , 1997, Int. J. Geogr. Inf. Sci..

[30]  Haihong Li,et al.  Road extraction from aerial and satellite images by dynamic programming , 1995 .