Road Extraction from High-Resolution Orthophoto Images Using Convolutional Neural Network

Abstract Two of the major applications in geospatial information system (GIS) and remote sensing fields are object detection and man-made feature extraction (e.g., road sections) from high-resolution remote sensing imagery. Extracting roads from high-resolution remotely sensed imagery plays a crucial role in multiple applications, such as navigation, emergency tasks, land cover change detection, and updating GIS maps. This study presents a deep learning technique based on a convolutional neural network (CNN) to classify and extract roads from orthophoto images. We applied the model on five orthophoto images to specify the superiority of the method for road extraction. First, we used principal component analysis and object-based image analysis for pre-processing to not only obtain spectral information but also add spatial and textural information for enhancing the classification accuracy. Then, the obtained results from the previous step were used as input for the CNN model to classify the images into road and non-road parts and trivial opening and closing operation are applied to extract connected road components from the images and remove holes inside the road parts. For the accuracy assessment of the proposed method, we used measurement factors such as precision, recall, F1 score, overall accuracy, and IOU. Achieved results showed that the average percentages of these factors were 91.09%, 95.32%, 93.15%, 94.44%, and 87.21%. The results were also compared with those of other existing methods. The comparison ascertained the reliability and superior performance of the suggested model architecture for extracting road regions from orthophoto images. Graphic Abstract

[1]  Dan Watt,et al.  Quality Assessment , 2009, Encyclopedia of Database Systems.

[2]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[3]  A. Mookambiga,et al.  Automated road network extraction using artificial neural network , 2011, 2011 International Conference on Recent Trends in Information Technology (ICRTIT).

[4]  Mingsheng Liao,et al.  Road Extraction From SAR Imagery Based on Multiscale Geometric Analysis of Detector Responses , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Qihao Weng,et al.  Remote sensing of impervious surfaces in the urban areas: Requirements, methods, and trends , 2012 .

[6]  Mingsheng Liao,et al.  Learning Based Compressed Sensing for SAR Image Super-Resolution , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Cem Ünsalan,et al.  Road Network Detection Using Probabilistic and Graph Theoretical Methods , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Jian Li,et al.  Resonant Frequency Calculation and Optimal Design of Peano Fractal Antenna for Partial Discharge Detection , 2012 .

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Jixiang Sun,et al.  Road Extraction from High-Resolution SAR Images via Automatic Local Detecting and Human-Guided Global Tracking , 2012 .

[11]  Jan Dirk Wegner,et al.  A Higher-Order CRF Model for Road Network Extraction , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[13]  Wenzhong Shi,et al.  An Integrated Method for Urban Main-Road Centerline Extraction From Optical Remotely Sensed Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[15]  Biswajeet Pradhan,et al.  GIS-based sustainable city compactness assessment using integration of MCDM, Bayes theorem and RADAR technology , 2015 .

[16]  Mohamed S. Kamel,et al.  Road Detection in Urban Areas Using Random Forest Tree-Based Ensemble Classification , 2015, ICIAR.

[17]  Chinnathevar Sujatha,et al.  Connected component-based technique for automatic extraction of road centerline in high resolution satellite images , 2015, EURASIP Journal on Image and Video Processing.

[18]  Konrad Schindler,et al.  Road networks as collections of minimum cost paths , 2015 .

[19]  Mehdi Mokhtarzade,et al.  Semi Automatic Road Extraction by Fusion of High Resolution Optical and Radar Images , 2015, Journal of the Indian Society of Remote Sensing.

[20]  Gui-Song Xia,et al.  Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery , 2015, Remote. Sens..

[21]  Jun Wang,et al.  Road network extraction: a neural-dynamic framework based on deep learning and a finite state machine , 2015 .

[22]  Paolo Gamba,et al.  An Object-Based Method for Road Network Extraction in VHR Satellite Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Georgios Tziritas,et al.  MRF-based segmentation and unsupervised classification for building and road detection in peri-urban areas of high-resolution satellite images , 2016 .

[24]  Han Jiang,et al.  Fully convolutional networks for building and road extraction: Preliminary results , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[25]  Narumasa Tsutsumida,et al.  Improving land cover classification using input variables derived from a geographically weighted principal components analysis , 2016 .

[26]  Keiller Nogueira,et al.  Towards vegetation species discrimination by using data-driven descriptors , 2016, 2016 9th IAPR Workshop on Pattern Recogniton in Remote Sensing (PRRS).

[27]  B. Pradhan,et al.  Analysis on causes of flash flood in Jeddah city (Kingdom of Saudi Arabia) of 2009 and 2011 using multi-sensor remote sensing data and GIS , 2016 .

[28]  Richard Lepage,et al.  Road Extraction From Very High Resolution Remote Sensing Optical Images Based on Texture Analysis and Beamlet Transform , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Nan Yang,et al.  A review of road extraction from remote sensing images , 2016 .

[30]  Qi Tian,et al.  Road Recognition From Remote Sensing Imagery Using Incremental Learning , 2017, IEEE Transactions on Intelligent Transportation Systems.

[31]  Mojgan Pashaie Nejad,et al.  Investigation of SVM and Level Set Interactive Methods for Road Extraction from Google Earth Images , 2018, Journal of the Indian Society of Remote Sensing.

[32]  Pierre Alliez,et al.  Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Igi Ardiyanto,et al.  Deep residual coalesced convolutional network for efficient semantic road segmentation , 2017, IPSJ Transactions on Computer Vision and Applications.

[34]  Peerapon Vateekul,et al.  An Enhanced Deep Convolutional Encoder-Decoder Network for Road Segmentation on Aerial Imagery , 2017, International Conference on Computer and Information Technology.

[35]  S. C. Ng,et al.  Principal component analysis to reduce dimension on digital image , 2017 .

[36]  Abolfazl Abdollahi,et al.  Semi automatic road extraction from digital images , 2017 .

[37]  Yongyang Xu,et al.  Quality assessment of building footprint data using a deep autoencoder network , 2017, Int. J. Geogr. Inf. Sci..

[38]  Bertrand Le Saux,et al.  Segment-before-Detect: Vehicle Detection and Classification through Semantic Segmentation of Aerial Images , 2017, Remote. Sens..

[39]  Prashanth Reddy Marpu,et al.  Hierarchical graph-based segmentation for extracting road networks from high-resolution satellite images , 2017 .

[40]  Zulin Wang,et al.  Road Structure Refined CNN for Road Extraction in Aerial Image , 2017, IEEE Geoscience and Remote Sensing Letters.

[41]  Biswajeet Pradhan,et al.  Classification of Very High Resolution Aerial Photos Using Spectral-Spatial Convolutional Neural Networks , 2018, J. Sensors.

[42]  Eija Honkavaara,et al.  Quantitative Remote Sensing at Ultra-High Resolution with UAV Spectroscopy: A Review of Sensor Technology, Measurement Procedures, and Data Correction Workflows , 2018, Remote. Sens..

[43]  Rameen Abdal,et al.  UFCN: a fully convolutional neural network for road extraction in RGB imagery acquired by remote sensing from an unmanned aerial vehicle , 2018 .

[44]  Xia Li,et al.  Road Detection From Remote Sensing Images by Generative Adversarial Networks , 2018, IEEE Access.

[45]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[46]  Yongyang Xu,et al.  Road Extraction from High-Resolution Remote Sensing Imagery Using Deep Learning , 2018, Remote. Sens..

[47]  Wei Xia,et al.  Road Extraction from High Resolution Image with Deep Convolution Network – A Case Study of GF-2 Image , 2018 .

[48]  Seyed Majid Azimi,et al.  Road Segmentation in SAR Satellite Images With Deep Fully Convolutional Neural Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[49]  Biswajeet Pradhan,et al.  Extraction of road features from UAV images using a novel level set segmentation approach , 2019, International Journal of Urban Sciences.