Integrated technique of segmentation and classification methods with connected components analysis for road extraction from orthophoto images

Abstract Road networks are one of the main urban features. Therefore, road parts extraction from high-resolution remotely sensed imagery and updated road database are beneficial for many GIS applications. However, owing to the presence of various types of obstacles in the images, such as shadows, cars, and trees, with similar transparency and spectral values as road class, achieving accurate road extraction using different classification and segmentation methods is still difficult. This paper proposes an integrated method combining segmentation and classification methods with connected components analysis to extract road class from orthophoto images. The proposed technique is threefold. First, multiresolution segmentation method was applied to segment images. Then, the main classification methods, namely, decision trees (DT), k-nearest neighbors (KNN), and support vector machines (SVM), were implemented based on spectral, geometric, and textural information to classify the obtained results into two classes: road and non-road. Three main accuracy evaluation measures, such as recall, precision, and F1-score, were evaluated to determine the performance of the proposed method, with respective average values of 87.62%, 89.71%, and 88.61%, respectively, for DT; 86.61%, 88.17%, and 87.30%, respectively, for KNN; and 89.83%, 89.52%, and 89.67%, respectively, for SVM. Finally, connected components labelling was used to extract road component parts, and morphological operation was employed to delete non-road parts and noises and improve the performance. These results were also compared with other prior works, which confirmed that the integrated method is an effective road extraction technique.

[1]  Eija Honkavaara,et al.  Quantitative Remote Sensing at Ultra-High Resolution with UAV Spectroscopy: A Review of Sensor Technology, Measurement Procedures, and Data Correction Workflows , 2018, Remote. Sens..

[2]  Thomas Blaschke,et al.  Land cover change assessment using decision trees, support vector machines and maximum likelihood classification algorithms , 2010, Int. J. Appl. Earth Obs. Geoinformation.

[3]  Richard Lepage,et al.  Road Extraction From Very High Resolution Remote Sensing Optical Images Based on Texture Analysis and Beamlet Transform , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Abolfazl Abdollahi,et al.  Semi automatic road extraction from digital images , 2017 .

[5]  Sébastien Lefèvre,et al.  Morphological path filtering at the region scale for efficient and robust road network extraction from satellite imagery , 2016, Pattern Recognit. Lett..

[6]  Min Yang,et al.  Extracting Centerlines From Dual-Line Roads Using Superpixel Segmentation , 2019, IEEE Access.

[7]  Xin Huang,et al.  A multi-index learning approach for classification of high-resolution remotely sensed images over urban areas , 2014 .

[8]  Shumin Fei,et al.  Robust urban road image segmentation , 2014, Proceeding of the 11th World Congress on Intelligent Control and Automation.

[9]  Zulin Wang,et al.  Road Structure Refined CNN for Road Extraction in Aerial Image , 2017, IEEE Geoscience and Remote Sensing Letters.

[10]  Lei He,et al.  Road Extraction from Unmanned Aerial Vehicle Remote Sensing Images Based on Improved Neural Networks , 2019, Sensors.

[11]  Huayi Wu,et al.  Main Road Extraction from ZY-3 Grayscale Imagery Based on Directional Mathematical Morphology and VGI Prior Knowledge in Urban Areas , 2015, PloS one.

[12]  Biswajeet Pradhan,et al.  Extraction of road features from UAV images using a novel level set segmentation approach , 2019, International Journal of Urban Sciences.

[13]  Mehdi Momeni,et al.  AUTOMATIC CENTERLINE EXTRACTION OF COVERD ROADS BY SURROUNDING OBJECTS FROM HIGH RESOLUTION SATELLITE IMAGES , 2017 .

[14]  Georgios Tziritas,et al.  MRF-based segmentation and unsupervised classification for building and road detection in peri-urban areas of high-resolution satellite images , 2016 .

[15]  C. Mallet,et al.  Large-scale road detection in forested mountainous areas using airborne topographic lidar data , 2016 .

[16]  M. Maboudi,et al.  Object-based road extraction from satellite images using ant colony optimization , 2017 .

[17]  Jiao Jiao,et al.  An End-to-End Neural Network for Road Extraction From Remote Sensing Imagery by Multiple Feature Pyramid Network , 2018, IEEE Access.

[18]  Biswajeet Pradhan,et al.  Deep Learning Approaches Applied to Remote Sensing Datasets for Road Extraction: A State-Of-The-Art Review , 2020, Remote. Sens..

[19]  Paolo Gamba,et al.  An Object-Based Method for Road Network Extraction in VHR Satellite Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[20]  Chinnathevar Sujatha,et al.  Connected component-based technique for automatic extraction of road centerline in high resolution satellite images , 2015, EURASIP Journal on Image and Video Processing.

[21]  Jon Atli Benediktsson,et al.  A spatial-spectral kernel-based approach for the classification of remote-sensing images , 2012, Pattern Recognit..

[22]  Mojgan Pashaie Nejad,et al.  Investigation of SVM and Level Set Interactive Methods for Road Extraction from Google Earth Images , 2018, Journal of the Indian Society of Remote Sensing.

[23]  Asmala Ahmad,et al.  Analysis of Maximum Likelihood Classificationon Multispectral Data , 2012 .

[24]  Wenzhong Shi,et al.  A Semi-Automatic Method for Road Centerline Extraction From VHR Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[25]  Yun Zhang,et al.  Road detection using Deep Neural Network in high spatial resolution images , 2017, 2017 Joint Urban Remote Sensing Event (JURSE).

[26]  Xiang Wen,et al.  Road Extraction Based on the Algorithms of MRF and Hybrid Model of SVM and FCM , 2011, 2011 International Symposium on Image and Data Fusion.

[27]  Christian Heipke,et al.  Road Network Extraction in Suburban Areas , 2012 .

[28]  Yoshio Yamaguchi,et al.  Land Cover Classification of Palsar Images by Knowledge Based Decision Tree Classifier and Supervised Classifiers Based on SAR Observables , 2011 .

[29]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[30]  Mehdi Mokhtarzade,et al.  Semi Automatic Road Extraction by Fusion of High Resolution Optical and Radar Images , 2015, Journal of the Indian Society of Remote Sensing.

[31]  P. Yadav,et al.  ROAD NETWORK IDENTIFICATION AND EXTRACTION IN SATELLITE IMAGERY USING OTSU'S METHOD AND CONNECTED COMPONENT ANALYSIS , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[32]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[33]  F. Ares,et al.  PHASE-ONLY CONTROL OF ANTENNA SUM PATTERNS , 2001 .

[34]  Rahul Dev Garg,et al.  Automatic Road Extraction from High Resolution Satellite Image using Adaptive Global Thresholding and Morphological Operations , 2013, Journal of the Indian Society of Remote Sensing.

[35]  Yanhui Guo,et al.  NS-k-NN: Neutrosophic Set-Based k-Nearest Neighbors Classifier , 2017, Symmetry.

[36]  Mario Chica-Olmo,et al.  An assessment of the effectiveness of a random forest classifier for land-cover classification , 2012 .

[37]  Cem Ünsalan,et al.  Road Network Detection Using Probabilistic and Graph Theoretical Methods , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Wenzhong Shi,et al.  Road Centerline Extraction From High-Resolution Imagery Based on Shape Features and Multivariate Adaptive Regression Splines , 2013, IEEE Geoscience and Remote Sensing Letters.

[39]  Mohammad Javad Valadan Zoej,et al.  Optimization of Multiresolution Segmentation for Object-Oriented Road Detection from High-Resolution Images , 2016 .

[40]  Hai Lin,et al.  Lessons Learned from Whole Exome Sequencing in Multiplex Families Affected by a Complex Genetic Disorder, Intracranial Aneurysm , 2015, PloS one.

[41]  M. Sharmila,et al.  Automatic road extraction using high resolution satellite images based on level set and mean shift methods , 2013, 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT).

[42]  Jason Weston,et al.  Semisupervised Neural Networks for Efficient Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Min Wang,et al.  Segmentation of High Spatial Resolution Remote Sensing Imagery Based on Hard-Boundary Constraint and Two-Stage Merging , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Prashanth Reddy Marpu,et al.  Hierarchical graph-based segmentation for extracting road networks from high-resolution satellite images , 2017 .

[45]  Wenzhong Shi,et al.  Spectral–Spatial Classification and Shape Features for Urban Road Centerline Extraction , 2014, IEEE Geoscience and Remote Sensing Letters.

[46]  Ashok Samal,et al.  Semi-Automated Road Detection From High Resolution Satellite Images by Directional Morphological Enhancement and Segmentation Techniques , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[47]  Jon Atli Benediktsson,et al.  Advanced directional mathematical morphology for the detection of the road network in very high resolution remote sensing images , 2010, Pattern Recognit. Lett..

[48]  Jing Zhang,et al.  Multiple Saliency Features Based Automatic Road Extraction from High-Resolution Multispectral Satellite Images , 2018 .

[49]  Jon Atli Benediktsson,et al.  Support Tensor Machines for Classification of Hyperspectral Remote Sensing Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Weifeng Li,et al.  Comparing Machine Learning Classifiers for Object-Based Land Cover Classification Using Very High Resolution Imagery , 2014, Remote. Sens..

[51]  Shutao Li,et al.  Spectral–Spatial Hyperspectral Image Classification Based on KNN , 2016 .

[52]  Sukhendu Das,et al.  Use of Salient Features for the Design of a Multistage Framework to Extract Roads From High-Resolution Multispectral Satellite Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.