Information Fusion for Urban Road Extraction From VHR Optical Satellite Images

This paper presents a novel method exploiting fusion at the information level for urban road extraction from very high resolution (VHR) optical satellite images. Given a satellite image, we explore spectral and shape features computed at the pixel level, and use them to select road segments using two different methods (i.e., expectation maximization clustering and linearness filtering). A road centerline extraction method, which is relying on the outlier robust regression, is subsequently applied to extract accurate centerlines from road segments. After that, three different sets of information fusion rules are applied to jointly exploit results from these methods, which offer ways to address their own limitations. Two VHR optical satellite images are used to validate the proposed method. Quantitative results prove that information fusion following centerline extraction by multiple techniques is able to produce the best accuracy values for automatic urban road extraction from VHR optical satellite images.

[1]  Wenzhong Shi,et al.  A Semi-Automatic Method for Road Centerline Extraction From VHR Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[2]  Faith R. Kearns,et al.  Classification of the wildland-urban interface: A comparison of pixel- and object-based classifications using high-resolution aerial photography , 2008, Comput. Environ. Urban Syst..

[3]  Emmanuel P. Baltsavias,et al.  Object extraction and revision by image analysis using existing geodata and knowledge: current status and steps towards operational systems☆ , 2004 .

[4]  Stanislav S. Makhanov,et al.  A Family of Quadratic Snakes for Road Extraction , 2007, Asian Conference on Computer Vision.

[5]  A. Gruen,et al.  Semi-Automatic Linear Feature Extraction by Dynamic Programming and LSB-Snakes , 1997 .

[6]  Paolo Gamba,et al.  Junction-aware extraction and regularization of urban road networks in high-resolution SAR images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering Techniques , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Pascal Fua,et al.  Reconstructing Loopy Curvilinear Structures Using Integer Programming , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Ying Sun,et al.  Automatic Road Centerline Extraction from Imagery Using Road GPS Data , 2014, Remote. Sens..

[10]  Anthony Stefanidis,et al.  Self-organised clustering for road extraction in classified imagery , 2001 .

[11]  Geoffrey E. Hinton,et al.  Learning to Detect Roads in High-Resolution Aerial Images , 2010, ECCV.

[12]  Sukhendu Das,et al.  Use of Salient Features for the Design of a Multistage Framework to Extract Roads From High-Resolution Multispectral Satellite Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[14]  M. Herold,et al.  Object-oriented mapping and analysis of urban land use / cover using IKONOS data , 2002 .

[15]  Manuele Bicego,et al.  Automatic road extraction from aerial images by probabilistic contour tracking , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[16]  A. Rango,et al.  Object-oriented image analysis for mapping shrub encroachment from 1937 to 2003 in southern New Mexico , 2004 .

[17]  M. Sharmila,et al.  Automatic road extraction using high resolution satellite images based on level set and mean shift methods , 2013, 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT).

[18]  Jun Zhou,et al.  ROBUST AND EFFICIENT ROAD TRACKING IN AERIAL IMAGES , 2005 .

[19]  Pascal Fua,et al.  Automated Reconstruction of Dendritic and Axonal Trees by Global Optimization with Geometric Priors , 2011, Neuroinformatics.

[20]  Wenzhong Shi,et al.  Extracting Man-Made Objects From High Spatial Resolution Remote Sensing Images via Fast Level Set Evolutions , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[21]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[22]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Johannes R. Sveinsson,et al.  Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles , 2008, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[24]  John R. Jensen,et al.  Object‐based change detection using correlation image analysis and image segmentation , 2008 .

[25]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[26]  Thierry Ranchin,et al.  Detection and extraction of road networks from high resolution satellite images , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[27]  Yuan Yuan,et al.  VE-LLI-VO: Vessel Enhancement Using Local Line Integrals and Variational Optimization , 2011, IEEE Transactions on Image Processing.

[28]  Geoffrey E. Hinton,et al.  Learning to Label Aerial Images from Noisy Data , 2012, ICML.

[29]  Stanislav S. Makhanov,et al.  Numerical experiments with cooperating multiple quadratic snakes for road extraction , 2011, Int. J. Geogr. Inf. Sci..

[30]  Etienne Decencière,et al.  Efficient Geodesic Attribute Thinnings Based on the Barycentric Diameter , 2012, Journal of Mathematical Imaging and Vision.

[31]  Wenzhong Shi,et al.  Correction to "Extracting Man-Made Objects From High Spatial Resolution Remote Sensing Images via Fast Level Set Evolutions" , 2015, IEEE Trans. Geosci. Remote. Sens..

[32]  Josef Strobl,et al.  What’s wrong with pixels? Some recent developments interfacing remote sensing and GIS , 2001 .

[33]  William H. Press,et al.  Numerical Recipes 3rd Edition: The Art of Scientific Computing , 2007 .

[34]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[35]  Wenzhong Shi,et al.  Road Centerline Extraction From High-Resolution Imagery Based on Shape Features and Multivariate Adaptive Regression Splines , 2013, IEEE Geoscience and Remote Sensing Letters.

[36]  Pascal Fua,et al.  Automated reconstruction of tree structures using path classifiers and Mixed Integer Programming , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  X. G. Lina,et al.  SEMI-AUTOMATIC EXTRACTION OF RIBBON ROADS FORM HIGH RESOLUTION REMOTELY SENSED IMAGERY BY COOPERATION BETWEEN ANGULAR TEXTURE SIGNATURE AND TEMPLATE MATCHING , 2008 .

[38]  Çaglar Senaras,et al.  Automated Detection of Arbitrarily Shaped Buildings in Complex Environments From Monocular VHR Optical Satellite Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Zuxun Zhang,et al.  A Robust Method for Semi-Automatic Extraction of Road Centerlines Using a Piecewise Parabolic Model and Least Square Template Matching , 2004 .

[40]  Ting Peng,et al.  Incorporating Generic and Specific Prior Knowledge in a Multiscale Phase Field Model for Road Extraction From VHR Images , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  Peter Wonka,et al.  Road Network Extraction and Intersection Detection From Aerial Images by Tracking Road Footprints , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Paolo Gamba,et al.  Improving urban road extraction in high-resolution images exploiting directional filtering, perceptual grouping, and simple topological concepts , 2006, IEEE Geoscience and Remote Sensing Letters.

[43]  Sahar Movaghati,et al.  Road Extraction From Satellite Images Using Particle Filtering and Extended Kalman Filtering , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Josiane Zerubia,et al.  New higher-order active contour energies for network extraction , 2005, IEEE International Conference on Image Processing 2005.

[45]  Ron Kimmel,et al.  Numerical geometry of images - theory, algorithms, and applications , 2003 .

[46]  Juan B. Mena,et al.  State of the art on automatic road extraction for GIS update: a novel classification , 2003, Pattern Recognit. Lett..

[47]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[48]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[49]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[50]  Xin Huang,et al.  Road centreline extraction from high‐resolution imagery based on multiscale structural features and support vector machines , 2009 .

[51]  Zhengjun Liu,et al.  Semi-automatic extraction of road networks by least squares interlaced template matching in urban areas , 2011 .

[52]  Qiaoping Zhang,et al.  A wavelet approach to road extraction from high spatial resolution remotely-sensed imagery , 2004 .

[53]  Jon Atli Benediktsson,et al.  Advanced directional mathematical morphology for the detection of the road network in very high resolution remote sensing images , 2010, Pattern Recognit. Lett..

[54]  Hye-Jin Kim,et al.  A shape–size index extraction for classification of high resolution multispectral satellite images , 2012 .

[55]  Jan Dirk Wegner,et al.  A Higher-Order CRF Model for Road Network Extraction , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[56]  Christian Heipke,et al.  Network snakes: graph-based object delineation with active contour models , 2010, Machine Vision and Applications.

[57]  Suya You,et al.  Delineation and geometric modeling of road networks , 2010 .

[58]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[59]  Kenneth M. Hinkel,et al.  Satellite remote sensing classification of thaw lakes and drained thaw lake basins on the North Slope of Alaska , 2005 .

[60]  Mehdi Mokhtarzade,et al.  Road detection from high-resolution satellite images using artificial neural networks , 2007, Int. J. Appl. Earth Obs. Geoinformation.

[61]  Florent Lafarge,et al.  Recovering Line-Networks in Images by Junction-Point Processes , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[62]  Christian Heipke,et al.  Road Network Extraction in Suburban Areas , 2012 .

[63]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[64]  D. Civco,et al.  Road Extraction Using SVM and Image Segmentation , 2004 .

[65]  Farhad Samadzadegan,et al.  A new ant based distributed framework for urban road map updating from high resolution satellite imagery , 2013, Comput. Geosci..

[66]  Ivan Laptev,et al.  Automatic extraction of roads from aerial images based on scale space and snakes , 2000 .

[67]  Manfred Ehlers,et al.  Automated Techniques for Environmental Monitoring and Change Analyses for Ultra High Resolution Remote Sensing Data , 2006 .

[68]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[69]  Wenzhong Shi,et al.  An Integrated Method for Urban Main-Road Centerline Extraction From Optical Remotely Sensed Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[70]  Aluir Porfírio Dal Poz,et al.  Object-Space Road Extraction in Rural Areas Using Stereoscopic Aerial Images , 2012, IEEE Geoscience and Remote Sensing Letters.

[71]  Liping Di,et al.  Application of a Fast Linear Feature Detector to Road Extraction From Remotely Sensed Imagery , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.