Urban-Area and Building Detection Using SIFT Keypoints and Graph Theory

Very high resolution satellite images provide valuable information to researchers. Among these, urban-area boundaries and building locations play crucial roles. For a human expert, manually extracting this valuable information is tedious. One possible solution to extract this information is using automated techniques. Unfortunately, the solution is not straightforward if standard image processing and pattern recognition techniques are used. Therefore, to detect the urban area and buildings in satellite images, we propose the use of scale invariant feature transform (SIFT) and graph theoretical tools. SIFT keypoints are powerful in detecting objects under various imaging conditions. However, SIFT is not sufficient for detecting urban areas and buildings alone. Therefore, we formalize the problem in terms of graph theory. In forming the graph, we represent each keypoint as a vertex of the graph. The unary and binary relationships between these vertices (such as spatial distance and intensity values) lead to the edges of the graph. Based on this formalism, we extract the urban area using a novel multiple subgraph matching method. Then, we extract separate buildings in the urban area using a novel graph cut method. We form a diverse and representative test set using panchromatic 1-m-resolution Ikonos imagery. By extensive testings, we report very promising results on automatically detecting urban areas and buildings.

[1]  Jorma Laaksonen,et al.  Detecting Man-Made Structures and Changes in Satellite Imagery With a Content-Based Information Retrieval System Built on Self-Organizing Maps , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[2]  B. S. Manjunath,et al.  Modeling and Detection of Geospatial Objects Using Texture Motifs , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Lorenzo Bruzzone,et al.  A Multilevel Context-Based System for Classification of Very High Spatial Resolution Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Lorenzo Bruzzone,et al.  A Support Vector Domain Description Approach to Supervised Classification of Remote Sensing Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Werner Goeman,et al.  Evaluating corner detectors for the extraction of man-made structures in urban areas , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[6]  Liangpei Zhang,et al.  An Adaptive Multiscale Information Fusion Approach for Feature Extraction and Classification of IKONOS Multispectral Imagery Over Urban Areas , 2007, IEEE Geoscience and Remote Sensing Letters.

[7]  Hermann Kaufmann,et al.  Detection of small objects from high-resolution panchromatic satellite imagery based on supervised image segmentation , 2001, IEEE Trans. Geosci. Remote. Sens..

[8]  O. Ersoy,et al.  Consensual and Hierarchical Classification of Remotely Sensed Multispectral Images , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.

[9]  Jon Atli Benediktsson,et al.  Decision Fusion for the Classification of Urban Remote Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Guy De Tré,et al.  Relevance Criteria for Spatial Information Retrieval Using Error-Tolerant Graph Matching , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Kim L. Boyer,et al.  A theoretical and experimental investigation of graph theoretical measures for land development in satellite imagery , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ping Zhong,et al.  A Multiple Conditional Random Fields Ensemble Model for Urban Area Detection in Remote Sensing Optical Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Nikhil R. Pal,et al.  Land cover classification using fuzzy rules and aggregation of contextual information through evidence theory , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Hichem Sahli,et al.  A Stochastic Framework for the Identification of Building Rooftops Using a Single Remote Sensing Image , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Sangbum Lee,et al.  Subpixel analysis of Landsat ETM/sup +/ using self-organizing map (SOM) neural networks for urban land cover characterization , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, ECCV.

[18]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[19]  Giles M. Foody,et al.  Sanchez-Hernandez, Carolina and Boyd, Doreen S. and Foody, Giles M. (2007) One-class classification for monitoring a specific land cover class: SVDD classification of fenland. IEEE Transactions on , 2016 .

[20]  Cem Unsalan Measuring Land Development in Urban Regions Using Graph Theoretical and Conditional Statistical Features , 2007 .

[21]  Kim L. Boyer,et al.  A system to detect houses and residential street networks in multispectral satellite images , 2005, Comput. Vis. Image Underst..

[22]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Josiane Zerubia,et al.  Texture Analysis through a Markovian Modelling and Fuzzy Classification: Application to Urban Area Extraction from Satellite Images , 2000, International Journal of Computer Vision.

[24]  Paolo Gamba,et al.  Improved VHR Urban Area Mapping Exploiting Object Boundaries , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[26]  Michael Elad,et al.  On the origin of the bilateral filter and ways to improve it , 2002, IEEE Trans. Image Process..

[27]  Taejung Kim,et al.  Development of a graph-based approach for building detection , 1999, Image Vis. Comput..

[28]  Kim L. Boyer,et al.  Classifying land development in high-resolution panchromatic satellite images using straight-line statistics , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Shu-Ching Chen,et al.  Automatic Construction of Building Footprints From Airborne LIDAR Data , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Milan Sonka,et al.  Image processing analysis and machine vision [2nd ed.] , 1999 .

[31]  Jing Peng,et al.  An improved snake model for building detection from urban aerial images , 2005, Pattern Recognit. Lett..

[32]  S. D. Mayungaa,et al.  SEMI-AUTOMATIC BUILDING EXTRACTION UTILIZING QUICKBIRD IMAGERY , 2005 .

[33]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[34]  Xin Yang,et al.  Feature extraction for man-made objects segmentation in aerial images , 2008, Mach. Vis. Appl..

[35]  V. Karathanassi,et al.  A texture-based classification method for classifying built areas according to their density , 2000 .

[36]  Kim L. Boyer,et al.  A system to detect houses and residential street networks in multispectral satellite images , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[37]  Yun Zhang,et al.  Semi-Automatic Building Extraction Utilizing QuickBird Imagery , 2005 .

[38]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.