Building extraction in satellite images using active contours and colour features

ABSTRACT Obtaining the segmentation of building footprints from satellite images is a complex process since building areas and their surroundings are presented with various colour intensity values and complex features. Active contour region-based segmentation methods can be used to establish the corresponding boundary of building structures. Typically, these methods divide the image into regions that exhibit a certain similarity and homogeneity. However, using the traditional active contour algorithms for building structures detection, in several cases where spectral heterogeneity exists, over-detection or under-detection are usually noticed. In this work, the Red, Green and Blue (RGB) representation and the properties of the Hue, Saturation and Value (HSV) colour space have been analysed and used to optimize the extraction of buildings from satellite images in an active contour segmentation framework. Initially, the satellite image was processed by applying a clustering technique using colour features to eliminate vegetation areas and shadows that may adversely affect the performance of the algorithm. Subsequently, the HSV representation of the image was used and a new active contour model was developed and applied for building extraction, utilizing descriptors derived from the value and saturation images. A new energy term is encoded for biasing the contours to achieve better segmentation results. An effective procedure has been designed and incorporated in the proposed model for the active contour initialization. This process enhances the performance of the model, leading to lower computational cost and higher building detection accuracy. Additionally, statistical measures are used for designing optimum morphological filters to eliminate any misleading information that may still exist. Qualitative and quantitative measures are used for evaluating the performance of the proposed method.

[1]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[2]  Emmanuel P. Baltsavias,et al.  Object extraction and revision by image analysis using existing geodata and knowledge: current status and steps towards operational systems☆ , 2004 .

[3]  Kim L. Boyer,et al.  A system to detect houses and residential street networks in multispectral satellite images , 2005, Comput. Vis. Image Underst..

[4]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[5]  Kim L. Boyer,et al.  A system to detect houses and residential street networks in multispectral satellite images , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[6]  Ali Ozgun Ok,et al.  Automated detection of buildings from single VHR multispectral images using shadow information and graph cuts , 2013 .

[7]  Stavros Stavrou,et al.  Optimizing level set initialization for satellite image segmentation , 2013, ICT 2013.

[8]  Javier Gonzalez,et al.  Shadow detection in colour high‐resolution satellite images , 2008 .

[9]  Josiane Zerubia,et al.  Two Variational Models for Multispectral Image Classification , 2001, EMMCVPR.

[10]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[11]  Chunming Li,et al.  A Level Set Method for Image Segmentation in the Presence of Intensity Inhomogeneities With Application to MRI , 2011, IEEE Transactions on Image Processing.

[12]  Xutong Niu,et al.  A semi-automatic framework for highway extraction and vehicle detection based on a geometric deformable model , 2006 .

[13]  K. Karantzalos,et al.  A Region-based Level Set Segmentation for Automatic Detection of Man-made Objects from Aerial and Satellite Images , 2009 .

[14]  Victor J. D. Tsai,et al.  A comparative study on shadow compensation of color aerial images in invariant color models , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Mustafa Turker,et al.  Support vector machines classification for finding building patches from IKONOS imagery: the effect of additional bands , 2014 .

[16]  Pedro Larrañaga,et al.  An empirical comparison of four initialization methods for the K-Means algorithm , 1999, Pattern Recognit. Lett..

[17]  Nikos Paragios,et al.  Recognition-Driven Two-Dimensional Competing Priors Toward Automatic and Accurate Building Detection , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Jing Peng,et al.  An improved snake model for building detection from urban aerial images , 2005, Pattern Recognit. Lett..

[19]  Daniel Cremers,et al.  A Multiphase Dynamic Labeling Model for Variational Recognition-driven Image Segmentation , 2005, International Journal of Computer Vision.

[20]  Lei Zhang,et al.  Active contours driven by local image fitting energy , 2010, Pattern Recognit..

[21]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[22]  Rama Chellappa,et al.  Delineating buildings by grouping lines with MRFs , 1996, IEEE Trans. Image Process..

[23]  Çaglar Senaras,et al.  Automated Detection of Arbitrarily Shaped Buildings in Complex Environments From Monocular VHR Optical Satellite Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Khan M. Iftekharuddin,et al.  Shadow Detection of Man-Made Buildings in High-Resolution Panchromatic Satellite Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Jefferey A. Shufelt,et al.  Performance Evaluation and Analysis of Monocular Building Extraction From Aerial Imagery , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[27]  F. Tony,et al.  A multiphase level set framework for image segmentation using theMumford and Shah modelLuminita , 2001 .

[28]  Suya You,et al.  Approaches to Large-Scale Urban Modeling , 2003, IEEE Computer Graphics and Applications.

[29]  J. Chris McGlone,et al.  Projective and object space geometry for monocular building extraction , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Hamid Abrishami Moghaddam,et al.  Automatic urban building boundary extraction from high resolution aerial images using an innovative model of active contours , 2010, Int. J. Appl. Earth Obs. Geoinformation.

[31]  Lei Zhang,et al.  Active contours with selective local or global segmentation: A new formulation and level set method , 2010, Image Vis. Comput..

[32]  J. Shan,et al.  CLASS-GUIDED BUILDING EXTRACTION FROM IKONOS IMAGERY , 2003 .

[33]  Xin Yang,et al.  Mumford-Shah Model Based Man-Made Objects Detection from Aerial Images , 2005, Scale-Space.

[34]  Hichem Sahli,et al.  A Stochastic Framework for the Identification of Building Rooftops Using a Single Remote Sensing Image , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[35]  R. Bruce Irvin,et al.  Methods for exploiting the relationship between buildings and their shadows in aerial imagery , 1989, IEEE Trans. Syst. Man Cybern..

[36]  Tony F. Chan,et al.  Level set based shape prior segmentation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[37]  Nikos Paragios,et al.  Large-Scale Building Reconstruction Through Information Fusion and 3-D Priors , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Chunming Li,et al.  Minimization of Region-Scalable Fitting Energy for Image Segmentation , 2008, IEEE Transactions on Image Processing.

[39]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[40]  INFOTECH Shadow Detection of Man-Made Buildings in High- Resolution Panchromatic Satellite Images , 2014 .

[41]  Cem Ünsalan,et al.  Urban-Area and Building Detection Using SIFT Keypoints and Graph Theory , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Saman Ghaffarian,et al.  Automatic building detection based on Purposive FastICA (PFICA) algorithm using monocular high resolution Google Earth images , 2014 .

[43]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[44]  Jefferey A. Shufelt,et al.  Fusion of monocular cues to detect man-made structures in aerial imagery , 1993 .

[45]  Xuelong Li,et al.  A Variational Approach to Simultaneous Image Segmentation and Bias Correction , 2015, IEEE Transactions on Cybernetics.

[46]  S. Osher,et al.  A level set approach for computing solutions to incompressible two-phase flow , 1994 .

[47]  Ying Zhang,et al.  Urban land use mapping using high resolution SAR data based on density analysis and contextual information , 2013 .

[48]  Nozha Boujemaa,et al.  Adaptive Satellite Images Segmentation by Level Set Multiregion Competition , 2006 .

[49]  Theodosios Pavlidis,et al.  Use of Shadows for Extracting Buildings in Aerial Images , 1990, Comput. Vis. Graph. Image Process..

[50]  Jordi Inglada,et al.  Automatic recognition of man-made objects in high resolution optical remote sensing images by SVM classification of geometric image features , 2007 .

[51]  Saman Ghaffarian,et al.  AUTOMATIC BUILDING DETECTION BASED ON SUPERVISED CLASSIFICATION USING HIGH RESOLUTION GOOGLE EARTH IMAGES , 2014 .

[52]  Hai Min,et al.  A novel level set method for image segmentation by incorporating local statistical analysis and global similarity measurement , 2015, Pattern Recognit..

[53]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[54]  Jian Yang,et al.  Inhomogeneity-embedded active contour for natural image segmentation , 2015, Pattern Recognit..

[55]  Ramakant Nevatia,et al.  Detecting buildings in aerial images , 1988, Comput. Vis. Graph. Image Process..

[56]  Norbert Haala,et al.  An update on automatic 3D building reconstruction , 2010 .

[57]  C. Unsalan,et al.  Building detection from aerial images using invariant color features and shadow information , 2008, 2008 23rd International Symposium on Computer and Information Sciences.

[58]  Lei Chen,et al.  Building detection in an urban area using lidar data and QuickBird imagery , 2012 .