Robust Rooftop Extraction From Visible Band Images Using Higher Order CRF

In this paper, we propose a robust framework for building extraction in visible band images. We first get an initial classification of the pixels based on an unsupervised presegmentation. Then, we develop a novel conditional random field (CRF) formulation to achieve accurate rooftops extraction, which incorporates pixel-level information and segment-level information for the identification of rooftops. Comparing with the commonly used CRF model, a higher order potential defined on segment is added in our model, by exploiting region consistency and shape feature at segment level. Our experiments show that the proposed higher order CRF model outperforms the state-of-the-art methods both at pixel and object levels on rooftops with complex structures and sizes in challenging environments.

[1]  Jeff A. Bilmes,et al.  A gentle tutorial of the em algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models , 1998 .

[2]  Yair Weiss,et al.  "Natural Images, Gaussian Mixtures and Dead Leaves" , 2012, NIPS.

[3]  Bodo Rosenhahn,et al.  Segment-based building detection with conditional random fields , 2011, 2011 Joint Urban Remote Sensing Event.

[4]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[5]  Pushmeet Kohli,et al.  Robust Higher Order Potentials for Enforcing Label Consistency , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Ramakant Nevatia,et al.  Building Detection and Description from a Single Intensity Image , 1998, Comput. Vis. Image Underst..

[7]  Takis Kasparis,et al.  Automatic Vegetation Identification and Building Detection from a Single Nadir Aerial Image , 2009, Remote. Sens..

[8]  Werner Goeman,et al.  Evaluating corner detectors for the extraction of man-made structures in urban areas , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[9]  Victor J. D. Tsai,et al.  A comparative study on shadow compensation of color aerial images in invariant color models , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Çaglar Senaras,et al.  Automated Detection of Arbitrarily Shaped Buildings in Complex Environments From Monocular VHR Optical Satellite Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Zhengjun Liu,et al.  Building extraction from high resolution satellite imagery based on multi-scale image segmentation and model matching , 2008, 2008 International Workshop on Earth Observation and Remote Sensing Applications.

[12]  Kim L. Boyer,et al.  A system to detect houses and residential street networks in multispectral satellite images , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[13]  Ali Ozgun Ok,et al.  Automated detection of buildings from single VHR multispectral images using shadow information and graph cuts , 2013 .

[14]  Shiyong Cui,et al.  Graph Search and its Application in Building Extraction from High Resolution Remote Sensing Imagery , 2011 .

[15]  Zhengjun Liu,et al.  Building extraction from high resolution imagery based on multi-scale object oriented classification and probabilistic Hough transform , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[16]  Hichem Sahli,et al.  A Stochastic Framework for the Identification of Building Rooftops Using a Single Remote Sensing Image , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[18]  Cem Ünsalan,et al.  Urban-Area and Building Detection Using SIFT Keypoints and Graph Theory , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Kuo-Liang Chung,et al.  Efficient Shadow Detection of Color Aerial Images Based on Successive Thresholding Scheme , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Parvaneh Saeedi,et al.  A novel approach for polygonal rooftop detection in satellite/aerial imageries , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[21]  Theodosios Pavlidis,et al.  Use of Shadows for Extracting Buildings in Aerial Images , 1990, Comput. Vis. Graph. Image Process..

[22]  Josiane Zerubia,et al.  Building Development Monitoring in Multitemporal Remotely Sensed Image Pairs with Stochastic Birth-Death Dynamics , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Parvaneh Saeedi,et al.  Automatic Rooftop Extraction in Nadir Aerial Imagery of Suburban Regions Using Corners and Variational Level Set Evolution , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[24]  C. Unsalan,et al.  Building detection from aerial images using invariant color features and shadow information , 2008, 2008 23rd International Symposium on Computer and Information Sciences.

[25]  Cem Ünsalan,et al.  A Probabilistic Framework to Detect Buildings in Aerial and Satellite Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[26]  D. Zaum,et al.  ROBUST BUILDING DETECTION IN AERIAL IMAGES , 2005 .

[27]  Taejung Kim,et al.  Semiautomatic reconstruction of building height and footprints from single satellite images , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[28]  Ramakant Nevatia,et al.  Detection of buildings using perceptual grouping and shadows , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Peter Wonka,et al.  Shadow-Based Rooftop Segmentation in Visible Band Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  D Marr,et al.  Early processing of visual information. , 1976, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[31]  R. Bruce Irvin,et al.  Methods for exploiting the relationship between buildings and their shadows in aerial imagery , 1989, IEEE Trans. Syst. Man Cybern..

[32]  Kim L. Boyer,et al.  A system to detect houses and residential street networks in multispectral satellite images , 2005, Comput. Vis. Image Underst..

[33]  C. Brenner.  Building reconstruction from images and laser scanning , 2005 .

[34]  Kidiyo Kpalma,et al.  Vegetation extraction from IKONOS imagery using high spatial resolution index , 2011 .

[35]  Taejung Kim,et al.  Development of a graph-based approach for building detection , 1999, Image Vis. Comput..

[36]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[37]  J. Tasic,et al.  Colour spaces: perceptual, historical and applicational background , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[38]  Huseyin Gokhan Akcay,et al.  Building detection using directional spatial constraints , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.