Building Detection From One Orthophoto and High-Resolution InSAR Data Using Conditional Random Fields

Today's airborne SAR sensors provide geometric resolution in the order well below half a meter. Many features of urban objects become visible in such data. However, layover and occlusion issues inevitably arise in urban areas complicating automated object detection. In order to support interpretation, SAR data may be analyzed using complementary information from maps or optical imagery. In this paper, an approach for building detection in urban areas based on object features extracted from high-resolution interferometric SAR (InSAR) data and one orthophoto is presented. Features describing local evidence as well as context information are used. Buildings are detected by classification of those feature vectors within a Conditional Random Field (CRF) framework. Although as graphical model similar to Markov Random Fields (MRF), CRFs have the advantage of incorporating global context information, of relaxing the conditional independence assumption between features, and of a more general integration of observations. We show that, first, CRFs perform well in comparison to Maximum Likelihood classifiers and MRFs. Second, the combined use of optical and InSAR features may improve detection results.

[1]  Martial Hebert,et al.  Discriminative random fields: a discriminative framework for contextual interaction in classification , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Florence Tupin,et al.  Detection of building outlines based on the fusion of SAR and optical features , 2003 .

[3]  Trevor Darrell,et al.  Conditional Random Fields for Object Recognition , 2004, NIPS.

[4]  Ping Zhong,et al.  A Multiple Conditional Random Fields Ensemble Model for Urban Area Detection in Remote Sensing Optical Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[6]  Uwe Soergel,et al.  Building Reconstruction from Multi-aspect InSAR Data , 2010 .

[7]  Filip Korc INTERPRETING TERRESTRIAL IMAGES OF URBAN SCENES USING DISCRIMINATIVE RANDOM FIELDS , 2008 .

[8]  Antonio Torralba,et al.  Contextual Models for Object Detection Using Boosted Random Fields , 2004, NIPS.

[9]  Trevor Darrell,et al.  Hidden Conditional Random Fields , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  J. D. Wegner,et al.  BRIDGE HEIGHT ESTIMATION FROM COMBINED HIGH-RESOLUTION OPTICAL AND SAR IMAGERY , 2008 .

[11]  Mark W. Schmidt,et al.  Accelerated training of conditional random fields with stochastic gradient methods , 2006, ICML.

[12]  Jean-Francois Mangin,et al.  Detection of linear features in SAR images: application to road network extraction , 1998, IEEE Trans. Geosci. Remote. Sens..

[13]  Uwe Soergel,et al.  Feature Extraction and Visualization of Bridges Over Water From High-Resolution InSAR Data and One Orthophoto , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Jianbo Shi,et al.  Spectral segmentation with multiscale graph decomposition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Paolo Gamba,et al.  Detection and extraction of buildings from interferometric SAR data , 1999, IEEE Trans. Geosci. Remote. Sens..

[16]  Miguel Á. Carreira-Perpiñán,et al.  Multiscale conditional random fields for image labeling , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[17]  Uwe Soergel,et al.  Building Recognition From Multi-Aspect High-Resolution InSAR Data in Urban Areas , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[19]  Olaf Hellwich,et al.  Building Extraction from Polarimetric SAR Data using Mean Shift and Conditional Random Fields , 2008 .

[20]  Martial Hebert,et al.  Discriminative Random Fields , 2006, International Journal of Computer Vision.

[21]  Florence Tupin,et al.  Markov random field on region adjacency graph for the fusion of SAR and optical data in radargrammetric applications , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Ya-Qiu Jin,et al.  Automatic Reconstruction of Building Objects From Multiaspect Meter-Resolution SAR Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Brendan J. Frey,et al.  A Revolution: Belief Propagation in Graphs with Cycles , 1997, NIPS.

[24]  James J. Little,et al.  A Hybrid Conditional Random Field for Estimating the Underlying Ground Surface From Airborne LiDAR Data , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Trevor Darrell,et al.  Hidden Conditional Random Fields for Gesture Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[26]  J. Besag On the Statistical Analysis of Dirty Pictures , 1986 .

[27]  Henri Maître,et al.  A Fusion Scheme for Joint Retrieval of Urban Height Map and Classification From High-Resolution Interferometric SAR Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Andrea Vedaldi,et al.  Objects in Context , 2007, 2007 IEEE 11th International Conference on Computer Vision.