Combining High-Resolution Optical and InSAR Features for Height Estimation of Buildings With Flat Roofs

In this paper, we contribute to answer the question: How accurately can we estimate heights of buildings with flat roofs given one high-resolution single-pass interferometric synthetic aperture radar (InSAR) image pair and one aerial orthophoto? What makes this problem challenging are the different sensor geometries and the sound stochastic combination of all available elevation cues. We revisit already existing methods and develop novel approaches to determine building heights. A rigorous stochastic approach based on least squares adjustment with functionally dependent parameters is introduced to combine all height measurements per building to one robust height estimate. Observation accuracies of the stochastic model are either taken from the literature or estimated empirically. A major benefit of adjustment is that it delivers a posterior standard deviation per height, which can be interpreted as a precision indicator and is of high relevance for practical applications. Estimated heights of an urban scene are compared to ground truth acquired with airborne laser scanning, allowing us to assess height accuracies that can be achieved under nearly optimal conditions. We conduct statistical tests that validate our model and show that a weighted combination of optical and synthetic aperture radar (SAR) data with least squares adjustment delivers reliable height estimates with meter accuracy for flat-roofed buildings. Additionally, we empirically estimate a confidence interval of the estimated heights that directly tells the user the security margin to be included, for example, in case of building evacuations for an anticipated flooding event, under the condition that the data and model have the same specifications as in this paper.

[1]  Mihai Datcu,et al.  Stochastic geometrical modeling for built-up area understanding from a single SAR intensity image with meter resolution , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Lorenzo Bruzzone,et al.  Building Height Retrieval From VHR SAR Imagery Based on an Iterative Simulation and Matching Technique , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Josiane Zerubia,et al.  Building Outline Extraction from Digital Elevation Models Using Marked Point Processes , 2007, International Journal of Computer Vision.

[4]  R. Garello,et al.  Radargrammetric processing for 3-D building extraction from high-resolution airborne SAR data , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[5]  Horst Bischof,et al.  Image-based Building Classification and 3D Modelling with Super-Pixels , 2010 .

[6]  Uwe Soergel,et al.  Building Reconstruction from Multi-aspect InSAR Data , 2010 .

[7]  Theodosios Pavlidis,et al.  Use of Shadows for Extracting Buildings in Aerial Images , 1990, Comput. Vis. Graph. Image Process..

[8]  K. Jacobsen EFFECTIVE RESOLUTION OF DIGITAL FRAME IMAGES , 2009 .

[9]  Parvaneh Saeedi,et al.  Three-Dimensional Polygonal Building Model Estimation From Single Satellite Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Uwe Soergel,et al.  Stereo analysis of high-resolution SAR images for building height estimation in cases of orthogonal aspect directions , 2009 .

[11]  Uwe Soergel,et al.  Building Detection From One Orthophoto and High-Resolution InSAR Data Using Conditional Random Fields , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  F. Tupin Extraction of 3D information using overlay detection on SAR images , 2003, 2003 2nd GRSS/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas.

[13]  Ramakant Nevatia,et al.  Building Detection and Description from a Single Intensity Image , 1998, Comput. Vis. Image Underst..

[14]  Antonio Iodice,et al.  Height Retrieval of Isolated Buildings From Single High-Resolution SAR Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[15]  C. Brenner Building reconstruction from images and laser scanning , 2005 .

[16]  Paolo Gamba,et al.  Hyperspectral and IFSAR data for 3D urban characterization , 2000, IGARSS 2000. IEEE 2000 International Geoscience and Remote Sensing Symposium. Taking the Pulse of the Planet: The Role of Remote Sensing in Managing the Environment. Proceedings (Cat. No.00CH37120).

[17]  J. Chris McGlone,et al.  Projective and object space geometry for monocular building extraction , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[18]  F. Cellier,et al.  Building Height Estimation using Fine Analysis of Altimetric Mixtures in Layover Areas on Polarimetric Interferometric X-band SAR Images , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.

[19]  Henri Maître,et al.  A Fusion Scheme for Joint Retrieval of Urban Height Map and Classification From High-Resolution Interferometric SAR Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Florence Tupin,et al.  Markov random field on region adjacency graph for the fusion of SAR and optical data in radargrammetric applications , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[21]  D. Blacknell,et al.  The extraction of building dimensions from high resolution SAR imagery , 2003, 2003 Proceedings of the International Conference on Radar (IEEE Cat. No.03EX695).

[22]  Lorenzo Bruzzone,et al.  Automatic Detection and Reconstruction of Building Radar Footprints From Single VHR SAR Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Edward M. Mikhail,et al.  Observations And Least Squares , 1983 .

[24]  U. Soergel,et al.  BUILDING RECONSTRUCTION FROM INSAR DATA BY DETAIL ANALYSIS OF PHASE PROFILES , 2008 .

[25]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[26]  Jordi Inglada,et al.  On the possibility of automatic multisensor image registration , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Paolo Gamba,et al.  Detection and extraction of buildings from interferometric SAR data , 1999, IEEE Trans. Geosci. Remote. Sens..

[28]  Lorenzo Bruzzone,et al.  Earthquake Damage Assessment of Buildings Using VHR Optical and SAR Imagery , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Uwe Soergel,et al.  Building Recognition From Multi-Aspect High-Resolution InSAR Data in Urban Areas , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[30]  C. Ticehurst,et al.  Radar backscatter analysis for urban environments , 1997 .

[31]  Uwe Stilla,et al.  Fusion of airborne multi-aspect InSAR data by simultaneous backward geocoding , 2011, 2011 Joint Urban Remote Sensing Event.

[32]  Franz Leberl,et al.  Detection and reconstruction of human scale features from high resolution interferometric SAR data , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[33]  Hélène Oriot,et al.  Rectangular building extraction from stereoscopic airborne Radar images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[34]  F. Cellier,et al.  Hypothesis Management for Building Reconstruction from High Resolution InSAR Imagery , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.

[35]  Sarah Abelen,et al.  THEORETICAL ANALYSIS OF BUILDING HEIGHT ESTIMATION USING SPACE- BORNE SAR-INTERFEROMETRY FOR RAPID MAPPING APPLICATIONS , 2009 .

[36]  Florence Tupin,et al.  Detection of building outlines based on the fusion of SAR and optical features , 2003 .

[37]  Uwe Stilla,et al.  Model-Based Interpretation of High-Resolution SAR Images of Buildings , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  G L Laprade,et al.  ELEVATIONS FROM RADAR IMAGERY , 1969 .

[39]  Helmut Mayer,et al.  Automatic Object Extraction from Aerial Imagery - A Survey Focusing on Buildings , 1999, Comput. Vis. Image Underst..

[40]  Jérôme Darbon,et al.  Joint Regularization of Phase and Amplitude of InSAR Data: Application to 3-D Reconstruction , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Florence Tupin,et al.  Extraction and Three-Dimensional Reconstruction of Isolated Buildings in Urban Scenes From High-Resolution Optical and SAR Spaceborne Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Uwe Soergel,et al.  Extraction and Geometrical Accuracy of Double-bounce Lines in High Resolution SAR Images , 2010 .

[43]  R. Bruce Irvin,et al.  Methods For Exploiting The Relationship Between Buildings And Their Shadows In Aerial Imagery , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[44]  Ronald L. Rivest,et al.  Introduction to Algorithms, 3rd Edition , 2009 .

[45]  Florent Lafarge,et al.  Geometric Feature Extraction by a Multimarked Point Process , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  J. D. Wegner,et al.  FUSION OF OPTICAL AND INSAR FEATURES FOR BUILDING RECOGNITION IN URBAN AREAS , 2009 .

[47]  S. Hinz,et al.  Smart Filtering of Interferometric Phases for Enhancing Building Reconstruction , 2013 .

[48]  N. Bryant,et al.  Investigation of the integration of AVIRIS and IFSAR for urban analysis , 1998 .