Automatic building height extraction by volumetric shadow analysis of monoscopic imagery

This article presents a new approach to automatic extraction of building heights from monoscopic urban scenes. A volumetric shadow analysis (VSA) method was proposed previously for extraction of 3D building information (height, shape, and footprint location) and for handling occluded building footprints or shadows. It determined building heights by adjusting building height manually until the projected shadows generated for an assumed height and actual shadows in the image matched. In this article, we propose an intelligent scheme based on the VSA for automatic building height extraction. We achieve this by checking the location change of projected shadow lines with respect to the actual shadow regions while building heights are increased incrementally. In this article, the performance of the proposed automatic height extraction was compared to that of manual extraction. The method was first applied to IKONOS, KOMPSAT-2, QuickBird, and Worldview-1 images with manually extracted building roofs. The root mean square error (RMSE) of building heights was under 3 m by automatic height extraction and 2 m by manual extraction. The RMSE of building footprint location was close to twice that of image ground sample distance (GSD) by automatic height extraction and under twice that of image GSD by manual extraction. These results support the capability of the proposed method in automatic height extraction from a single image efficiently and accurately, and in handling occluded building footprints and shadows. Second, the method was combined with an existing roof extraction method and tested for automated building roof extraction. The results showed that the proposed method can also provide a powerful cue for automatic building roof extraction from a single image.

[1]  Masashi Matsuoka,et al.  Multi-scale solution for building extraction from LiDAR and image data , 2009, Int. J. Appl. Earth Obs. Geoinformation.

[2]  Ramakant Nevatia,et al.  Building Detection and Description from a Single Intensity Image , 1998, Comput. Vis. Image Underst..

[3]  Jiann-Yeou Rau,et al.  Robust Reconstruction of Building Models from Three-Dimensional Line Segments , 2003 .

[4]  George Vosselman,et al.  Accuracy of 3D city models: EuroSDR comparison , 2005 .

[5]  Theodosios Pavlidis,et al.  Use of Shadows for Extracting Buildings in Aerial Images , 1990, Comput. Vis. Graph. Image Process..

[6]  Jefferey A. Shufelt,et al.  Fusion of monocular cues to detect man-made structures in aerial imagery , 1993 .

[7]  Allen R. Hanson,et al.  Extracting Straight Lines , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  M. Fradkin,et al.  Building Detection from Multiple Aerial Images in Dense Urban Areas , 2001, Comput. Vis. Image Underst..

[9]  Taejung Kim,et al.  Automated urban area building extraction from high resolution stereo imagery , 1996, Image Vis. Comput..

[10]  Florence Tupin,et al.  Detection of building outlines based on the fusion of SAR and optical features , 2003 .

[11]  Taejung Kim,et al.  Development of a graph-based approach for building detection , 1999, Image Vis. Comput..

[12]  Nikos Paragios,et al.  Recognition-Driven Two-Dimensional Competing Priors Toward Automatic and Accurate Building Detection , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Taejung Kim,et al.  Semiautomatic reconstruction of building height and footprints from single satellite images , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[14]  J. Peng,et al.  Model and context‐driven building extraction in dense urban aerial images , 2005 .

[15]  Henri Maître,et al.  3-D Reconstruction of Urban Scenes from Aerial Stereo Imagery: A Focusing Strategy , 1999, Comput. Vis. Image Underst..

[16]  John Trinder,et al.  Building detection by fusion of airborne laser scanner data and multi-spectral images : Performance evaluation and sensitivity analysis , 2007 .

[17]  Arie Croitoru,et al.  SINGLE AND STEREO BASED 3 D METROLOGY FROM HIGH-RESOLUTION IMAGERY : METHODOLOGIES AND ACCURACIES , 2004 .

[18]  Dongseok Shin,et al.  Development of a Robust Algorithm for Transformation of a 3D Object Point onto a 2D Image Point for Linear Pushbroom Imagery , 2001 .

[19]  Jan-Peter Muller,et al.  A technique for 3D building reconstruction , 1998 .

[20]  George Vosselman,et al.  Reconstruction of 3D building models from aerial images and maps , 2003 .

[21]  J. Gong,et al.  3D Building Model Reconstruction from Multi-view Aerial Imagery and Lidar Data , 2011 .

[22]  P. Reinartz,et al.  Benchmarking and quality analysis of DEM generated from high and very high resolution optical stereo satellite data , 2010 .

[23]  I. Dowman,et al.  Data fusion of high-resolution satellite imagery and LiDAR data for automatic building extraction * , 2007 .

[24]  Cem Ünsalan,et al.  Urban-Area and Building Detection Using SIFT Keypoints and Graph Theory , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Kyung-Ok Kim,et al.  Semiautomatic Building Line Extraction from Ikonos Images Through Monoscopic Line Analysis , 2006 .

[26]  Kurt Kubik,et al.  Automatic Building Detection Using the Dempster-Shafer Algorithm , 2006 .

[27]  Kyoung Mu Lee,et al.  Fusion of Lidar and Imagery for Reliable Building Extraction , 2008 .