Seamless Fusion of LiDAR and Aerial Imagery for Building Extraction

Although many efforts have been made on the fusion of Light Detection and Ranging (LiDAR) and aerial imagery for the extraction of houses, little research on taking advantage of a building's geometric features, properties, and structures for assisting the further fusion of the two types of data has been made. For this reason, this paper develops a seamless fusion between LiDAR and aerial imagery on the basis of aspect graphs, which utilize the features of houses, such as geometry, structures, and shapes. First, 3-D primitives, standing for houses, are chosen, and their projections are represented by the aspects. A hierarchical aspect graph is then constructed using aerial image processing in combination with the results of LiDAR data processing. In the aspect graph, the note represents the face aspect and the arc is described by attributes obtained by the formulated coding regulations, and the coregistration between the aspect and LiDAR data is implemented. As a consequence, the aspects and/or the aspect graph are interpreted for the extraction of houses, and then the houses are fitted using a planar equation for creating a digital building model (DBM). The experimental field, which is located in Wytheville, VA, is used to evaluate the proposed method. The experimental results demonstrated that the proposed method is capable of effectively extracting houses at a successful rate of 93%, as compared with another method, which is 82% effective when LiDAR spacing is approximately 7.3 by 7.3 ft2. The accuracy of 3-D DBM is higher than the method using only single LiDAR data.

[1]  Wuming Zhang,et al.  Automatic Extraction of Power Lines from Aerial Images of Unmanned Aerial Vehicles , 2007, IEEE Geoscience and Remote Sensing Letters.

[2]  Franck Jung.  Detecting building changes from multitemporal aerial stereopairs , 2004 .

[3]  George Vosselman,et al.  Reconstruction of 3D building models from aerial images and maps , 2003 .

[4]  Lukas Zebedin,et al.  Towards 3D map generation from digital aerial images , 2006 .

[5]  Helmut Mayer,et al.  Automatic Object Extraction from Aerial Imagery - A Survey Focusing on Buildings , 1999, Comput. Vis. Image Underst..

[6]  P. Zingaretti,et al.  Performance evaluation of automated approaches to building detection in multi-source aerial data , 2010 .

[7]  Kensaku Fujii,et al.  Urban object reconstruction using airborne laser elevation image and aerial image , 2002, IEEE Trans. Geosci. Remote. Sens..

[8]  John W. Fisher,et al.  Automatic registration of LIDAR and optical images of urban scenes , 2009, CVPR.

[9]  S. Mills,et al.  Combined thermal-LIDAR imagery for urban mapping , 2008, 2008 23rd International Conference Image and Vision Computing New Zealand.

[10]  Franz Rottensteiner,et al.  Automatic Generation of High-Quality Building Models from Lidar Data , 2003, IEEE Computer Graphics and Applications.

[11]  A. Habib,et al.  Photogrammetric and Lidar Data Registration Using Linear Features , 2005 .

[12]  I. Dowman,et al.  Data fusion of high-resolution satellite imagery and LiDAR data for automatic building extraction * , 2007 .

[13]  Cem Ünsalan,et al.  Urban-Area and Building Detection Using SIFT Keypoints and Graph Theory , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Ramakant Nevatia,et al.  Using Perceptual Organization to Extract 3-D Structures , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Henri Maître,et al.  3-D Reconstruction of Urban Scenes from Aerial Stereo Imagery: A Focusing Strategy , 1999, Comput. Vis. Image Underst..

[16]  John Trinder,et al.  Building detection by fusion of airborne laser scanner data and multi-spectral images : Performance evaluation and sensitivity analysis , 2007 .

[17]  Klaus Tempfli,et al.  AUTOMATIC BUILDING EXTRACTION FROM AIRBORNE LASER SCANNING DATA , 2000 .

[18]  Armin B. Cremers,et al.  Extracting Buildings from Aerial Images Using Hierarchical Aggregation in 2D and 3D , 1998, Comput. Vis. Image Underst..

[19]  M. Fradkin,et al.  Building Detection from Multiple Aerial Images in Dense Urban Areas , 2001, Comput. Vis. Image Underst..

[20]  J. Shan,et al.  Building boundary tracing and regularization from airborne lidar point clouds , 2007 .

[21]  George Vosselman,et al.  Knowledge based reconstruction of building models from terrestrial laser scanning data , 2009 .

[22]  Frédéric Champagnat,et al.  Dense height map estimation from oblique aerial image sequences , 2008, Comput. Vis. Image Underst..

[23]  P. Gamba,et al.  Joint analysis of SAR, LIDAR and aerial imagery for simultaneous extraction of land cover, DTM and 3D shape of buildings , 2002 .

[24]  T. Schenk.  FUSION OF LIDAR DATA AND AERIAL IMAGERY FOR A MORE COMPLETE SURFACE DESCRIPTION , 2002 .

[25]  Zhou Guo-qing.  Filtering method of LIDAR data based on contours , 2009 .

[26]  Matthieu Cord,et al.  Building Detection and Reconstruction from Mid- and High-Resolution Aerial Imagery , 1998, Comput. Vis. Image Underst..

[27]  Luis Ángel Ruiz Fernández,et al.  Evaluation of Automatic Building Detection Approaches Combining High Resolution Images and LiDAR Data , 2011, Remote. Sens..

[28]  Taejung Kim,et al.  Automated urban area building extraction from high resolution stereo imagery , 1996, Image Vis. Comput..

[29]  Hamid Abrishami Moghaddam,et al.  Automatic urban building boundary extraction from high resolution aerial images using an innovative model of active contours , 2010, Int. J. Appl. Earth Obs. Geoinformation.

[30]  Allen R. Hanson,et al.  Recognition and reconstruction of buildings from multiple aerial images , 2003, Comput. Vis. Image Underst..

[31]  Jing Peng,et al.  An improved snake model for building detection from urban aerial images , 2005, Pattern Recognit. Lett..

[32]  Norbert Pfeifer,et al.  A Comparison of Evaluation Techniques for Building Extraction From Airborne Laser Scanning , 2009, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  David M. McKeown,et al.  Automating Knowledge Acquisition For Aerial Image Interpretation , 1987, Photonics West - Lasers and Applications in Science and Engineering.

[34]  Guoqing Zhou,et al.  Geo-Referencing of Video Flow From Small Low-Cost Civilian UAV , 2010, IEEE Transactions on Automation Science and Engineering.

[35]  Hélène Oriot,et al.  Rectangular building extraction from stereoscopic airborne Radar images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Peter Axelsson,et al.  Processing of laser scanner data-algorithms and applications , 1999 .

[37]  Matthieu Cord,et al.  Accurate Building Structure Recovery from High Resolution Aerial Imagery , 2001, Comput. Vis. Image Underst..

[38]  Kyoung Mu Lee,et al.  Fusion of Lidar and Imagery for Reliable Building Extraction , 2008 .

[39]  King-Sun Fu,et al.  Machine Understanding of CSG: Extraction and Unification of Manufacturing Features , 1987, IEEE Computer Graphics and Applications.

[40]  C. Song,et al.  Urban 3D GIS From LiDAR and digital aerial images , 2004, Comput. Geosci..

[41]  Shu-Ching Chen,et al.  Automatic Construction of Building Footprints From Airborne LIDAR Data , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[42]  George Vosselman,et al.  Experimental comparison of filter algorithms for bare-Earth extraction from airborne laser scanning point clouds , 2004 .

[43]  Ye Yu,et al.  Residential Building Reconstruction Based on the Data Fusion of Sparse LiDAR Data and Satellite Imagery , 2009, ISVC.

[44]  David M. McKeown.  Knowledge-based aerial photo interpretation☆ , 1984 .

[45]  Hai Wei,et al.  Fusion of LIDAR and aerial imagery for accurate building footprint extraction , 2009, Electronic Imaging.

[46]  Suya You,et al.  Integrating LiDAR, Aerial Image and Ground Images for Complete Urban Building Modeling , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[47]  Lu Wang,et al.  A robust approach for automatic registration of aerial images with untextured aerial LiDAR data , 2009, CVPR.

[48]  I. Biederman.  Human image understanding: Recent research and a theory , 1985, Computer Vision Graphics and Image Processing.

[49]  Mahmod Reza Sahebi,et al.  Automatic building extraction from LIDAR digital elevation models and WorldView imagery , 2009 .

[50]  Salman Ahmadi,et al.  An improved snake model for automatic extraction of buildings from urban aerial images and LiDAR data , 2010, Comput. Environ. Urban Syst..

[51]  Takashi Matsuyama,et al.  Knowledge-based aerial image understanding systems , 1986 .

[52]  Azriel Rosenfeld,et al.  3-D Shape Recovery Using Distributed Aspect Matching , 1992, IEEE Trans. Pattern Anal. Mach. Intell..