Automatic LIDAR building segmentation based on DGCNN and euclidean clustering

There has been growing demand for 3D modeling from earth observations, especially for purposes of urban and regional planning and management. The results of 3D observations has slowly become the primary source of data in terms of policy determination and infrastructure planning. In this research, we presented an automatic building segmentation method that directly uses LIDAR data. Previous works have utilized the CNN method to automatically segment buildings. However, the existing body of works have relied heavily on the conversion of LIDAR data into Digital Terrain Model (DTM), Digital Surface Model (DSM), or Digital Elevation Model (DEM) formats. Those formats required conversion of LIDAR data into raster images, which poses challenges to the evaluation of building volumes. In this paper, we collected LIDAR data with unmanned aerial vehicle and directly segmented buildings utilizing the said LIDAR data. We utilized a Dynamic Graph Convolutional Neural Network (DGCNN) algorithm to separate buildings and vegetation. We then utilized Euclidean Clustering to segment each building. We found that the combination of these methods are superior to prior works in the field, with accuracy up to 95.57% and an Intersection Over Union (IOU) score of 0.85.

[1]  John Trinder,et al.  Using the Dempster-Shafer method for the fusion of LIDAR data and multi-spectral images for building detection , 2005, Inf. Fusion.

[2]  G. Vosselman.  BUILDING RECONSTRUCTION USING PLANAR FACES IN VERY HIGH DENSITY HEIGHT DATA , 1999 .

[3]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Guojun Lu,et al.  Automatic segmentation of LiDAR point cloud data at different height levels for 3D building extraction , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[5]  Fei-Fei Li,et al.  Large-Scale Video Classification with Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  Thomas Blaschke,et al.  Building Extraction from Airborne Laser Scanning Data: An Analysis of the State of the Art , 2015, Remote. Sens..

[8]  Eric O. Postma,et al.  Learning scale-variant and scale-invariant features for deep image classification , 2016, Pattern Recognit..

[9]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[10]  Biswajeet Pradhan,et al.  Fusion of Airborne LiDAR With Multispectral SPOT 5 Image for Enhancement of Feature Extraction Using Dempster–Shafer Theory , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Pengcheng Zhang,et al.  Automatic building extraction from high-resolution aerial images and LiDAR data using gated residual refinement network , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[12]  Yongsheng Zhang,et al.  Automatic Building Detection Using Airborne LIDAR Data , 2009, 2009 International Forum on Information Technology and Applications.

[13]  I. Dowman,et al.  Data fusion of high-resolution satellite imagery and LiDAR data for automatic building extraction * , 2007 .

[14]  Biswajeet Pradhan,et al.  Deep Learning Approach for Building Detection Using LiDAR-Orthophoto Fusion , 2018, J. Sensors.

[15]  George Vosselman,et al.  3D BUILDING MODEL RECONSTRUCTION FROM POINT CLOUDS AND GROUND PLANS , 2001 .

[16]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[17]  Claus Brenner,et al.  Extraction of buildings and trees in urban environments , 1999 .

[18]  Josiane Zerubia,et al.  Automatic Building Extraction from DEMs using an Object Approach and Application to the 3D-city Modeling , 2008 .

[19]  Jian Wang,et al.  Automatic extraction of building boundaries using aerial LiDAR data , 2016 .

[20]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Jiangye Yuan,et al.  Building Extraction at Scale Using Convolutional Neural Network: Mapping of the United States , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Rama Rao Nidamanuri,et al.  Segmentation based building detection approach from LiDAR point cloud , 2017 .

[23]  Pierre Alliez,et al.  Fully convolutional neural networks for remote sensing image classification , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[24]  C. Fraser,et al.  Building detection in complex scenes thorough effective separation of buildings from trees , 2012 .

[25]  Hui Li,et al.  New methodologies for precise building boundary extraction from LiDAR data and high resolution image , 2013 .

[26]  Emmanuel P. Baltsavias,et al.  Object extraction and revision by image analysis using existing geodata and knowledge: current status and steps towards operational systems☆ , 2004 .

[27]  Michele Volpi,et al.  Dense Semantic Labeling of Subdecimeter Resolution Images With Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Yong Li,et al.  An improved building boundary extraction algorithm based on fusion of optical imagery and LIDAR data , 2013 .

[29]  Jamie Sherrah,et al.  Fully Convolutional Networks for Dense Semantic Labelling of High-Resolution Aerial Imagery , 2016, ArXiv.

[30]  George Vosselman,et al.  Fusion of laser scanning data, maps, and aerial photographs for building reconstruction , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[31]  Lianru Gao,et al.  Semantic Labeling of High Resolution Aerial Imagery and LiDAR Data with Fine Segmentation Network , 2018, Remote. Sens..

[32]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[33]  Tara N. Sainath,et al.  Deep Convolutional Neural Networks for Large-scale Speech Tasks , 2015, Neural Networks.

[34]  Wenzhong Shi,et al.  Automatic Building Extraction via Adaptive Iterative Segmentation With LiDAR Data and High Spatial Resolution Imagery Fusion , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Tania Landes,et al.  New approach for automatic detection of buildings in airborne laser scanner data using first echo only , 2006 .

[36]  George Vosselman,et al.  3D Building Reconstruction by Map Based Generation and Evaluation of Hypotheses , 2001, BMVC.

[37]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.