Extraction of residential building instances in suburban areas from mobile LiDAR data

Abstract In the recent years, mobile LiDAR data has become an important data source for building mapping. However, it is challenging to extract building instances in residential areas where buildings of different structures are closely distributed and surrounded by cluttered objects such as vegetations. In this paper, we present a new “localization then segmentation” framework to tackle these problems. First, a hypothesis and selection method is proposed to localize buildings. Rectangle proposals which indicate building locations are generated using projections of vertical walls obtained by region growing. The selection of rectangles is formulated as a constrained maximization problem, which is solved by linear programming. Then, point clouds are divided into groups, each of which contains one building instance. A foreground-background segmentation method is then proposed to extract buildings from complex surroundings in each group. Based on the graph of points, an objective function which integrates local geometric features and shape priors is minimized by the graph cuts. The experiments are conducted in two large and complex scenes, Calgary and Kentucky residential areas. The completeness and correctness of building localization in the former dataset are 87.2% and 91.34%, respectively. In the latter dataset, the completeness and correctness of building localization are 100% and 96.3%, respectively. Based on the tests, our binary segmentation method outperforms existing methods regarding the F1 measure. These results demonstrate the feasibility and effectiveness of our framework in extracting instance-level residential buildings from mobile LiDAR point clouds in suburban areas.

[1]  Wuming Zhang,et al.  An Easy-to-Use Airborne LiDAR Data Filtering Method Based on Cloth Simulation , 2016, Remote. Sens..

[2]  Bisheng Yang,et al.  Automated Extraction of Building Outlines From Airborne Laser Scanning Point Clouds , 2013, IEEE Geoscience and Remote Sensing Letters.

[3]  Ramakant Nevatia,et al.  Building Detection and Description from a Single Intensity Image , 1998, Comput. Vis. Image Underst..

[4]  Olga Veksler,et al.  Star Shape Prior for Graph-Cut Image Segmentation , 2008, ECCV.

[5]  Qingquan Li,et al.  Automated extraction of street-scene objects from mobile lidar point clouds , 2012 .

[6]  Zhen Wang,et al.  A Multiscale and Hierarchical Feature Extraction Method for Terrestrial Laser Scanning Point Cloud Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[7]  S. J. Oude Elberink,et al.  Feasibility of facade footprint extraction from mobile laser scanning data , 2011 .

[8]  Rongjun Qin,et al.  Object-Based 3-D Building Change Detection on Multitemporal Stereo Images , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Chun Liu,et al.  Automatic Buildings Extraction From LiDAR Data in Urban Area by Neural Oscillator Network of Visual Cortex , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Zhang Liqiang,et al.  A spatial cognition-based urban building clustering approach and its applications , 2013 .

[12]  Shi-Min Hu,et al.  Adaptive partitioning of urban facades , 2011, SA '11.

[13]  Ahmad Kamal Aijazi,et al.  Segmentation Based Classification of 3D Urban Point Clouds: A Super-Voxel Based Approach with Evaluation , 2013, Remote. Sens..

[14]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[15]  Vladimir G. Kim,et al.  Shape-based recognition of 3D point clouds in urban environments , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[16]  Beatriz Marcotegui,et al.  Point cloud segmentation towards urban ground modeling , 2009, 2009 Joint Urban Remote Sensing Event.

[17]  Jonathan Li,et al.  Use of mobile LiDAR in road information inventory: a review , 2016 .

[18]  Xiao Xiang Zhu,et al.  Building Instance Classification Using Street View Images , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[19]  Derek D. Lichti,et al.  Robust Segmentation of Planar and Linear Features of Terrestrial Laser Scanner Point Clouds Acquired from Construction Sites , 2018, Sensors.

[20]  Tao Zhang,et al.  Interactive graph cut based segmentation with shape priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  F. Dornaika,et al.  EXTRACTING WIRE-FRAME MODELS OF STREET FACADES FROM 3D POINT CLOUDS AND THE CORRESPONDING CADASTRAL MAP , 2010 .

[22]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[23]  Jianping Wu,et al.  Automated derivation of urban building density information using airborne LiDAR data and object-based method , 2010 .

[24]  C. Fraser,et al.  Automatic Detection of Residential Buildings Using LIDAR Data and Multispectral Imagery , 2010 .

[25]  Erzhuo Che,et al.  Multi-scan segmentation of terrestrial laser scanning data based on normal variation analysis , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[26]  Minglei Li,et al.  Fitting boxes to Manhattan scenes using linear integer programming , 2016, Int. J. Digit. Earth.

[27]  George Vosselman,et al.  Building extraction from oblique airborne imagery based on robust façade detection , 2012 .

[28]  George Vosselman,et al.  Knowledge based reconstruction of building models from terrestrial laser scanning data , 2009 .

[29]  Andrés Serna,et al.  Segmentation of Façades from Urban 3D Point Clouds Using Geometrical and Morphological Attribute-Based Operators , 2016, ISPRS Int. J. Geo Inf..

[30]  Yanming Chen,et al.  Building Point Detection from Vehicle-Borne LiDAR Data Based on Voxel Group and Horizontal Hollow Analysis , 2016, Remote. Sens..

[31]  Hao Deng,et al.  Interactive Urban Context-Aware Visualization via Multiple Disocclusion Operators , 2016, IEEE Transactions on Visualization and Computer Graphics.

[32]  Ruigang Yang,et al.  Online Building Segmentation from Ground-Based LiDAR Data in Urban Scenes , 2013, 2013 International Conference on 3D Vision.

[33]  Yunchao Wei,et al.  Proposal-Free Network for Instance-Level Object Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Stefan Hinz,et al.  Semantic point cloud interpretation based on optimal neighborhoods, relevant features and efficient classifiers , 2015 .

[35]  Manchun Li,et al.  Use of LiDAR for calculating solar irradiance on roofs and façades of buildings at city scale: Methodology, validation, and analysis , 2018 .

[36]  Andrés Serna,et al.  Detection, segmentation and classification of 3D urban objects using mathematical morphology and supervised learning , 2014 .

[37]  Bisheng Yang,et al.  Hierarchical extraction of urban objects from mobile laser scanning data , 2015 .

[38]  Sheng Xu,et al.  Recognizing Street Lighting Poles From Mobile LiDAR Data , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Abdul Nurunnabi,et al.  Robust Segmentation for Large Volumes of Laser Scanning Three-Dimensional Point Cloud Data , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Çaglar Senaras,et al.  Automated Detection of Arbitrarily Shaped Buildings in Complex Environments From Monocular VHR Optical Satellite Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Dong Chen,et al.  Topologically Aware Building Rooftop Reconstruction From Airborne Laser Scanning Point Clouds , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[43]  J. Demantké,et al.  DIMENSIONALITY BASED SCALE SELECTION IN 3D LIDAR POINT CLOUDS , 2012 .

[44]  Bruno Vallet,et al.  TerraMobilita/iQmulus urban point cloud analysis benchmark , 2015, Comput. Graph..

[45]  Shu-Ching Chen,et al.  Automatic Construction of Building Footprints From Airborne LIDAR Data , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Thomas A. Funkhouser,et al.  Min-cut based segmentation of point clouds , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[47]  Jun Yu,et al.  Semiautomated Extraction of Street Light Poles From Mobile LiDAR Point-Clouds , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Parvaneh Saeedi,et al.  Automatic Rooftop Extraction in Nadir Aerial Imagery of Suburban Regions Using Corners and Variational Level Set Evolution , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[51]  Josiane Zerubia,et al.  Automatic Building Extraction from DEMs using an Object Approach and Application to the 3D-city Modeling , 2008 .

[52]  Dirk Wollherr,et al.  A clustering method for efficient segmentation of 3D laser data , 2008, 2008 IEEE International Conference on Robotics and Automation.

[53]  Wei Yao,et al.  Identifying Man-Made Objects Along Urban Road Corridors From Mobile LiDAR Data , 2014, IEEE Geoscience and Remote Sensing Letters.