Building segmentation and outline extraction from UAV image-derived point clouds by a line growing algorithm

ABSTRACT This paper presents an approach to process raw unmanned aircraft vehicle (UAV) image-derived point clouds for automatically detecting, segmenting and regularizing buildings of complex urban landscapes. For regularizing, we mean the extraction of the building footprints with precise position and details. In the first step, vegetation points were extracted using a support vector machine (SVM) classifier based on vegetation indexes calculated from color information, then the traditional hierarchical stripping classification method was applied to classify and segment individual buildings. In the second step, we first determined the building boundary points with a modified convex hull algorithm. Then, we further segmented these points such that each point was assigned to a fitting line using a line growing algorithm. Then, two mutually perpendicular directions of each individual building were determined through a W-k-means clustering algorithm which used the slop information and principal direction constraints. Eventually, the building edges were regularized to form the final building footprints. Qualitative and quantitative measures were used to evaluate the performance of the proposed approach by comparing the digitized results from ortho images.

[1]  Patricia Gober,et al.  Per-pixel vs. object-based classification of urban land cover extraction using high spatial resolution imagery , 2011, Remote Sensing of Environment.

[2]  Konstantinos Karantzalos,et al.  MODEL-BASED BUILDING DETECTION FROM LOW-COST OPTICAL SENSORS ONBOARD UNMANNED AERIAL VEHICLES , 2015 .

[3]  Yong Li,et al.  An improved building boundary extraction algorithm based on fusion of optical imagery and LIDAR data , 2013 .

[4]  Yong Il Kim,et al.  Extraction and Regularization of Various Building Boundaries with Complex Shapes Utilizing Distribution Characteristics of Airborne LIDAR Points , 2011 .

[5]  Ming Li,et al.  An open-source 3D solar radiation model integrated with a 3D Geographic Information System , 2015, Environ. Model. Softw..

[6]  C. Fraser,et al.  Building detection in complex scenes thorough effective separation of buildings from trees , 2012 .

[7]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[8]  Charalabos Ioannidis,et al.  Automatic Detection of Building Points from LIDAR and Dense Image Matching Point Clouds , 2015 .

[9]  Michael Cramer,et al.  The DGPF-Test on Digital Airborne Camera Evaluation - Over- view and Test Design , 2010 .

[10]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Clive S. Fraser,et al.  Automatic Segmentation of Raw LIDAR Data for Extraction of Building Roofs , 2014, Remote. Sens..

[12]  A. Huete,et al.  A review of vegetation indices , 1995 .

[13]  Mahmoud Melkemi,et al.  Computing the shape of a planar points set , 2000, Pattern Recognit..

[14]  D. Whitman,et al.  Comparison of Three Algorithms for Filtering Airborne Lidar Data , 2005 .

[15]  Madhurima Bandyopadhyay,et al.  Classification and extraction of trees and buildings from urban scenes using discrete return LiDAR and aerial color imagery , 2013, Defense, Security, and Sensing.

[16]  Amy Woodget,et al.  Quantifying Physical River Habitat Parametres Using Hyperspatial Resolution UAS Imagery and SfM-photogrammetry , 2015 .

[17]  D. T. Booth,et al.  The Accuracy of Ground-Cover Measurements , 2006 .

[18]  Mohammad Awrangjeb,et al.  Using point cloud data to identify, trace, and regularize the outlines of buildings , 2016 .

[19]  Fabio Remondino,et al.  AUTOMATIC ROOF OUTLINES RECONSTRUCTION FROM PHOTOGRAMMETRIC DSM , 2012 .

[20]  Shen Wei BUILDING BOUNDARY EXTRACTION BASED ON LIDAR POINT CLOUDS DATA , 2008 .

[21]  C. Briese,et al.  A NEW METHOD FOR BUILDING EXTRACTION IN URBAN AREAS FROM HIGH-RESOLUTION LIDAR DATA , 2002 .

[22]  C. Fraser,et al.  Automatic Detection of Residential Buildings Using LIDAR Data and Multispectral Imagery , 2010 .

[23]  J. Shan,et al.  Building boundary tracing and regularization from airborne lidar point clouds , 2007 .

[24]  R. Reulke,et al.  Remote Sensing and Spatial Information Sciences , 2005 .

[25]  M. Rothermel,et al.  SURE : PHOTOGRAMMETRIC SURFACE RECONSTRUCTION FROM IMAGER Y , 2013 .

[26]  Jianhua Gong,et al.  An open-source 3D solar radiation model integrated with a 3D Geographic Information System , 2015, Environ. Model. Softw..

[27]  Wuming Zhang,et al.  Building segmentation and modeling from airborne LiDAR data , 2015, Int. J. Digit. Earth.

[28]  Clive S. Fraser,et al.  An Automatic and Threshold-Free Performance Evaluation System for Building Extraction Techniques From Airborne LIDAR Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Ali Özgün Ok ROBUST DETECTION OF BUILDINGS FROM A SINGLE COLOR AERIAL IMAGE , 2008 .

[30]  Jin Liu,et al.  Embedding user-generated content into oblique airborne photogrammetry-based 3D city model , 2017, Int. J. Geogr. Inf. Sci..

[31]  Michael Ying Yang,et al.  Review of Automatic Feature Extraction from High-Resolution Optical Sensor Data for UAV-Based Cadastral Mapping , 2016, Remote. Sens..

[32]  Jie Shan,et al.  Segmentation and Reconstruction of Polyhedral Building Roofs From Aerial Lidar Point Clouds , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Zhengjun Liu,et al.  Building extraction from high resolution imagery based on multi-scale object oriented classification and probabilistic Hough transform , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[34]  C. Tucker Red and photographic infrared linear combinations for monitoring vegetation , 1979 .

[35]  Wolfgang Förstner,et al.  Towards automatic building extraction from high-resolution digital elevation models , 1995 .

[36]  Norbert Pfeifer,et al.  A Comparison of Evaluation Techniques for Building Extraction From Airborne Laser Scanning , 2009, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[37]  Nan Yang,et al.  Multi-View Stereo Matching Based on Self-Adaptive Patch and Image Grouping for Multiple Unmanned Aerial Vehicle Imagery , 2016, Remote. Sens..

[38]  Pankaj K. Agarwal,et al.  Exact and Approximation Algortihms for Clustering , 1997 .

[39]  D. Eberly Least Squares Fitting of Data , 2016 .

[40]  Gottfried Konecny Cadastral Mapping with Earth Observation Technology , 2010 .

[41]  G. Meyer,et al.  Verification of color vegetation indices for automated crop imaging applications , 2008 .

[42]  Chengcui Zhang,et al.  A progressive morphological filter for removing nonground measurements from airborne LIDAR data , 2003, IEEE Trans. Geosci. Remote. Sens..

[43]  Wuming Zhang,et al.  A novel building boundary reconstruction method based on lidar data and images , 2013, Other Conferences.

[44]  D. Grigillo,et al.  Urban Object Extraction from Digital Surface Model and Digital Aerial Images , 2012 .

[45]  Jaewook Jung,et al.  Results of the ISPRS benchmark on urban object detection and 3D building reconstruction , 2014 .

[46]  Nicolas Paparoditis,et al.  High-end aerial digital cameras and their impact on the automation and quality of the production workflow , 2006 .

[47]  Fabio Remondino,et al.  Building Footprints Extraction from Oblique Imagery , 2013 .

[48]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[49]  Clive S. Fraser,et al.  Automatic and threshold-free evaluation of 3D building roof reconstruction techniques , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[50]  Ramanathan Muthuganapathy,et al.  A non-parametric approach to shape reconstruction from planar point sets through Delaunay filtering , 2015, Comput. Aided Des..

[51]  Yi Li,et al.  A quantitative method for storm surge vulnerability assessment – a case study of Weihai city , 2017, Int. J. Digit. Earth.

[52]  Michael K. Ng,et al.  Automated variable weighting in k-means type clustering , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Jing Xiao,et al.  AUTOMATIC BUILDING OUTLINING FROM MULTI-VIEW OBLIQUE IMAGES , 2012 .

[54]  Neil Smith,et al.  Reconstructing building mass models from UAV images , 2016, Comput. Graph..

[55]  C. Fraser,et al.  Automatic Building Extraction From LIDAR Data Covering Complex Urban Scenes , 2014 .

[56]  Brian Johnson,et al.  Classifying a high resolution image of an urban area using super-object information , 2013 .