Intact Planar Abstraction of Buildings via Global Normal Refinement from Noisy Oblique Photogrammetric Point Clouds

Oblique photogrammetric point clouds are currently one of the major data sources for the three-dimensional level-of-detail reconstruction of buildings. However, they are severely noise-laden and pose serious problems for the effective and automatic surface extraction of buildings. In addition, conventional methods generally use normal vectors estimated in a local neighborhood, which are liable to be affected by noise, leading to inferior results in successive building reconstruction. In this paper, we propose an intact planar abstraction method for buildings, which explicitly handles noise by integrating information in a larger context through global optimization. The information propagates hierarchically from a local to global scale through the following steps: first, based on voxel cloud connectivity segmentation, single points are clustered into supervoxels that are enforced to not cross the surface boundary; second, each supervoxel is expanded to nearby supervoxels through the maximal support region, which strictly enforces planarity; third, the relationships established by the maximal support regions are injected into a global optimization, which reorients the local normal vectors to be more consistent in a larger context; finally, the intact planar surfaces are obtained by region growing using robust normal and point connectivity in the established spatial relations. Experiments on the photogrammetric point clouds obtained from oblique images showed that the proposed method is effective in reducing the influence of noise and retrieving almost all of the major planar structures of the examined buildings.

[1]  Qingquan Li,et al.  An Improved Method for Power-Line Reconstruction from Point Cloud Data , 2016, Remote. Sens..

[2]  Florentin Wörgötter,et al.  Object Partitioning Using Local Convexity , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Pavel Smrz,et al.  Continuous plane detection in point-cloud data based on 3D Hough Transform , 2014, J. Vis. Commun. Image Represent..

[4]  S. J. Oude Elberink,et al.  Building modeling from noisy photogrammetric point clouds , 2014 .

[5]  David G. Lowe,et al.  Scalable Nearest Neighbor Algorithms for High Dimensional Data , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Florentin Wörgötter,et al.  Voxel Cloud Connectivity Segmentation - Supervoxels for Point Clouds , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Fabio Remondino,et al.  State of the art in high density image matching , 2014 .

[8]  Maks Ovsjanikov,et al.  PCPNet Learning Local Shape Properties from Raw Point Clouds , 2017, Comput. Graph. Forum.

[9]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[10]  Ji-Hwan Kim,et al.  New approach to accuracy verification of 3D surface models: An analysis of point cloud coordinates. , 2016, Journal of prosthodontic research.

[11]  Abdul Nurunnabi,et al.  Outlier detection and robust normal-curvature estimation in mobile laser scanning 3D point cloud data , 2015, Pattern Recognit..

[12]  Michela Bertolotto,et al.  Octree-based region growing for point cloud segmentation , 2015 .

[13]  Qing Zhu,et al.  Robust point cloud classification based on multi-level semantic relationships for urban scenes , 2017 .

[14]  C. Lin,et al.  Eigen-feature analysis of weighted covariance matrices for LiDAR point cloud classification , 2014 .

[15]  Xiao Xiang Zhu,et al.  Automatic Feature-Based Geometric Fusion of Multiview TomoSAR Point Clouds in Urban Area , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[17]  Linfu Xie,et al.  An asymmetric re-weighting method for the precision combined bundle adjustment of aerial oblique images , 2016 .

[18]  Yusheng Xu,et al.  Segmentation of building roofs from airborne LiDAR point clouds using robust voxel-based region growing , 2017 .

[19]  F. Remondinob,et al.  ORIENTATION OF OBLIQUE AIRBORNE IMAGE SETS-EXPERIENCES FROM THE ISPRS / EUROSDR BENCHMARK ON MULTI-PLATFORM PHOTOGRAMMETRY , 2016 .

[20]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[21]  F. Pukelsheim The Three Sigma Rule , 1994 .

[22]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[23]  Derek Nowrouzezahrai,et al.  Extracting lines of curvature from noisy point clouds , 2009, Comput. Aided Des..

[24]  Peng Li,et al.  3-D Point Cloud Object Detection Based on Supervoxel Neighborhood With Hough Forest Framework , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[25]  Manuel Menezes de Oliveira Neto,et al.  Real-time detection of planar regions in unorganized point clouds , 2015, Pattern Recognit..

[26]  Li Li,et al.  PAIRWISE LINKAGE FOR POINT CLOUD SEGMENTATION , 2016 .

[27]  Alexandre Boulch,et al.  Deep Learning for Robust Normal Estimation in Unstructured Point Clouds , 2016, Comput. Graph. Forum.

[28]  Ben Jarihani,et al.  Assessment of UAV and Ground-Based Structure from Motion with Multi-View Stereo Photogrammetry in a Gullied Savanna Catchment , 2017, ISPRS Int. J. Geo Inf..

[29]  Mathias Rothermel,et al.  Extracting 3D urban models from oblique aerial images , 2015, 2015 Joint Urban Remote Sensing Event (JURSE).

[30]  Hossein Arefi,et al.  3D Semantic Labeling using Region Growing Segmentation Based on Structural and Geometric Attributes , 2017 .

[31]  Supun Samarasekera,et al.  Building segmentation for densely built urban regions using aerial LIDAR data , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Qingquan Li,et al.  An Improved Method for PowerLine Reconstruction from Point Cloud Data , 2016 .

[33]  M. J. Ramón,et al.  Virtual Directions in Paleomagnetism: A Global and Rapid Approach to Evaluate the NRM Components , 2017, Front. Earth Sci..

[34]  Andrey Dimitrov,et al.  Non‐Uniform B‐Spline Surface Fitting from Unordered 3D Point Clouds for As‐Built Modeling , 2016, Comput. Aided Civ. Infrastructure Eng..

[35]  J. Shan,et al.  A global optimization approach to roof segmentation from airborne lidar point clouds , 2014 .

[36]  Bisheng Yang,et al.  An efficient global energy optimization approach for robust 3D plane segmentation of point clouds , 2018 .

[37]  Cheng Wang,et al.  Toward better boundary preserved supervoxel segmentation for 3D point clouds , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[38]  F. Tarsha-Kurdi,et al.  Hough-Transform and Extended RANSAC Algorithms for Automatic Detection of 3D Building Roof Planes from Lidar Data , 2007 .

[39]  Marc Pouget,et al.  Estimating differential quantities using polynomial fitting of osculating jets , 2003, Comput. Aided Geom. Des..

[40]  Lei Tang,et al.  An Improved RANSAC for 3D Point Cloud Plane Segmentation Based on Normal Distribution Transformation Cells , 2017, Remote. Sens..

[41]  Azriel Rosenfeld,et al.  Digital topology: Introduction and survey , 1989, Comput. Vis. Graph. Image Process..

[42]  Yang Yu,et al.  An adaptive variation model for point cloud normal computation , 2015, Neural Computing and Applications.

[43]  Daniel Cohen-Or,et al.  Consolidation of unorganized point clouds for surface reconstruction , 2009, ACM Trans. Graph..

[44]  Qing Zhu,et al.  Stable least-squares matching for oblique images using bound constrained optimization and a robust loss function , 2016 .

[45]  Z. Du,et al.  Reliable Spatial Relationship Constrained Feature Point Matching of Oblique Aerial Images , 2015 .

[46]  T. Rabbani,et al.  SEGMENTATION OF POINT CLOUDS USING SMOOTHNESS CONSTRAINT , 2006 .

[47]  Xianfeng Huang,et al.  A Methodology for Automated Segmentation and Reconstruction of Urban 3-D Buildings from ALS Point Clouds , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[48]  Yugang Tian,et al.  LiDAR Filtering of Urban Areas With Region Growing Based on Moving-Window Weighted Iterative Least-Squares Fitting , 2017, IEEE Geoscience and Remote Sensing Letters.

[49]  Daniel Cohen-Or,et al.  ℓ1-Sparse reconstruction of sharp point set surfaces , 2010, TOGS.

[50]  Yanming Chen,et al.  Multiscale Grid Method for Detection and Reconstruction of Building Roofs from Airborne LiDAR Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[51]  Yu-ze Nie,et al.  An Algorithm of Combining Delaunay TIN Models and Region Growing for Buildings Extraction , 2017 .

[52]  Yi-Hsing Tseng,et al.  Surface Reconstruction from LiDAR Data with Extended Snake Theory , 2007, EMMCVPR.