HIERARCHICAL REGULARIZATION OF POLYGONS FOR PHOTOGRAMMETRIC POINT CLOUDS OF OBLIQUE IMAGES

Abstract. Despite the success of multi-view stereo (MVS) reconstruction from massive oblique images in city scale, only point clouds and triangulated meshes are available from existing MVS pipelines, which are topologically defect laden, free of semantical information and hard to edit and manipulate interactively in further applications. On the other hand, 2D polygons and polygonal models are still the industrial standard. However, extraction of the 2D polygons from MVS point clouds is still a non-trivial task, given the fact that the boundaries of the detected planes are zigzagged and regularities, such as parallel and orthogonal, cannot preserve. Aiming to solve these issues, this paper proposes a hierarchical polygon regularization method for the photogrammetric point clouds from existing MVS pipelines, which comprises of local and global levels. After boundary points extraction, e.g. using alpha shapes, the local level is used to consolidate the original points, by refining the orientation and position of the points using linear priors. The points are then grouped into local segments by forward searching. In the global level, regularities are enforced through a labeling process, which encourage the segments share the same label and the same label represents segments are parallel or orthogonal. This is formulated as Markov Random Field and solved efficiently. Preliminary results are made with point clouds from aerial oblique images and compared with two classical regularization methods, which have revealed that the proposed method are more powerful in abstracting a single building and is promising for further 3D polygonal model reconstruction and GIS applications.

[1]  Reinhard Klein,et al.  Efficient RANSAC for Point‐Cloud Shape Detection , 2007, Comput. Graph. Forum.

[2]  Michael Wimmer,et al.  O-snap , 2013, ACM Trans. Graph..

[3]  Andrzej Borkowski,et al.  3D building reconstruction from ALS data using unambiguous decomposition into elementary structures , 2016 .

[4]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  G. Petrie Systematic Oblique Aerial Photography Using Multiple Digital Frame Cameras , 2009 .

[6]  Pierre Alliez,et al.  CGAL - The Computational Geometry Algorithms Library , 2011 .

[7]  Linfu Xie,et al.  An asymmetric re-weighting method for the precision combined bundle adjustment of aerial oblique images , 2016 .

[8]  Christopher Dyken,et al.  Simultaneous curve simplification , 2009, J. Geogr. Syst..

[9]  Daniel Freedman,et al.  Energy minimization via graph cuts: settling what is possible , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  F. Nex,et al.  OBLIQUE MULTI-CAMERA SYSTEMS - ORIENTATION AND DENSE MATCHING ISSUES , 2014 .

[11]  M. Rothermel,et al.  Benchmarking High Density Image Matching for Oblique Airborne Imagery , 2014 .

[12]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Z. Du,et al.  Reliable Spatial Relationship Constrained Feature Point Matching of Oblique Aerial Images , 2015 .

[14]  K. Wenzel,et al.  A comparison of dense matching algorithms for scaled surface reconstruction using stereo camera rigs , 2013 .

[15]  Andreas Birk,et al.  Fast plane detection and polygonalization in noisy 3D range images , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Baining Guo,et al.  Surface Reconstruction Using Alpha Shapes , 1997, Comput. Graph. Forum.

[17]  Daniel Cohen-Or,et al.  ℓ1-Sparse reconstruction of sharp point set surfaces , 2010, TOGS.

[18]  Qing Zhu,et al.  TEXTURE-AWARE DENSE IMAGE MATCHING USING TERNARY CENSUS TRANSFORM , 2016 .

[19]  Fabio Remondino,et al.  Aerial multi-camera systems: Accuracy and block triangulation issues , 2015 .

[20]  Markus Gerke,et al.  The ISPRS benchmark on urban object classification and 3D building reconstruction , 2012 .

[21]  M. Rothermel,et al.  Oblique Image Data Processing – Potential , Experiences and Recommendations , 2013 .