Variational Building Modeling from Urban MVS Meshes

In this paper, we introduce a method for building LOD (levels of detail) modeling from urban multi-view stereo (MVS) meshes. Using city MVS meshes as input, our algorithm proceeds in three main steps: segmentation, contour extraction and modeling. With the prior knowledge and span constraint, we first segment the scene with an adapted variational measure to discover the underlying structures. The next contour extraction step projects the vertical structures onto the ground as line segments and extract the facade contours from them with a Markov random field. In the last modeling step, the contours are used to label the roof sections out and extruded to generate models of LODs with semantics. Experiments on complex and noisy urban meshes show that our approach could generate compact and accurate building models when compared with stateof- art methods.

[1]  Neil Smith,et al.  Reconstructing building mass models from UAV images , 2016, Comput. Graph..

[2]  Zhanyi Hu,et al.  How to Select Good Neighboring Images in Depth-Map Merging Based 3D Modeling , 2014, IEEE Transactions on Image Processing.

[3]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[4]  Horst Bischof,et al.  Regularized 3D Modeling from Noisy Building Reconstructions , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[5]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[6]  Charalambos Poullis,et al.  A Framework for Automatic Modeling from Point Cloud Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Long Quan,et al.  Higher-Order CRF Structural Segmentation of 3D Reconstructed Surfaces , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  Dong-Ming Yan,et al.  Variational mesh segmentation via quadric surface fitting , 2012, Comput. Aided Des..

[10]  Qian-Yi Zhou,et al.  Fast and extensible building modeling from airborne LiDAR data , 2008, GIS '08.

[11]  Michael Goesele,et al.  Shading-Aware Multi-view Stereo , 2016, ECCV.

[12]  Daniel Cohen-Or,et al.  SmartBoxes for interactive urban reconstruction , 2010, ACM Transactions on Graphics.

[13]  Jean Ponce,et al.  Accurate Camera Calibration from Multi-View Stereo and Bundle Adjustment , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Jan-Michael Frahm,et al.  Structure-from-Motion Revisited , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Ulrich Neumann,et al.  2.5D Dual Contouring: A Robust Approach to Creating Building Models from Aerial LiDAR Point Clouds , 2010, ECCV.

[16]  Marco Attene,et al.  Hierarchical mesh segmentation based on fitting primitives , 2006, The Visual Computer.

[17]  Florent Lafarge,et al.  Structure‐Aware Mesh Decimation , 2015, Comput. Graph. Forum.

[18]  Richard Szeliski,et al.  Manhattan-world stereo , 2009, CVPR.

[19]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[20]  Zhanyi Hu,et al.  HSfM: Hybrid Structure-from-Motion , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[22]  Jan-Michael Frahm,et al.  Pixelwise View Selection for Unstructured Multi-View Stereo , 2016, ECCV.

[23]  Peter Wonka,et al.  Manhattan-World Urban Reconstruction from Point Clouds , 2016, ECCV.

[24]  Daniel G. Aliaga,et al.  Building reconstruction using manhattan-world grammars , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Zhanyi Hu,et al.  Tracks selection for robust, efficient and scalable large-scale structure from motion , 2017, Pattern Recognit..

[26]  Mathieu Desbrun,et al.  Variational shape approximation , 2004, SIGGRAPH 2004.

[27]  Florent Lafarge,et al.  LOD Generation for Urban Scenes , 2015, ACM Trans. Graph..