SEMANTICALLY ENRICHED HIGH RESOLUTION LOD 3 BUILDING MODEL GENERATION

Abstract. This paper reports about an effort to generate LoD3 models of buildings semi-automatically, with the highest possible level of automation. It is work in progress. We use multi-sensor data like aerial images from a 5-head camera with a GSD of 10 cm, UAV images, and aerial and mobile LiDAR point clouds. We distinguish two cases: LoD2 models are available and they are not. We apply Multi-Photo Geometrically Constrained Least Squares Matching for different kind of point measurements. The regularity of many building facades in Singapore leads us to the idea to generalize the measurement procedure towards using measurement macros (geometrical primitives, i.e. windows, doors, etc.) and combine reality-based with procedural modelling. In parallel we try to model these facade elements from LiDAR point cloud data. In another research line we do building detection by a novel approach to land-cover classification, incorporating features of the facades to improve the classification accuracy. To generate the semantic labels of the facades, we developed a spatially unrelated mean-shift clustering method to yield structurally confined segments. It is the characteristic of automated and even semi-automated procedures that the results need some amount of editing. We therefore work on interactive post-editing approaches on CityGML building models containing semantic information of each surface. Maintaining the semantic information throughout the editing process is essential but often lack the support from current tools. Accordingly, we implement a method to synchronize CityGML models. Overall this project consists of a great number of different algorithmic components, which can only be coarsely explained in this paper.

[1]  Rongjun Qin,et al.  A Hierarchical Building Detection Method for Very High Resolution Remotely Sensed Images Combined with DSM Using Graph Cut Optimization , 2014 .

[2]  Peter Wonka,et al.  Interactive Dimensioning of Parametric Models , 2015, Comput. Graph. Forum.

[3]  Qian Zhang,et al.  Classification of Ultra-High Resolution Orthophotos Combined with DSM Using a Dual Morphological Top Hat Profile , 2015, Remote. Sens..

[4]  Debra F. Laefer,et al.  Slicing Method for curved façade and window extraction from point clouds , 2016 .

[5]  Susanne Becker,et al.  Generation and application of rules for quality dependent façade reconstruction , 2009 .

[6]  George Vosselman,et al.  Knowledge based reconstruction of building models from terrestrial laser scanning data , 2009 .

[7]  Leonidas J. Guibas,et al.  Discovering structural regularity in 3D geometry , 2008, SIGGRAPH 2008.

[8]  A. Gruen ADAPTIVE LEAST SQUARES CORRELATION: A POWERFUL IMAGE MATCHING TECHNIQUE , 1985 .

[9]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Rongjun Qin,et al.  Urban Land-Cover Classification with Façade Feature From Oblique Images , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[11]  Filip Biljecki,et al.  A SLIDING WINDOW METHOD FOR DETECTING CORNERS OF OPENINGS FROM TERRESTRIAL LIDAR DATA , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[12]  Armin Gruen,et al.  CC-MODELER : A TOPOLOGY GENERATOR FOR 3-D CITY MODELS , 1998 .

[13]  Franklin C. Crow,et al.  Summed-area tables for texture mapping , 1984, SIGGRAPH.

[14]  Daniel Cohen-Or,et al.  SmartBoxes for interactive urban reconstruction , 2010, ACM Transactions on Graphics.

[15]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[16]  Pascal Müller,et al.  Procedural modeling of cities , 2001, SIGGRAPH.

[17]  Armin Gruen,et al.  Adaptive Least Squares Correlation With Geometrical Constraints , 1986, Other Conferences.