TOWARDS AUTOMATIC SEMANTIC LABELLING OF 3D CITY MODELS

Abstract. The lack of semantic information in many 3D city models is a considerable limiting factor in their use, as a lot of applications rely on semantics. Such information is not always available, since it is not collected at all times, it might be lost due to data transformation, or its lack may be caused by non-interoperability in data integration from other sources. This research is a first step in creating an automatic workflow that semantically labels plain 3D city model represented by a soup of polygons, with semantic and thematic information, as defined in the CityGML standard. The first step involves the reconstruction of the topology, which is used in a region growing algorithm that clusters upward facing adjacent triangles. Heuristic rules, embedded in a decision tree, are used to compute a likeliness score for these regions that either represent the ground (terrain) or a RoofSurface. Regions with a high likeliness score, to one of the two classes, are used to create a decision space, which is used in a support vector machine (SVM). Next, topological relations are utilised to select seeds that function as a start in a region growing algorithm, to create regions of triangles of other semantic classes. The topological relationships of the regions are used in the aggregation of the thematic building features. Finally, the level of detail is detected to generate the correct output in CityGML. The results show an accuracy between 85 % and 99 % in the automatic semantic labelling on four different test datasets. The paper is concluded by indicating problems and difficulties implying the next steps in the research.

[1]  Jesfis Peral,et al.  Heuristics -- intelligent search strategies for computer problem solving , 1984 .

[2]  George Vosselman,et al.  3D BUILDING MODEL RECONSTRUCTION FROM POINT CLOUDS AND GROUND PLANS , 2001 .

[3]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[4]  T. H. Kolbe,et al.  CityGML: Interoperable Access to 3D City Models , 2005 .

[5]  Fabio Pittarello,et al.  Semantic description of 3D environments: a proposal based on web standards , 2006, Web3D '06.

[6]  Thomas H. Kolbe,et al.  Spatio-semantic coherence in the integration of 3D city models , 2007 .

[7]  G. Gröger,et al.  SEMANTICALLY ENHANCED PROTOTYPES FOR BUILDING RECONSTRUCTION , 2007 .

[8]  Sisi Zlatanova,et al.  Creating Spatial Information Infrastructures: Towards the Spatial Semantic Web , 2008 .

[9]  Peter van Oosterom,et al.  Spatial Access Methods , 2009, Encyclopedia of Database Systems.

[10]  S. Zlatanova,et al.  Geoinformation for Disaster and Risk Management. Examples and best practices , 2010 .

[11]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[12]  Lutz Plümer,et al.  Automatic classification of building types in 3D city models , 2012, GeoInformatica.

[13]  Jean Brodeur,et al.  Geosemantic Interoperability and the Geospatial Semantic Web , 2012, Springer Handbook of Geographic Information.

[14]  Lutz Plümer,et al.  CityGML – Interoperable semantic 3D city models , 2012 .

[15]  Burcu Akinci,et al.  Automatic Creation of Semantically Rich 3D Building Models from Laser Scanner Data , 2013 .

[16]  Hugo Ledoux,et al.  On the Validation of Solids Represented with the International Standards for Geographic Information , 2013, Comput. Aided Civ. Infrastructure Eng..

[17]  Filip Biljecki,et al.  Formalisation of the level of detail in 3D city modelling , 2014, Comput. Environ. Urban Syst..

[18]  Norbert Pfeifer,et al.  Automated Classification of Airborne Laser Scanning Point Clouds , 2014, ArXiv.

[19]  G. Damiand,et al.  Automatic Semantic Labelling of 3D Buildings Based on Geometric and Topological Information , 2014 .

[20]  Shai Ben-David,et al.  Understanding Machine Learning: From Theory to Algorithms , 2014 .

[21]  Filip Biljecki,et al.  Applications of 3D City Models: State of the Art Review , 2015, ISPRS Int. J. Geo Inf..

[22]  Filip Biljecki,et al.  Automatically enhancing CityGML LOD2 models with a corresponding indoor geometry , 2015, Int. J. Geogr. Inf. Sci..

[23]  Filip Biljecki,et al.  Automatic Semantic-preserving Conversion Between OBJ and CityGML , 2015, UDMV.

[24]  T. Kolbe,et al.  CityGML goes to Broadway , 2015 .

[25]  Florent Lafarge,et al.  LOD Generation for Urban Scenes , 2015, ACM Trans. Graph..

[26]  Filip Biljecki,et al.  An improved LOD specification for 3D building models , 2016, Comput. Environ. Urban Syst..

[27]  Christopher B. Jones,et al.  Automatic semantic and geometric enrichment of CityGML building models using HoG-based template matching , 2017 .