FROM 2D TO 3D SUPERVISED SEGMENTATION AND CLASSIFICATION FOR CULTURAL HERITAGE APPLICATIONS

Abstract. The digital management of architectural heritage information is still a complex problem, as a heritage object requires an integrated representation of various types of information in order to develop appropriate restoration or conservation strategies. Currently, there is extensive research focused on automatic procedures of segmentation and classification of 3D point clouds or meshes, which can accelerate the study of a monument and integrate it with heterogeneous information and attributes, useful to characterize and describe the surveyed object. The aim of this study is to propose an optimal, repeatable and reliable procedure to manage various types of 3D surveying data and associate them with heterogeneous information and attributes to characterize and describe the surveyed object. In particular, this paper presents an approach for classifying 3D heritage models, starting from the segmentation of their textures based on supervised machine learning methods. Experimental results run on three different case studies demonstrate that the proposed approach is effective and with many further potentials.

[1]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[2]  J. Niemeyer,et al.  Contextual classification of lidar data and building object detection in urban areas , 2014 .

[3]  Luca Cipriani,et al.  DIGITALIZATION CULTURE VS ARCHAEOLOGICAL VISUALIZATION: INTEGRATION OF PIPELINES AND OPEN ISSUES , 2017 .

[4]  Fadi Dornaika,et al.  Image-Based Delineation and Classification of Built Heritage Masonry , 2014, Remote. Sens..

[5]  Livio De Luca,et al.  A web platform for the consultation of spatialized and semantically enriched iconographic sources on cultural heritage buildings , 2013, JOCCH.

[6]  Paolo Cignoni,et al.  3D Models for Cultural Heritage: Beyond Plain Visualization , 2011, Computer.

[7]  Luca Cipriani,et al.  3D models mapping optimization through an integrated parameterization approach: cases studies from Ravenna , 2014 .

[8]  Pedro Arias,et al.  Automatic Morphologic Analysis of Quasi‐Periodic Masonry Walls from LiDAR , 2016, Comput. Aided Civ. Infrastructure Eng..

[9]  S. J. Oude Elberink,et al.  Multiple-entity based classification of airborne laser scanning data in urban areas , 2014 .

[10]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[11]  Fan Zhang,et al.  Classification of airborne laser scanning data using JointBoost , 2015 .

[12]  G. Sithole.  DETECTION OF BRICKS IN A MASONRY WALL , 2008 .

[13]  Livio De Luca,et al.  A Hybrid Approach for the Semantic Annotation of Spatially Oriented Images , 2014 .

[14]  Fabrizio Ivan Apollonio,et al.  Title : A 3 D-centered Information System for the documentation of a complex restoration intervention , 2017 .

[15]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Gabriele Guidi,et al.  Segmentation of 3D models for cultural heritage structural analysis – some critical issues , 2017 .

[17]  Michael Weinmann,et al.  Geospatial Computer Vision Based on Multi-Modal Data - How Valuable Is Shape Information for the Extraction of Semantic Information? , 2017, Remote. Sens..

[18]  Stefan Hinz,et al.  CONTEXTUAL CLASSIFICATION OF POINT CLOUD DATA BY EXPLOITING INDIVIDUAL 3D NEIGBOURHOODS , 2015 .

[19]  Konrad Schindler,et al.  FAST SEMANTIC SEGMENTATION OF 3D POINT CLOUDS WITH STRONGLY VARYING DENSITY , 2016 .

[20]  Nicolo Dell'Unto,et al.  3D GIS for Cultural Heritage Restoration : a 'white box' workflow , 2016 .

[21]  Felipe Buill,et al.  Geometric Analysis on Stone Façades with Terrestrial Laser Scanner Technology , 2017 .

[22]  Fabio Remondino,et al.  A REVIEW OFPOINT CLOUDS SEGMENTATION AND CLASSIFICATION ALGORITHMS , 2017 .

[23]  Fabio Remondino,et al.  Management of Architectural Heritage Information in BIM and GIS: State-of-the-art and Future Perspectives , 2013 .

[24]  E. W. Adams,et al.  Archaeological Typology and Practical Reality: A Dialectical Approach to Artifact Classification and Sorting , 1991 .

[25]  Fabio Remondino,et al.  MODELING AND SEMANTIC CLASSIFICATION OF ARCHAEOLOGICAL FINDS FOR MANAGEMENT AND VISUALIZATION IN 3 D ARCHAEOLOGICAL DATABASES , 2008 .

[26]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[27]  David Lo Buglio,et al.  Geometry vs Semantics: Open Issues on 3D Reconstruction of Architectural Elements , 2014, 3D Research Challenges in Cultural Heritage.