GEOMETRIC FEATURES ANALYSIS FOR THE CLASSIFICATION OF CULTURAL HERITAGE POINT CLOUDS

Abstract. In the last years, the application of artificial intelligence (Machine Learning and Deep Learning methods) for the classification of 3D point clouds has become an important task in modern 3D documentation and modelling applications. The identification of proper geometric and radiometric features becomes fundamental to classify 2D/3D data correctly. While many studies have been conducted in the geospatial field, the cultural heritage sector is still partly unexplored. In this paper we analyse the efficacy of the geometric covariance features as a support for the classification of Cultural Heritage point clouds. To analyse the impact of the different features calculated on spherical neighbourhoods at various radius sizes, we present results obtained on four different heritage case studies using different features configurations.

[1]  Martin Weinmann,et al.  Book Review–Reconstruction and Analysis of 3D Scenes: From Irregularly Distributed 3D Points to Object Classes , 2016, Photogrammetric Engineering & Remote Sensing.

[2]  Fabio Remondino,et al.  A REVIEW OFPOINT CLOUDS SEGMENTATION AND CLASSIFICATION ALGORITHMS , 2017 .

[3]  Mohammed Bennamoun,et al.  A Comprehensive Performance Evaluation of 3D Local Feature Descriptors , 2015, International Journal of Computer Vision.

[4]  Fabio Remondino,et al.  3d Surveying and modelling of the Archaeological Area of Paestum, Italy , 2015 .

[5]  Boris Jutzi,et al.  SHAPE DISTRIBUTION FEATURES FOR POINT CLOUD ANALYSIS - A GEOMETRIC HISTOGRAM APPROACH ON MULTIPLE SCALES , 2014 .

[6]  Fabio Remondino,et al.  FROM 2D TO 3D SUPERVISED SEGMENTATION AND CLASSIFICATION FOR CULTURAL HERITAGE APPLICATIONS , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[7]  Sabine Vanhuysse,et al.  Less is more: optimizing classification performance through feature selection in a very-high-resolution remote sensing object-based urban application , 2018 .

[8]  Fabio Remondino,et al.  SEGMENTATION OF 3D PHOTOGRAMMETRIC POINT CLOUD FOR 3D BUILDING MODELING , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[9]  Fabrizio Ivan Apollonio,et al.  3D DOCUMENTATION OF 40 KILOMETERS OF HISTORICAL PORTICOES - THE CHALLENGE , 2016 .

[10]  S. J. Oude Elberink,et al.  Multiple-entity based classification of airborne laser scanning data in urban areas , 2014 .

[11]  Kewei Cheng,et al.  Feature Selection , 2016, ACM Comput. Surv..

[12]  Eliot Hearst.  Stimulus Relationships and Feature Selection in Learning and Behavior , 2018 .

[13]  Fabio Remondino,et al.  SEGMENTATION OF 3 D PHOTOGRAMMETRIC POINT CLOUD FOR 3 D BUILDING MODELING , 2018 .

[14]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..

[15]  J. Niemeyer,et al.  Contextual classification of lidar data and building object detection in urban areas , 2014 .

[16]  Martin Doerr,et al.  Ontologies for Cultural Heritage , 2009, Handbook on Ontologies.

[17]  Jun Wang,et al.  Map-Based Localization Method for Autonomous Vehicles Using 3D-LIDAR * , 2017 .

[18]  Uwe Soergel,et al.  Relevance assessment of full-waveform lidar data for urban area classification , 2011 .

[19]  Boris Jutzi,et al.  Semantic 3D scene interpretation: A framework combining optimal neighborhood size selection with relevant features , 2014 .

[20]  Fabio Remondino,et al.  Classification of 3D Digital Heritage , 2019, Remote. Sens..

[21]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[22]  Boris Jutzi,et al.  GEOMETRIC FEATURES AND THEIR RELEVANCE FOR 3D POINT CLOUD CLASSIFICATION , 2017 .

[23]  Marc Pollefeys,et al.  Semantic3D.net: A new Large-scale Point Cloud Classification Benchmark , 2017, ArXiv.

[24]  Gilles Halin,et al.  An ontological model for the reality-based 3D annotation of heritage building conservation state , 2017 .

[25]  C. Mallet,et al.  AIRBORNE LIDAR FEATURE SELECTION FOR URBAN CLASSIFICATION USING RANDOM FORESTS , 2009 .

[26]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .

[27]  Roland Billen,et al.  POINT CLOUD CLASSIFICATION OF TESSERAE FROM TERRESTRIAL LASER DATA COMBINED WITH DENSE IMAGE MATCHING FOR ARCHAEOLOGICAL INFORMATION EXTRACTION , 2017, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[28]  Boris Jutzi,et al.  Feature relevance assessment for the semantic interpretation of 3D point cloud data , 2013 .

[29]  Vladlen Koltun,et al.  Learning Compact Geometric Features , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).