Validation of terrestrial laser scanning and artificial intelligence for measuring deformations of cultural heritage structures

Abstract The paper discusses the issue of using artificial neural networks and point clouds for calculating displacements of cultural heritage structures. The model trained on laboratory dataset was able to determine displacements of the building facade, with the relative accuracy of 3% of the simulated values. The success rate of this model was equal to 85%. The deformations that were derived from digital surface models generated from point clouds, had the relative accuracy of 7% and the values determined by image based close-range photogrammetry methods - 35%. A major novelty is the use of neural networks to determine deformations based on sub-models generated from the point cloud and the unique, supervised-trained, high accuracy predictive model. Practical significance is associated with creating an end-to-end solution that performs detection and estimates the value of the deformation automatically which is a major advantage over other methods.

[1]  Robert J. Renka,et al.  Multivariate interpolation of large sets of scattered data , 1988, TOMS.

[2]  Ran Tao,et al.  Accurate 3D Shape, Displacement and Deformation Measurement Using a Smartphone , 2019, Sensors.

[3]  Majid Ahmadi,et al.  Interpolation Of Stereo Data With Shepard's Surfaces , 1988, Other Conferences.

[4]  Cettina Santagati,et al.  IMAGE-BASED MODELING TECHNIQUES FOR ARCHITECTURAL HERITAGE 3D DIGITALIZATION: LIMITS AND POTENTIALITIES , 2013 .

[5]  Luís F. Ramos,et al.  Heritage site preservation with combined radiometric and geometric analysis of TLS data , 2018 .

[6]  Kenneth R. White,et al.  Close-range photogrammetry applications in bridge measurement: Literature review , 2008 .

[7]  Raúl Rojas,et al.  Neural Networks - A Systematic Introduction , 1996 .

[8]  Wolfgang Boehler,et al.  Investigating Laser Scanner Accuracy , 2005 .

[9]  Vitoantonio Bevilacqua,et al.  An Evolutionary Optimization Method for Parameter Search in 3D Points Cloud Reconstruction , 2013, ICIC.

[10]  B. Riveiro,et al.  A case study of measurements of deformations due to different loads in pieces less than 1 m from lidar data , 2020 .

[11]  Alexander Bucksch,et al.  Error budget of terrestrial laser scanning: inuence of the incidence angle on the scan quality , 2007 .

[12]  Emin Salur,et al.  Experimental study and analysis of machinability characteristics of metal matrix composites during drilling , 2019, Composites Part B: Engineering.

[13]  Derek D. Lichti,et al.  Error modelling, calibration and analysis of an AM–CW terrestrial laser scanner system , 2007 .

[14]  Robert M. Pap,et al.  Handbook of neural computing applications , 1990 .

[15]  Pelagia Gawronek,et al.  Measurements of the Vertical Displacements of a Railway Bridge Using TLS Technology in the Context of the Upgrade of the Polish Railway Transport , 2019, Sensors.

[16]  D. Lichti,et al.  Angular resolution of terrestrial laser scanners , 2006 .

[17]  Ingo Neumann,et al.  Concrete Crack Measurement and Analysis Based on Terrestrial Laser Scanning Technology , 2015 .

[18]  Jingwei Zhang,et al.  Algorithm 905 , 2010 .

[19]  T. Kersten,et al.  COMPARATIVE INVESTIGATIONS INTO THE ACCURACY BEHAVIOUR OF THE NEW GENERATION OF TERRESTRIAL LASER SCANNING SYSTEMS , 2007 .

[20]  Derek D. Lichti,et al.  Modeling Terrestrial Laser Scanner Data for Precise Structural Deformation Measurement , 2007 .

[21]  Fernando Santos Osório,et al.  Artificial Neural Nets Object Recognition for 3D Point Clouds , 2013, 2013 Brazilian Conference on Intelligent Systems.

[22]  Richard Franke,et al.  Smooth interpolation of large sets of scattered data , 1980 .

[23]  Luigi Fregonese,et al.  COMPARISON BETWEEN LASER SCANNING AND AUTOMATED 3D MODELLING TECHNIQUES TO RECONSTRUCT COMPLEX AND EXTENSIVE CULTURAL HERITAGE AREAS , 2013 .

[24]  A. V. Olgac,et al.  Performance Analysis of Various Activation Functions in Generalized MLP Architectures of Neural Networks , 2011 .

[25]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[26]  Sebastian Scherer,et al.  VoxNet: A 3D Convolutional Neural Network for real-time object recognition , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Roderik Lindenbergh,et al.  A statistical deformation analysis of two epochs of terrestrial laser data of a lock , 2005 .

[28]  Andreas Wieser,et al.  LEARNED COMPACT LOCAL FEATURE DESCRIPTOR FOR TLS-BASED GEODETIC MONITORING OF NATURAL OUTDOOR SCENES , 2018, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[29]  Mitra Mirhassani,et al.  Efficient VLSI Implementation of Neural Networks With Hyperbolic Tangent Activation Function , 2014, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[30]  T. Luhmann,et al.  Measurement of Rotor Blade Deformations of Wind Energy Converters with Laser Scanners , 2013 .

[31]  Shunyi Zheng,et al.  A novel measurement method based on silhouette for chimney quasi-static deformation monitoring , 2012 .

[32]  Martin Pfennigbauer,et al.  Improving quality of laser scanning data acquisition through calibrated amplitude and pulse deviation measurement , 2010, Defense + Commercial Sensing.

[33]  A. Akar EVALUATION OF ACCURACY OF DEMS OBTAINED FROM UAV-POINT CLOUDS FOR DIFFERENT TOPOGRAPHICAL AREAS , 2017 .

[34]  M. Crosetto,et al.  Deformation measurement using terrestrial laser scanning data and least squares 3D surface matching , 2008 .

[35]  Mohammad Omidalizarandi,et al.  Terrestrial laser scanning technology for deformation monitoring and surface modeling of arch structures , 2017 .

[36]  Lei Zhang,et al.  Three-Dimensional Laser Scanning for the Bridge Deformation of Shanghai Maglev Train , 2018, CSPS.

[37]  V. Anagnostopoulos,et al.  Change Detection in Terrestrial Laser Scanner Data Via Point Cloud Correspondence , 2015 .

[38]  Jin Wang,et al.  Geodetic and Remote-Sensing Sensors for Dam Deformation Monitoring , 2018, Sensors.

[39]  Sang-Kyu Jung,et al.  Visual gene developer: a fully programmable bioinformatics software for synthetic gene optimization , 2011, BMC Bioinformatics.

[40]  Yuriy Reshetyuk,et al.  CALIBRATION OF TERRESTRIAL LASER SCANNERS CALLIDUS 1.1, LEICA HDS 3000 AND LEICA HDS 2500 , 2006 .

[41]  Norbert Pfeifer,et al.  DEFORMATION ANALYSIS OF A BORED TUNNEL BY MEANS OF TERRESTRIAL LASER SCANNING , 2006 .

[42]  H. Sağlam,et al.  Investigation of progressive tool wear for determining of optimized machining parameters in turning , 2019, Measurement.

[43]  Henrique Lorenzo,et al.  Monitoring and Assessing Structural Damage in Historic Buildings , 2008 .

[44]  Derek D. Lichti,et al.  STRUCTURAL DEFORMATION MEASUREMENT USING TERRESTRIAL LASER SCANNERS , 2003 .

[45]  Jing Huang,et al.  Point cloud labeling using 3D Convolutional Neural Network , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[46]  Simon Laflamme,et al.  Adaptive wavelet neural network for terrestrial laser scanner-based crack detection , 2018, Automation in Construction.

[47]  Luca Maria Gambardella,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence Flexible, High Performance Convolutional Neural Networks for Image Classification , 2022 .

[48]  Philip D. Wasserman,et al.  Advanced methods in neural computing , 1993, VNR computer library.

[49]  Andreas Wieser,et al.  The Perfect Match: 3D Point Cloud Matching With Smoothed Densities , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Xiaoming Huang,et al.  Developing an Optical Image-Based Method for Bridge Deformation Measurement Considering Camera Motion , 2018, Sensors.

[51]  Michel Jaboyedoff,et al.  Detection of millimetric deformation using a terrestrial laser scanner: experiment and application to a rockfall event , 2009 .

[52]  Facundo José López,et al.  A Framework for Using Point Cloud Data of Heritage Buildings Toward Geometry Modeling in A BIM Context: A Case Study on Santa Maria La Real De Mave Church , 2017 .

[53]  M. Barbarella,et al.  Monitoring of large landslides by Terrestrial Laser Scanning techniques: field data collection and processing , 2013 .

[54]  Derek D. Lichti,et al.  Ground-based Laser Scanners: Operation, systems and Applications , 2002 .

[55]  Li Qi,et al.  Fine Deformation Monitoring of Ancient Building Based on Terrestrial Laser Scanning Technologies , 2014 .

[56]  M. Scaioni,et al.  STRUCTURAL MONITORING OF A LARGE DAM BY TERRESTRIAL LASER SCANNING , 2006 .

[57]  H. Kuhlmann,et al.  Overview on Current Modelling Strategies of Point Clouds for Deformation Analysis Überblick aktueller Methoden zur Modellierung von Punktwolken für die Deformationsanalyse , 2016 .

[58]  Miklós Hoffmann Numerical control of kohonen neural network for scattered data approximation , 2004, Numerical Algorithms.