Quality Evaluation of Digital Twins Generated Based on UAV Photogrammetry and TLS: Bridge Case Study

In the current modern era of information and technology, emerging remote advancements have been widely established for detailed virtual inspections and assessments of infrastructure assets, especially bridges. These technologies are capable of creating an accurate digital representation of the existing assets, commonly known as the digital twins. Digital twins are suitable alternatives to in-person and on-site based assessments that can provide safer, cheaper, more reliable, and less distributive bridge inspections. In the case of bridge monitoring, Unmanned Aerial Vehicle (UAV) photogrammetry and Terrestrial Laser Scanning (TLS) are among the most common advanced technologies that hold the potential to provide qualitative digital models; however, the research is still lacking a reliable methodology to evaluate the generated point clouds in terms of quality and geometric accuracy for a bridge size case study. Therefore, this paper aims to provide a comprehensive methodology along with a thorough bridge case study to evaluate two digital point clouds developed from an existing Australian heritage bridge via both UAV-based photogrammetry and TLS. In this regard, a range of proposed approaches were employed to compare point clouds in terms of points’ distribution, level of outlier noise, data completeness, surface deviation, and geometric accuracy. The comparative results of this case study not only proved the capability and applicability of the proposed methodology and approaches in evaluating these two voluminous point clouds, but they also exhibited a higher level of point density and more acceptable agreements with as-is measurements in TLS-based point clouds subjected to the implementation of a precise data capture and a 3D reconstruction model.

[1]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Paul A. Fuchs,et al.  APPLICATIONS OF LASER-BASED INSTRUMENTATION FOR HIGHWAY BRIDGES , 2004 .

[3]  T. Rabbani,et al.  Automatic reconstruction of industrial installations using point clouds and images , 2006 .

[4]  Burcu Akinci,et al.  Laser Scanning for Bridge Inspection and Management , 2007 .

[5]  U. Ascher,et al.  Consolidation of unorganized point clouds for surface reconstruction , 2009, ACM Trans. Graph..

[6]  Ingo Heinrich,et al.  3D-laser scanning: a new method to analyze coarse tree root systems , 2009 .

[7]  Gaurav S. Sukhatme,et al.  Multi-image stitching and scene reconstruction for evaluating defect evolution in structures , 2011 .

[8]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[9]  Thomas P. Kersten,et al.  Low-Cost and Open-Source Solutions for Automated Image Orientation - A Critical Overview , 2012, EuroMed.

[10]  Burcu Akinci,et al.  Automatic execution of workflows on laser-scanned data for extracting bridge surveying goals , 2012, Adv. Eng. Informatics.

[11]  Yasuhiro Koda,et al.  Quantitative scaling evaluation of concrete structures based on terrestrial laser scanning , 2013 .

[12]  Khalid S. Essa,et al.  New fast least-squares algorithm for estimating the best-fitting parameters due to simple geometric-structures from gravity anomalies , 2013, Journal of advanced research.

[13]  George Pavlidis,et al.  Multi-image 3D reconstruction data evaluation , 2014 .

[14]  Joaquín Martínez-Sánchez,et al.  Successful Applications of Geotechnologies for the Evaluation of Road Infrastructures , 2014, Remote. Sens..

[15]  Bastian Goldlücke,et al.  Variational Analysis , 2014, Computer Vision, A Reference Guide.

[16]  Yutao Wang Outlier formation and removal in 3D laser scanned point clouds , 2014 .

[17]  Andrus Aavik,et al.  Geodetic Monitoring of Bridge Deformations Occurring During Static Load Testing , 2015 .

[18]  Susana M. Vieira,et al.  Noise Versus Outliers , 2016 .

[19]  Pedro Arias,et al.  Exploitation of Geometric Data provided by Laser Scanning to Create FEM Structural Models of Bridges , 2016 .

[20]  Debra F. Laefer,et al.  Toward automatic generation of 3D steel structures for building information modelling , 2017 .

[21]  Ali Hosseininaveh Ahmadabadian,et al.  Clustering and selecting vantage images in a low-cost system for 3D reconstruction of texture-less objects , 2017 .

[22]  Xiaoming Huang,et al.  Developing an Optical Image-Based Method for Bridge Deformation Measurement Considering Camera Motion , 2018, Sensors.

[23]  Junwon Seo,et al.  Drone-enabled bridge inspection methodology and application , 2018, Automation in Construction.

[24]  B. Samali,et al.  Decision Support Systems , 2018, Management of Information Systems.

[25]  Marc Maguire,et al.  Bridge inspection: human performance, unmanned aerial systems and automation , 2018, Journal of Civil Structural Health Monitoring.

[26]  Nora Gyetvai,et al.  Laser Scanning-Based Diagnostics in the Structural Assessment of Historic Wrought Iron Bridges , 2018 .

[27]  Masood Varshosaz,et al.  The performance evaluation of multi-image 3D reconstruction software with different sensors , 2018 .

[28]  Zulkepli Majid,et al.  COMPARING THE PERFORMANCE OF POINT CLOUD REGISTRATION METHODS FOR LANDSLIDE MONITORING USING MOBILE LASER SCANNING DATA , 2018, ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[29]  Linh Truong-Hong,et al.  Laser scan-based structural assessment of wrought iron bridges: Guinness Bridge, Ireland , 2018 .

[30]  Jakub Szulwic,et al.  Deformation Analysis of a Composite Bridge during Proof Loading Using Point Cloud Processing , 2018, Sensors.

[31]  Robert J. Thomas,et al.  Fatigue Crack Detection Using Unmanned Aerial Systems in Fracture Critical Inspection of Steel Bridges , 2018, Journal of Bridge Engineering.

[32]  Gian Michele Calvi,et al.  Once upon a Time in Italy: The Tale of the Morandi Bridge , 2018, Structural Engineering International.

[33]  Peng Jiang,et al.  Vertical Deformation Monitoring of the Suspension Bridge Tower Using GNSS: A Case Study of the Forth Road Bridge in the UK , 2018, Remote. Sens..

[34]  Calvin Coopmans,et al.  A Practitioner’s Guide to Small Unmanned Aerial Systems for Bridge Inspection , 2019, Infrastructures.

[35]  Siyuan Chen,et al.  UAV Bridge Inspection through Evaluated 3D Reconstructions , 2019, Journal of Bridge Engineering.

[36]  Airong Chen,et al.  Three-Dimensional Reconstruction of Structural Surface Model of Heritage Bridges Using UAV-Based Photogrammetric Point Clouds , 2019, Remote. Sens..

[37]  S. Kubota,et al.  Construction and Usage of Three-dimensional Data for Road Structures Using Terrestrial Laser Scanning and UAV with Photogrammetry , 2019, Proceedings of the 36th International Symposium on Automation and Robotics in Construction (ISARC).

[38]  L. Truong-Hong,et al.  Laser scanning for bridge inspection , 2019, Laser Scanning.

[39]  Pelagia Gawronek,et al.  TLS Measurement during Static Load Testing of a Railway Bridge , 2019, ISPRS Int. J. Geo Inf..

[40]  M. Rashidi,et al.  Experimental and Numerical Investigation of Innovative Composite Buckling-Restrained Fuse , 2019, Lecture Notes in Civil Engineering.

[41]  Ali Karami,et al.  An automatic 3D reconstruction system for texture-less objects , 2019, Robotics Auton. Syst..

[42]  Soon-Wook Kwon,et al.  Comparison and utilization of point cloud generated from photogrammetry and laser scanning: 3D world model for smart heavy equipment planning , 2019, Automation in Construction.

[43]  Bijan Samali,et al.  A comprehensive taxonomy for structure and material deficiencies, preventions and remedies of timber bridges , 2020 .

[44]  B. Samali,et al.  Health Monitoring of Bridges Using RPAs , 2020, Lecture Notes in Civil Engineering.

[45]  Changwan Kim,et al.  Deep-Learning-Based Classification of Point Clouds for Bridge Inspection , 2020, Remote. Sens..

[46]  Mohammad Mahdi Javidana,et al.  Steel hysteretic column dampers for seismic retrofit of soft-first-story structures , 2020 .

[47]  Carl T. Haas,et al.  Geometric Accuracy of Digital Twins for Structural Health Monitoring , 2020 .

[48]  Linh Truong-Hong,et al.  A Decade of Modern Bridge Monitoring Using Terrestrial Laser Scanning: Review and Future Directions , 2020, Remote. Sens..

[49]  Hiroshi Yamaguchi,et al.  Noise-robust transparent visualization of large-scale point clouds acquired by laser scanning , 2020 .

[50]  J. Kwiatkowski,et al.  Comparison of Non-Destructive Techniques for Technological Bridge Deflection Testing , 2020, Materials.

[51]  A. Karami,et al.  INVESTIGATING 3D RECONSTRUCTION OF NON-COLLABORATIVE SURFACES THROUGH PHOTOGRAMMETRY AND PHOTOMETRIC STEREO , 2021 .

[52]  Masood Varshosaz,et al.  Using Information Content to Select Keypoints for UAV Image Matching , 2021, Remote. Sens..

[53]  Saleh Abu Dabous,et al.  UAV-Based Remote Sensing Applications for Bridge Condition Assessment , 2021, Remote. Sens..

[54]  Jinkook Kim,et al.  Fuzzy‐based method for efficient seismic performance evaluation of structures with uncertainty , 2021, Comput. Aided Civ. Infrastructure Eng..

[55]  M. Kafi,et al.  Study of effects of beam-column connection and column rigidity on the performance of SPSW system , 2021 .

[56]  B. Samali,et al.  Comprehensive Study of Moving Load Identification on Bridge Structures Using the Explicit Form of Newmark-β Method: Numerical and Experimental Studies , 2021, Remote. Sens..

[57]  Srinath Perera,et al.  Digital twin application in the construction industry: A literature review , 2021 .

[58]  Masoud Mohammadi,et al.  Numerical and analytical study of ultimate capacity of steel plate shear walls with partial plate-column connection (SPSW-PC) , 2021 .