CONDITION ASSESSMENT OF RC BRIDGES. INTEGRATING MACHINE LEARNING, PHOTOGRAMMETRY AND BIM

Abstract. The survey of building pathologies is focused on reading the state of conservation of the building, composed by the survey of constructive and decorative details, the masonry layering, the crack pattern, the degradation and the color recognition. The drawing of these representations is a time-consuming task, accomplished by manual work by skilled operators who often rely on in-situ analysis and on pictures. In this project three-dimensional an automated method for the condition survey of reinforced concrete spalling has been developed. To realize the automated image-based survey it has been exploited the Mask R-CNN neural network. The training phase has been executed over the original model, providing new examples of images with concrete cover detachments. At the same time, a photogrammetry process involved the images, in order to obtain a point cloud which acts as a reference to a Scan to BIM process. The BIM environment serves as a collector of information, as it owns the ontology to recreate entities and relationships. The information as extracted by neural network and photogrammetry serve to create the pictures which depict the concrete spalling in the BIM environment. A process of projecting information from the images to the BIM recreates the shapes of the pathology on the objects of the model, which becomes a decision support system for the built environment. A case study of a concrete beam bridge in northern Italy demonstrates the validity of the process.

[1]  Tung-Ching Su Application of Computer Vision to Crack Detection of Concrete Structure , 2013 .

[2]  Ashutosh Bagchi,et al.  Image-based retrieval of concrete crack properties for bridge inspection , 2014 .

[3]  Ashutosh Bagchi,et al.  Development of a BIM-Based Data Management System for Structural Health Monitoring with Application to Modular Buildings: Case Study , 2019, J. Comput. Civ. Eng..

[4]  Pedro Arias,et al.  Structural analysis of Monforte de Lemos masonry arch bridge considering the influence of the geometry of the arches and fill material on the collapse load estimation , 2016 .

[5]  A. Pisello,et al.  Hierarchical environmental risk mapping of material degradation in historic masonry buildings: An integrated approach considering climate change and structural damage , 2019, Construction and Building Materials.

[6]  Luís F. Ramos,et al.  Heritage site preservation with combined radiometric and geometric analysis of TLS data , 2018 .

[7]  Fabio Fatiguso,et al.  Historic Building Information Modelling: performance assessment for diagnosis-aided information modelling and management , 2018 .

[8]  Maurice Murphy,et al.  Historic Building Information Modelling (HBIM) , 2019, Architecture and Design.

[9]  V. Cristini,et al.  Structural Studies, Repairs and Maintenance of Heritage Architecture XIV , 2016 .

[10]  S. Della Torre,et al.  HBIM LEVEL OF DETAIL-GEOMETRY-ACCURACY AND SURVEY ANALYSIS FOR ARCHITECTURAL PRESERVATION , 2019, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[11]  Eva Savina Malinverni,et al.  MODELLING IN HBIM TO DOCUMENT MATERIALS DECAY BY A THEMATIC MAPPING TO MANAGE THE CULTURAL HERITAGE: THE CASE OF “CHIESA DELLA PIETÀ” IN FERMO , 2019, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[12]  Sidney Nascimento Givigi,et al.  Automatic Crack Detection and Measurement Based on Image Analysis , 2016, IEEE Transactions on Instrumentation and Measurement.

[13]  Burcu Akinci,et al.  Deviation analysis method for the assessment of the quality of the as-is Building Information Models generated from point cloud data , 2013 .

[14]  Andrea Giordano,et al.  Integration Between Perspective Images and BIM Models: Projective Geometry Is Still Alive , 2018 .

[15]  Fabio Fatiguso,et al.  Advanced damage detection techniques in historical buildings using digital photogrammetry and 3D surface anlysis , 2019, Journal of Cultural Heritage.

[16]  P. Salonia,et al.  HISTORICAL BUILDINGS AND THEIR DECAY : DATA RECORDING , ANALYSING AND TRANSFERRING IN AN ITC ENVIRONMENT , 2003 .

[17]  Eduardo Júlio,et al.  Automatic crack monitoring using photogrammetry and image processing , 2013 .

[18]  Hanjin Hu,et al.  Building Information Modeling (BIM) for transportation infrastructure – Literature review, applications, challenges, and recommendations , 2018, Automation in Construction.

[19]  Diego González-Aguilera,et al.  The combination of geomatic approaches and operational modal analysis to improve calibration of finite element models: A case of study in Saint Torcato Church (Guimarães, Portugal) , 2014 .

[20]  Pedro Arias,et al.  Terrestrial laser scanning and limit analysis of masonry arch bridges , 2011 .

[21]  Norman HALLERMANN,et al.  Unmanned Aerial Systems ( UAS ) – Case Studies of Vision Based Monitoring of Ageing Structures , 2015 .

[22]  Kristin J. Dana,et al.  Automated Crack Detection on Concrete Bridges , 2016, IEEE Transactions on Automation Science and Engineering.

[23]  Enrico Quagliarini,et al.  Nondestructive Evaluation of Plasters on Historical Thin Vaults by Scanning Laser Doppler Vibrometers , 2014 .

[24]  Paolo Clini,et al.  Fast, low cost and safe methodology for the assessment of the state of conservation of historical buildings from 3D laser scanning: The case study of Santa Maria in Portonovo (Italy) , 2017 .

[25]  Elia Quirós,et al.  Semiautomatic detection and classification of materials in historic buildings with low-cost photogrammetric equipment , 2017 .

[26]  Carles Bosch,et al.  Towards Semi-Automatic Scaling Detection on Flat Stones , 2017, GCH.

[27]  Livio De Luca,et al.  Developing a toolkit for mapping and displaying stone alteration on a web-based documentation platform , 2014 .

[28]  Hoang-Nam Nguyen,et al.  An Automatic Approach for Accurate Edge Detection of Concrete Crack Utilizing 2D Geometric Features of Crack , 2014, J. Signal Process. Syst..

[29]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Mohammad R. Jahanshahi,et al.  An innovative methodology for detection and quantification of cracks through incorporation of depth perception , 2011, Machine Vision and Applications.

[31]  Guido Morgenthal,et al.  Vision-based Monitoring Of Heritage Monuments: Unmanned Aerial Systems (UAS) For Detailed Inspection And High-accuracy Survey Of Structures , 2015 .

[32]  K. Smarsly,et al.  Monitoring information modeling for semantic mapping of structural health monitoring systems , 2016 .