Multi-classifier for reinforced concrete bridge defects

Abstract Classifying concrete defects during a bridge inspection remains a subjective and laborious task. The risk of getting a false result is approximately 50% if different inspectors assess the same concrete defect. This is significant in the light of an over-aging bridge stock, decreasing infrastructure maintenance budgets and catastrophic bridge collapses as happened in 2018 in Genoa, Italy. To support an automated inspection and an objective bridge defect classification, we propose a three-staged concrete defect classifier that can multi-classify potentially unhealthy bridge areas into their specific defect type in conformity with existing bridge inspection guidelines. Three separate deep neural pre-trained networks are fine-tuned based on a multi-source dataset consisting of self-collected image samples plus several Departments of Transportation inspection databases. We show that this approach can reliably classify multiple defect types with an average mean score of 85%. Our presented multi-classifier is a contribution towards developing a mostly or fully inspection schema for a more cost-effective and more objective bridge inspection.

[1]  Ruodan Lu,et al.  Detection of Structural Components in Point Clouds of Existing RC Bridges , 2018, Comput. Aided Civ. Infrastructure Eng..

[2]  Sami F. Masri,et al.  Adaptive vision-based crack detection using 3D scene reconstruction for condition assessment of structures , 2012 .

[3]  D. M. Hutton,et al.  The Cross‐Entropy Method: A Unified Approach to Combinatorial Optimisation, Monte‐Carlo Simulation and Machine Learning , 2005 .

[4]  Kristin J. Dana,et al.  Automated Crack Detection on Concrete Bridges , 2016, IEEE Transactions on Automation Science and Engineering.

[5]  Ming-Yu Liu,et al.  Deep Active Learning for Civil Infrastructure Defect Detection and Classification , 2017 .

[6]  Benjamin A. Graybeal,et al.  Routine Highway Bridge Inspection Condition Documentation Accuracy and Reliability , 2004 .

[7]  Feng Xie,et al.  Evaluating the effects of the I-35W bridge collapse on road-users in the twin cities metropolitan region , 2008 .

[8]  Shuji Hashimoto,et al.  Image‐Based Crack Detection for Real Concrete Surfaces , 2008 .

[9]  André Borrmann,et al.  Integrating RC Bridge Defect Information into BIM Models , 2018, J. Comput. Civ. Eng..

[10]  Zhao-Dong Xu,et al.  Damage Detection Strategy Using Strain-Mode Residual Trends for Long-Span Bridges , 2015, J. Comput. Civ. Eng..

[11]  Kristin J. Dana,et al.  Computer-vision based crack detection and analysis , 2012, Smart Structures.

[12]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[13]  Ioannis K. Brilakis,et al.  Detecting healthy concrete surfaces , 2018, Adv. Eng. Informatics.

[14]  Fan Xi,et al.  Detection crack in image using Otsu method and multiple filtering in image processing techniques , 2016 .

[15]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Reginald DesRoches,et al.  Rapid entropy-based detection and properties measurement of concrete spalling with machine vision for post-earthquake safety assessments , 2012, Adv. Eng. Informatics.

[17]  Ikhlas Abdel-Qader,et al.  ANALYSIS OF EDGE-DETECTION TECHNIQUES FOR CRACK IDENTIFICATION IN BRIDGES , 2003 .

[18]  Paul W. Fieguth,et al.  A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure , 2015, Adv. Eng. Informatics.

[19]  Shirley J. Dyke,et al.  Autonomous image localization for visual inspection of civil infrastructure , 2017 .

[20]  Sayan Dey,et al.  Crack detection in concrete surfaces using image processing, fuzzy logic, and neural networks , 2012, 2012 IEEE Fifth International Conference on Advanced Computational Intelligence (ICACI).

[21]  Burcin Becerik-Gerber,et al.  Unsupervised Approach for Autonomous Pavement-Defect Detection and Quantification Using an Inexpensive Depth Sensor , 2013, J. Comput. Civ. Eng..