Challenges of bridge maintenance inspection

Bridges are amongst the largest, most expensive and complex structures, which makes them crucial and valuable transportation asset for modern infrastructure. Bridge inspection is a crucial component of monitoring and maintaining these complex structures. It provides a safety assessment and condition documentation on a regular basis, noting maintenance actions needed to counteract defects like cracks, corrosion and spalling. This paper presents the challenges with existing bridge maintenance inspection as well as an overview on proposed methods to overcome these challenges by automating inspection using computer vision methods. As a conclusion, existing methods for automated bridge inspection are able to detect one class of damage type based on images. A multiclass approach that also considers the 3D geometry, as inspectors do, is missing.

[1]  Marco Attene,et al.  A Framework for Mesh Segmentation and Annotation using Ontologies , 2015, EGC.

[2]  Ioannis Brilakis,et al.  Machine Vision-Based Concrete Surface Quality Assessment , 2010 .

[3]  Reginald DesRoches,et al.  Rapid entropy-based detection and properties measurement of concrete spalling with machine vision for post-earthquake safety assessments , 2012, Adv. Eng. Informatics.

[4]  Nico Blodow,et al.  Close-range scene segmentation and reconstruction of 3D point cloud maps for mobile manipulation in domestic environments , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Changmin Kim,et al.  Rapid and automated determination of rusted surface areas of a steel bridge for robotic maintenance systems , 2014 .

[6]  Campbell R. Middleton,et al.  Reliability of visual inspection of highway bridges , 2002 .

[7]  Sheryl Staub-French,et al.  Querying a building information model for construction-specific spatial information , 2012, Adv. Eng. Informatics.

[8]  Heng-Da Cheng,et al.  Real-Time Image Thresholding Based on Sample Space Reduction and Interpolation Approach , 2003 .

[9]  Jeong Ho Lee,et al.  Robotic System for Searching Cracks beneath Bridge , 2008 .

[10]  Benjamin A. Graybeal,et al.  Routine Highway Bridge Inspection Condition Documentation Accuracy and Reliability , 2004 .

[11]  Burcu Guldur,et al.  Laser-based structural sensing and surface damage detection , 2014 .

[12]  Ashutosh Bagchi,et al.  Automated prediction of condition state rating in bridge inspection , 2012 .

[13]  André Borrmann,et al.  Processing of Topological BIM Queries using Boundary Representation Based Methods , 2014, Adv. Eng. Informatics.

[14]  Jeong Ho Lee,et al.  Bridge inspection robot system with machine vision , 2009 .

[15]  Shen-En Chen,et al.  Laser Scanning Technology for Bridge Monitoring , 2012 .

[16]  Rui Pedro Lopes Fernandes,et al.  Advantages and disadvantages of bim platforms on construction site , 2013 .

[17]  Luh-Maan Chang,et al.  Support-vector-machine-based method for automated steel bridge rust assessment , 2012 .

[18]  S McRobbie,et al.  Visualisation and Display of Automated Bridge Inspection Results , 2010 .

[19]  George Vosselman,et al.  Segmentation of point clouds using smoothness constraints , 2006 .

[20]  Frank Schultmann,et al.  Building Information Modeling (BIM) for existing buildings — Literature review and future needs , 2014 .

[21]  Philippe Veron,et al.  FROM POINT CLOUD TO BIM: A SURVEY OF EXISTING APPROACHES , 2013 .

[22]  Burcu Akinci,et al.  Automatic Creation of Semantically Rich 3D Building Models from Laser Scanner Data , 2011 .

[23]  Thorsten Joachims,et al.  Semantic Labeling of 3D Point Clouds for Indoor Scenes , 2011, NIPS.

[24]  Benjamin A. Graybeal,et al.  RELIABILITY OF VISUAL INSPECTION FOR HIGHWAY BRIDGES, VOLUME I: FINAL REPORT , 2001 .

[25]  Amr A. Oloufa,et al.  Algorithms for automated deduction of topological information , 2005 .

[26]  Brian Okorn,et al.  Toward Automated Modeling of Floor Plans , 2010 .

[27]  T. Rabbani,et al.  SEGMENTATION OF POINT CLOUDS USING SMOOTHNESS CONSTRAINT , 2006 .

[28]  Yun Liu,et al.  Automatic Crack Detection and Classification Method for Subway Tunnel Safety Monitoring , 2014, Sensors.

[29]  Sang-Hyeok Gang,et al.  Report Card for America's Infrastructure , 2012 .

[30]  Chao Wang,et al.  Automatic BIM component extraction from point clouds of existing buildings for sustainability applications , 2015 .

[31]  Markus König,et al.  Achievements and Challenges in Machine Vision-Based Inspection of Large Concrete Structures , 2014 .

[32]  Paul Newman,et al.  Fast Probabilistic Labeling of City Maps , 2008, Robotics: Science and Systems.

[33]  Changwan Kim,et al.  Fully Automated Registration of 3D CAD Model with Point Cloud from Construction Site , 2011 .

[34]  Chi En Yang,et al.  A Lightweight Imaged Based Bridge Inspection System Using Fishing Pole, Fishing Line and Fisheye Camera , 2011 .

[35]  S G McRobbie,et al.  Automated inspection of highway structures 2008/09 , 2009 .

[36]  Alessio Arena,et al.  A new computational approach to cracks quantification from 2D image analysis: Application to micro-cracks description in rocks , 2014, Comput. Geosci..

[37]  Burcu Akinci,et al.  Automatic Creation of Semantically Rich 3D Building Models from Laser Scanner Data , 2013 .

[38]  Reginald DesRoches,et al.  Automated Damage Index Estimation of Reinforced Concrete Columns for Post-Earthquake Evaluations , 2015 .

[39]  Jong Min Lee,et al.  Machine Vision System for Automatic Inspection of Bridges , 2008, 2008 Congress on Image and Signal Processing.

[40]  Zhenhua Zhu,et al.  Spatial and visual data fusion for capturing, retrieval, and modeling of as-built building geometry and features , 2013 .

[41]  Gang Li,et al.  Long-distance precision inspection method for bridge cracks with image processing , 2014 .

[42]  Zhenhua Zhu,et al.  Detecting air pockets for architectural concrete quality assessment using visual sensing , 2008, J. Inf. Technol. Constr..

[43]  George Vosselman,et al.  Knowledge based reconstruction of building models from terrestrial laser scanning data , 2009 .

[44]  William R Cox,et al.  Bridge Evaluation Quality Assurance in Europe , 2008 .

[45]  Sherif Yehia,et al.  PCA-Based algorithm for unsupervised bridge crack detection , 2006, Adv. Eng. Softw..

[46]  Ikhlas Abdel-Qader,et al.  ANALYSIS OF EDGE-DETECTION TECHNIQUES FOR CRACK IDENTIFICATION IN BRIDGES , 2003 .

[47]  Chang-Soo Han,et al.  Auto inspection system using a mobile robot for detecting concrete cracks in a tunnel , 2007 .

[48]  Reginald DesRoches,et al.  Machine Vision-Enhanced Postearthquake Inspection , 2011, J. Comput. Civ. Eng..

[49]  Rafael Sacks,et al.  A FRAMEWORK FOR SEMANTIC ENRICHMENT OF IFC BUILDING MODELS , 2013 .

[50]  Burcu Akinci,et al.  Laser Scanning for Bridge Inspection and Management , 2007 .

[51]  C. Anumba.  DETECTING AIR POCKETS FOR ARCHITECTURAL CONCRETE QUALITY ASSESSMENT USING VISUAL SENSING , 2007 .

[52]  Patricio A. Vela,et al.  Automatic Generation of As-Built Geometric Civil Infrastructure Models from Point Cloud Data , 2014 .

[53]  Carl T. Haas,et al.  State of research in automatic as-built modelling , 2015, Adv. Eng. Informatics.

[54]  Ashutosh Bagchi,et al.  A Study of Image-Based Element Condition Index for Bridge Inspection , 2013 .

[55]  Ashutosh Bagchi,et al.  Image-based retrieval of concrete crack properties for bridge inspection , 2014 .

[56]  Bryan T. Adey,et al.  Overview of existing Bridge Management Systems , 2010 .

[57]  Manolis I. A. Lourakis,et al.  Toward automated generation of parametric BIMs based on hybrid video and laser scanning data , 2010, Adv. Eng. Informatics.

[58]  Koji Mitani,et al.  Bridge Assessment Methods Using Image Processing and Infrared Thermography Technology: On-Site Pilot Application in Florida , 2013 .

[59]  A Abe,et al.  Development of a hybrid camera system for bridge inspection , 2012 .