A Mobile Robot for Automated Civil Infrastructure Inspection and Evaluation

Ahstract- The objective of civil infrastructure inspection is to evaluate and periodically perform maintenance. This involves properly collecting data on structures, documenting the data, and analyzing the quantitative inspection data over an extended period of operating time, all in order to maintain the structures properly. Recent research on civil infrastructure inspection is mainly based on manual visual inspections, which are often influenced and limited by a professional inspector's knowledge and experience. Thus, the accuracy and reliability of their results are affected. These inspection processes require significant individual labor, which can become quite costly as the inspection areas often require traffic to be limited or evacuation of certain business parking areas while the inspections are performed. In this paper, we present a new development of the autonomous mobile robotic system for automated data collection and inspection. A 4 degree of freedom (DoF) arm is designed and developed then integrated with the robot for efficient image capture using both visual and thermal cameras. The robotic system performs crack detection on the collected data using a state-of-the-art method involving convolutional neural networks (CNN), which is validated on a variety of test images. As inspection results, the robot can output several condition maps of the inspected infrastructure including crack map, thermal map and deterioration map to provide the overall picture of the structure health condition. Our robotic system reduces the overall inspection time compared to the current robotic inspection methods. We further validate our data collection process through showing the correlation between the data collected by each sensor in the system.

[1]  Kristin J. Dana,et al.  Automated Crack Detection on Concrete Bridges , 2016, IEEE Transactions on Automation Science and Engineering.

[2]  Hung Manh La,et al.  A Genetic Algorithm for Convolutional Network Structure Optimization for Concrete Crack Detection , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[3]  Hung Manh La,et al.  Implementation of a Fully Autonomous Platform for Assessment of Concrete Bridge Decks RABIT , 2015 .

[4]  Weihua Sheng,et al.  A Robotic Crack Inspection and Mapping System for Bridge Deck Maintenance , 2014, IEEE Transactions on Automation Science and Engineering.

[5]  Calvin Coopmans,et al.  Challenges in bridge inspection using small unmanned aerial systems: Results and lessons learned , 2017, 2017 International Conference on Unmanned Aircraft Systems (ICUAS).

[6]  Hung Manh La,et al.  A multi-functional inspection robot for civil infrastructure evaluation and maintenance , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  S. Mohamed Mansoor Roomi,et al.  Fault localisation of electrical equipments using thermal imaging technique , 2016, 2016 International Conference on Emerging Technological Trends (ICETT).

[8]  Jingang Yi,et al.  Autonomous robotic system for bridge deck data collection and analysis , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Marc Maguire,et al.  Comparing Automated Image-Based Crack Detection Techniques in the Spatial and Frequency Domains , 2017 .

[10]  G. T. Shrivakshan,et al.  A Comparison of various Edge Detection Techniques used in Image Processing , 2012 .

[11]  Shuji Hashimoto,et al.  Improved percolation-based method for crack detection in concrete surface images , 2008, 2008 19th International Conference on Pattern Recognition.

[12]  Hung Manh La,et al.  Autonomous robotic system using non-destructive evaluation methods for bridge deck inspection , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Hung Manh La,et al.  Automated Rebar Detection for Ground-Penetrating Radar , 2016, ISVC.

[14]  Tran Hiep Dinh,et al.  Computer vision-based method for concrete crack detection , 2016, 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[15]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[16]  Jungwon Huh,et al.  Experimental Study on Detection of Deterioration in Concrete Using Infrared Thermography Technique , 2016 .

[17]  Hung Manh La,et al.  Visual and Acoustic Data Analysis for the Bridge Deck Inspection Robotic System , 2014 .

[18]  Weihua Sheng,et al.  Developing a crack inspection robot for bridge maintenance , 2011, 2011 IEEE International Conference on Robotics and Automation.

[19]  M. Salman,et al.  Image Based Detection and Inspection of Cracks on Bridge Surface Using an Autonomous Robot [Review] , 2015 .

[20]  Jinyoung Kim,et al.  Similarities and Differences in Condition Assessment of Concrete Bridge Decks by Visual Inspection and NDE , 2016 .

[21]  Kristin J. Dana,et al.  Development of an autonomous bridge deck inspection robotic system , 2017, J. Field Robotics.

[22]  Jingang Yi,et al.  Mechatronic Systems Design for an Autonomous Robotic System for High-Efficiency Bridge Deck Inspection and Evaluation , 2013, IEEE/ASME Transactions on Mechatronics.

[23]  Osama Moselhi,et al.  Concrete bridge deck condition assessment using IR Thermography and Ground Penetrating Radar technologies , 2017 .

[24]  Nenad Gucunski,et al.  Attenuation-based methodology for condition assessment of concrete bridge decks using GPR , 2015 .

[25]  Huy Pham,et al.  Nondestructive evaluation sensor fusion with autonomous robotic system for civil infrastructure inspection , 2018, J. Field Robotics.