Autonomous robotic system for tunnel structural inspection and assessment

This paper presents a robotic platform, capable of autonomous tunnel inspection, developed under ROBO-SPECT European union funded research project. The robotic vehicle consists of a robotized production boom lift, a high precision robotic arm, advanced computer vision systems, a 3D laser scanner and an ultrasonic sensor. The autonomous inspection of tunnels requires advanced capabilities of the robotic vehicle and the computer vision sub-system. The robot localization in underground spaces and on long linear paths is a challenging task, as well as the mm accurate positioning of a robotic tip installed on a five-ton crane vehicle. Moreover, the 2D and 3D vision tasks, which support the inspection process, should tackle with poor and variable lighting conditions, low textured lining surfaces and the need for high accuracy. This contribution describes the final robotic vehicle and the developments as designed for concrete lining tunnel inspection. Results from the validation and benchmarking of the system are also included following the final tests at the operating Egnatia Motorway tunnels in northern Greece.

[1]  Alberto Jardón,et al.  Past, present and future of robotic tunnel inspection , 2015 .

[2]  J M W Brownjohn,et al.  Structural health monitoring of civil infrastructure , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[3]  Dan M. Frangopol,et al.  Maintenance and management of civil infrastructure based on condition, safety, optimization, and life-cycle cost* , 2007 .

[4]  Florian Mittermayr,et al.  Thaumasite Formation from Sulphate Attack (TSA) – Case Study at Austrian Tunnel Sites , 2008 .

[5]  Nikolaos Doulamis,et al.  Deep Convolutional Neural Networks for efficient vision based tunnel inspection , 2015, 2015 IEEE International Conference on Intelligent Computer Communication and Processing (ICCP).

[6]  C. Stentoumis,et al.  On accurate dense stereo-matching using a local adaptive multi-cost approach , 2014 .

[7]  Eftychios Protopapadakis,et al.  Image Based Approaches for Tunnels' Defects Recognition via Robotic Inspectors , 2015, ISVC.

[8]  Nikos Komodakis,et al.  Robotic intelligent vision and control for tunnel inspection and evaluation - The ROBINSPECT EC project , 2014, 2014 IEEE International Symposium on Robotic and Sensors Environments (ROSE) Proceedings.

[9]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[10]  Derek C. Rose,et al.  Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[11]  P. Rudol,et al.  Human Body Detection and Geolocalization for UAV Search and Rescue Missions Using Color and Thermal Imagery , 2008, 2008 IEEE Aerospace Conference.

[12]  Da-Wen Sun,et al.  Improving quality inspection of food products by computer vision: a review , 2004 .

[13]  Henrik Schiøler,et al.  Sociable Robots Through Self-Maintained Energy , 2006 .

[14]  Angelos Amditis,et al.  Crack Identification Via User Feedback, Convolutional Neural Networks and Laser Scanners for Tunnel Infrastructures , 2016, VISIGRAPP.

[15]  Markus König,et al.  Achievements and Challenges in Machine Vision-Based Inspection of Large Concrete Structures , 2014 .

[16]  Christos Stentoumis,et al.  Census-Based Cost on Gradients for Matching under Illumination Differences , 2015, 2015 International Conference on 3D Vision.

[17]  H. Yamada,et al.  Development of an automatic concrete-tunnel inspection system by an autonomous mobile robot , 2000, Proceedings 9th IEEE International Workshop on Robot and Human Interactive Communication. IEEE RO-MAN 2000 (Cat. No.00TH8499).

[18]  Yoshihiko Hamamoto,et al.  A Method for Crack Detection on a Concrete Structure , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[19]  Chang-Soo Han,et al.  Auto inspection system using a mobile robot for detecting concrete cracks in a tunnel , 2007 .

[20]  Nikolaos Doulamis,et al.  A hybrid algorithm for dense stereo correspondences in challenging indoor scenes , 2016, 2016 IEEE International Conference on Imaging Systems and Techniques (IST).

[21]  Theodora A. Varvarigou,et al.  A Threefold Dataset for Activity and Workflow Recognition in Complex Industrial Environments , 2012, IEEE MultiMedia.

[22]  Sami F. Masri,et al.  Adaptive vision-based crack detection using 3D scene reconstruction for condition assessment of structures , 2012 .

[23]  Xiaogang Wang,et al.  Intelligent multi-camera video surveillance: A review , 2013, Pattern Recognit. Lett..

[24]  Gerhard Paar,et al.  Three-Dimensional Tunnel Reconstruction Using Photogrammetry and Laser Scanning , 2007 .

[25]  X. Zhang,et al.  Towards automated progress assessment of workpackage components in construction projects using computer vision , 2009, Adv. Eng. Informatics.

[26]  Daniele Inaudi,et al.  Intelligent sensory technology for health-monitoring-based maintenance of infrastructures , 2004, SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[27]  Nikolaos Doulamis,et al.  A HOLISTIC APPROACH FOR INSPECTION OF CIVIL INFRASTRUCTURES BASED ON COMPUTER VISION TECHNIQUES , 2016 .

[28]  Carlos Balaguer,et al.  Robot-aided tunnel inspection and maintenance system by vision and proximity sensor integration , 2011 .

[29]  Norbert J. Delatte,et al.  Beyond Failure: Forensic Case Studies for Civil Engineers , 2008 .

[30]  Giorgio Metta,et al.  YARP: Yet Another Robot Platform , 2006 .

[31]  Kenichi Soga,et al.  Innovation in Monitoring Technologies for Underground Structures , 2010 .

[32]  Dong Hyun Jeong,et al.  Real-time Image Scanning System for detecting tunnel cracks using linescan cameras , 2006 .

[33]  Ivan Hrdina,et al.  Underground Space – The 4th Dimension of Metropolises: Proceedings of the World Tunnel Congress 2007 and 33rd ITA/AITES Annual General Assembly, Prague, May 2007, 3 Volumes + CD-ROM , 2007 .

[34]  Cécile Huet,et al.  Autonomy for underwater robots—a European perspective , 2016, Auton. Robots.

[35]  Alison Moore,et al.  'A light at the end of the tunnel'. , 2015, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[36]  Myung Sagong,et al.  Feature extraction of a concrete tunnel liner from 3D laser scanning data , 2009 .