A comprehensive virtual reality system for tunnel surface documentation and structural health monitoring

Infrastructures may develop defects over time and thus periodic monitoring is required to evaluate their health. Structural inspection of such constructions can sometimes be restricted due to short time windows in which humans can access the area as well as due to various hazardous conditions that may be present. This work advances the state of the art in structural inspection by contributing to the field of robotics, vision and inspection by proposing a comprehensive system to provide a better means of surface documentation and to aid structural health monitoring. A mobile robotic platform is equipped with one or more cameras to capture images of walls. Such images are then reconstructed into a 3D model that can be visualised through Virtual Reality (VR). The model can then be further analysed via subsequent image processing stages. Although the prime purpose of the system is for deployment in tunnels, it can be adapted to various other scenarios.

[1]  Simone Gilardoni,et al.  LHC Train Control System for Autonomous Inspections and Measurements , 2018 .

[2]  Jean-Philippe Pons,et al.  Seamless image-based texture atlases using multi-band blending , 2008, 2008 19th International Conference on Pattern Recognition.

[3]  Changchang Fu.  A New Research Approach on the Application of Virtual Reality Technology in Civil Engineering , 2015 .

[4]  Masato Ukai.  Advanced Inspection System of Tunnel Wall Deformation using Image Processing , 2007 .

[5]  Andrea Fusiello,et al.  Hierarchical structure-and-motion recovery from uncalibrated images , 2015, Comput. Vis. Image Underst..

[6]  Gerhard Paar,et al.  Tunnel Surface 3D Reconstruction from Unoriented Image Sequences , 2015, ArXiv.

[7]  Chang-Soo Han,et al.  Auto inspection system using a mobile robot for detecting concrete cracks in a tunnel , 2007 .

[8]  Björn Stenger,et al.  Visual change detection on tunnel linings , 2016, Machine Vision and Applications.

[9]  Tai-Tien Wang,et al.  Application and validation of simple image-mosaic technology for interpreting cracks on tunnel lining , 2013 .

[10]  Vladimir Kolmogorov,et al.  Convergent Tree-Reweighted Message Passing for Energy Minimization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  A. Masi,et al.  A DUAL ARM ROBOTIC PLATFORM CONTROL FOR NAVIGATION , INSPECTION AND TELEMANIPULATION , 2018 .

[12]  Brett Browning,et al.  Visual mapping for natural gas pipe inspection , 2015, Int. J. Robotics Res..

[13]  Carl J. Debono,et al.  Vision-based change detection for inspection of tunnel liners , 2018, Automation in Construction.

[14]  Angelos Amditis,et al.  AUTONOMOUS ROBOTIC INSPECTION IN TUNNELS , 2016 .

[15]  Alcínia Zita Sampaio,et al.  Monitoring Interior and Exterior Wall Inspections within a Virtual Environment , 2012 .

[16]  M. Mettenleiter,et al.  TERRESTRIAL LASER SCANNING – NEW PERSPECTIVES IN 3D SURVEYING , 2004 .

[17]  Michael M. Kazhdan,et al.  Poisson surface reconstruction , 2006, SGP '06.

[18]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[19]  Xue-Min Zhang,et al.  Panoramic Image Stitching for Arbitrarily Shaped Tunnel Lining Inspection , 2016, Comput. Aided Civ. Infrastructure Eng..

[20]  Mario Di Castro,et al.  An Advanced, Adaptive and Multimodal Graphical User Interface for Human-robot Teleoperation in Radioactive Scenarios , 2016, ICINCO.

[21]  Carl J. Debono,et al.  Tunnel inspection using photogrammetric techniques and image processing: A review , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[22]  Alberto Jardón,et al.  Past, present and future of robotic tunnel inspection , 2015 .

[23]  Andrew Zisserman,et al.  MLESAC: A New Robust Estimator with Application to Estimating Image Geometry , 2000, Comput. Vis. Image Underst..

[24]  Sarvpal Singh,et al.  Virtual reality: A brief survey , 2017, 2017 International Conference on Information Communication and Embedded Systems (ICICES).

[25]  Chang-Soo Han,et al.  Development of an inspection system for cracks in a concrete tunnel lining , 2007 .