Vision-Based Tunnel Lining Health Monitoring via Bi-Temporal Image Comparison and Decision-Level Fusion of Change Maps

Tunnel structural health inspections are predominantly done through periodic visual observations, requiring humans to be physically present on-site, possibly exposing them to hazardous environments. These surveys are subjective (relying on the surveyor experience), time-consuming, and may demand operation shutdown. These issues can be mitigated through accurate automatic monitoring and inspection systems. In this work, we propose a remotely operated machine vision change detection application to improve the structural health monitoring of tunnels. The vision-based sensing system acquires the data from a rig of cameras hosted on a robotic platform that is driven parallel to the tunnel walls. These data are then pre-processed using image processing and deep learning techniques to reduce nuisance changes caused by light variations. Image fusion techniques are then applied to identify the changes occurring in the tunnel structure. Different pixel-based change detection approaches are used to generate temporal change maps. Decision-level fusion methods are then used to combine these change maps to obtain a more reliable detection of the changes that occur between surveys. A quantitative analysis of the results achieved shows that the proposed change detection system achieved a recall value of 81%, a precision value of 93% and an F1-score of 86.7%.

[1]  Alberto Jardón,et al.  Past, present and future of robotic tunnel inspection , 2015 .

[2]  Francesca Bovolo,et al.  The Time Variable in Data Fusion: A Change Detection Perspective , 2015, IEEE Geoscience and Remote Sensing Magazine.

[3]  Carl J. Debono,et al.  Vision-based change detection for inspection of tunnel liners , 2018, Automation in Construction.

[4]  Fabio Crosilla,et al.  Procrustes Analysis and Geodetic Sciences , 2003 .

[5]  Kristie B. Hadden,et al.  2020 , 2020, Journal of Surgical Orthopaedic Advances.

[6]  Li Yan,et al.  A Multi-View Dense Image Matching Method for High-Resolution Aerial Imagery Based on a Graph Network , 2016, Remote. Sens..

[7]  D. Lu,et al.  Change detection techniques , 2004 .

[8]  Carl James Debono,et al.  Specular Highlights Detection Using a U-Net Based Deep Learning Architecture , 2020, 2020 Fourth International Conference on Multimedia Computing, Networking and Applications (MCNA).

[9]  Jing Qin,et al.  Improved Wavelet Threshold for Image De-noising , 2019, Front. Neurosci..

[10]  Carlos Balaguer,et al.  Towards Fully Automated Tunnel Inspection: A Survey and Future Trends , 2014 .

[11]  Yan Liu,et al.  A Multi-view Super-Resolution Method with Joint-optimization of Image Fusion and Blind Deblurring , 2018, KSII Trans. Internet Inf. Syst..

[12]  Chih-Yang Lin,et al.  An improved method for image thresholding based on the valley-emphasis method , 2013, 2013 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference.

[13]  Lars Kai Hansen,et al.  Multimodal Data Fusion [Scanning the Issue] , 2015, Proc. IEEE.

[14]  Huayu Li,et al.  Change Detection Method of High Resolution Remote Sensing Image Based on D-S Evidence Theory Feature Fusion , 2021, IEEE Access.

[15]  Cem Unsalan,et al.  Pixel-Based Change Detection Methods , 2012 .

[16]  J. Jan Medical Image Processing, Reconstruction and Restoration: Concepts and Methods , 2005 .

[17]  Bin Liu,et al.  Algorithm Design for Edge Detection of High-Speed Moving Target Image under Noisy Environment , 2019, Sensors.

[18]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[19]  A. Masi,et al.  A DUAL ARM ROBOTIC PLATFORM CONTROL FOR NAVIGATION , INSPECTION AND TELEMANIPULATION , 2018 .

[20]  C. J. Debono,et al.  Image mosaicing of tunnel wall images using high level features , 2017, Proceedings of the 10th International Symposium on Image and Signal Processing and Analysis.

[21]  Christian Jutten,et al.  Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects , 2015, Proceedings of the IEEE.

[22]  Björn Stenger,et al.  An Image-Based System for Change Detection on Tunnel Linings , 2013, MVA.

[23]  EHSAN AZIMIRAD,et al.  A COMPREHENSIVE REVIEW OF THE MULTI-SENSOR DATA FUSION ARCHITECTURES , 2015 .

[24]  Björn Stenger,et al.  Detecting Change for Multi-View, Long-Term Surface Inspection , 2015, BMVC.

[25]  Hao Yang,et al.  Vision Measurement of Tunnel Structures with Robust Modelling and Deep Learning Algorithms , 2020, Sensors.

[26]  Ho-Jin Choi,et al.  A four-frames differencing technique for moving objects detection in wide area surveillance , 2017, 2017 IEEE International Conference on Big Data and Smart Computing (BigComp).

[27]  A. Agapiou Multi-Temporal Change Detection Analysis of Vertical Sprawl over Limassol City Centre and Amathus Archaeological Site in Cyprus during 2015–2020 Using the Sentinel-1 Sensor and the Google Earth Engine Platform , 2021, Sensors.

[28]  Josiane Mothe,et al.  Automatic Annotation of Change Detection Images , 2021, Sensors.

[29]  Adel M. Alimi,et al.  Data fusion architectures: A survey and comparison , 2015, 2015 15th International Conference on Intelligent Systems Design and Applications (ISDA).

[30]  Du-Ming Tsai,et al.  Automated surface inspection for statistical textures , 2003, Image Vis. Comput..

[31]  Gordon Morison,et al.  An imaging system for visual inspection and structural condition monitoring of railway tunnels , 2017, 2017 IEEE Workshop on Environmental, Energy, and Structural Monitoring Systems (EESMS).

[32]  Lijuan Li,et al.  Vision-Based Three-Dimensional Reconstruction and Monitoring of Large-Scale Steel Tubular Structures , 2020, Advances in Civil Engineering.

[33]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[34]  Chenglin Wang,et al.  Real-time detection of surface deformation and strain in recycled aggregate concrete-filled steel tubular columns via four-ocular vision , 2019, Robotics Comput. Integr. Manuf..

[35]  Carl J. Debono,et al.  Tunnel inspection using photogrammetric techniques and image processing: A review , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[36]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.