Comparative deep learning studies for indirect tunnel monitoring with and without Fourier pre-processing

In the last decades, the majority of the existing infrastructure heritage is approaching the end of its nominal design life mainly due to aging, deterioration, and degradation phenomena, threatening the safety levels of these strategic routes of communications. For civil engineers and researchers devoted to assessing and monitoring the structural health (SHM) of existing structures, the demand for innovative indirect non-destructive testing (NDT) methods aided with artificial intelligence (AI) is progressively spreading. In the present study, the authors analyzed the exertion of various deep learning models in order to increase the productivity of classifying ground penetrating radar (GPR) images for SHM purposes, especially focusing on road tunnel linings evaluations. Specifically, the authors presented a comparative study employing two convolutional models, i.e. the ResNet-50 and the EfficientNet-B0, and a recent transformer model, i.e. the Vision Transformer (ViT). Precisely, the authors evaluated the effects of training the models with or without pre-processed data through the bi-dimensional Fourier transform. Despite the theoretical advantages envisaged by adopting this kind of pre-processing technique on GPR images, the best classification performances have been still manifested by the classifiers trained without the Fourier pre-processing.

[1]  H. Adeli,et al.  New adaptive robust H control of smart structures using synchrosqueezed wavelet transfo , 2022, Engineering Applications of Artificial Intelligence.

[2]  Junli Qiu,et al.  Structural behavior degradation of corroded metro tunnel lining segment , 2022, Structure and Infrastructure Engineering.

[3]  Li Guo,et al.  Research on tunnel lining image target recognition method based on YOLOv3 , 2022, IEEE Joint International Information Technology and Artificial Intelligence Conference.

[4]  A. Abraham,et al.  Recurrent Neural Networks , 2022 .

[5]  C. Ferraro,et al.  Evaluation of Ultrasonic SH-Waveform Tomography for Determining Cover Thickness and Rebar Size in Concrete Structures , 2022, Journal of Nondestructive Evaluation.

[6]  Zhong Zhou,et al.  Automatic detection method of tunnel lining multi‐defects via an enhanced You Only Look Once network , 2022, Comput. Aided Civ. Infrastructure Eng..

[7]  Christoph M. Monsberger,et al.  Large-scale distributed fiber optic sensing network for short and long-term integrity monitoring of tunnel linings , 2022, Journal of Civil Structural Health Monitoring.

[8]  Dejun Chen,et al.  Research on Target Recognition Method of Tunnel Lining Image Based on Deep Learning , 2022, 2022 IEEE 6th Information Technology and Mechatronics Engineering Conference (ITOEC).

[9]  Luca Di Battista,et al.  Indirect assessment of concrete resistance from FE model updating and Young’s modulus estimation of a multi-span PSC viaduct: Experimental tests and validation , 2022, Structures.

[10]  B. Chiaia,et al.  Deep convolutional neural network for multi-level non-invasive tunnel lining assessment , 2022, Frontiers of Structural and Civil Engineering.

[11]  P. Lourenço,et al.  Structural health monitoring of civil engineering structures by using the internet of things: A review , 2022, Journal of Building Engineering.

[12]  A. Cohn,et al.  Arbitrarily-oriented tunnel lining defects detection from Ground Penetrating Radar images using deep Convolutional Neural networks , 2022, Automation in Construction.

[13]  Jaroslaw Adam Miszczak,et al.  Finicky transfer learning—A method of pruning convolutional neural networks for cracks classification on edge devices , 2021, Comput. Aided Civ. Infrastructure Eng..

[14]  Giansalvo Cirrincione,et al.  Vision Transformers for femur fracture classification , 2021, Injury.

[15]  A. Aloisio,et al.  Advanced deep learning comparisons for non-invasive tunnel lining assessment from ground penetrating radar profiles , 2022, 8th European Congress on Computational Methods in Applied Sciences and Engineering.

[16]  G. Cirrincione,et al.  Ground Penetrating Radar Fourier Pre-processing for Deep Learning Tunnel Defects' Automated Classification , 2022, EANN.

[17]  Wang Xiaoliang,et al.  Identifying void defects behind Tunnel composite lining based on transient electromagnetic radar method , 2022 .

[18]  Haiyina Hasbia Amania,et al.  A Comprehensive Evaluation for the Tunnel Conditions with Ground Penetrating Radar Measurements , 2021, Remote. Sens..

[19]  Donghao Zhang,et al.  Automatic recognition of tunnel lining elements from GPR images using deep convolutional networks with data augmentation , 2021 .

[20]  Anfu Zhu,et al.  Recognition Method of Tunnel Lining Defects Based on Deep Learning , 2021, Wireless Communications and Mobile Computing.

[21]  J. Rigney,et al.  Review of Post-Fire Inspection Procedures for Concrete Tunnels , 2021, Transportation Research Record: Journal of the Transportation Research Board.

[22]  Yichang James Tsai,et al.  Convolutional neural network for automated classification of jointed plain concrete pavement conditions , 2020, Comput. Aided Civ. Infrastructure Eng..

[23]  Jingjing Guo,et al.  Semi‐supervised learning based on convolutional neural network and uncertainty filter for façade defects classification , 2020, Comput. Aided Civ. Infrastructure Eng..

[24]  Xueqin Chen,et al.  Tunnel condition assessment via cloud model‐based random forests and self‐training approach , 2020, Comput. Aided Civ. Infrastructure Eng..

[25]  Anthony G. Cohn,et al.  GPRInvNet: Deep Learning-Based Ground-Penetrating Radar Data Inversion for Tunnel Linings , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Michael Soltys,et al.  Introduction to Computational Complexity , 2009, Algorithms.

[27]  Peng Jiang,et al.  GPRI2Net: A Deep-Neural-Network-Based Ground Penetrating Radar Data Inversion and Object Identification Framework for Consecutive and Long Survey Lines , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[28]  B. Koonce ResNet 50 , 2021, Convolutional Neural Networks with Swift for Tensorflow.

[29]  Hao Qian Design of Tunnel Automatic Monitoring System Based on BIM and IOT , 2021, Journal of Physics: Conference Series.

[30]  Dong Wang Compilation and Application of Microcomputer Physical Education Class Scoring System , 2021 .

[31]  B. Koonce EfficientNet , 2021, Convolutional Neural Networks with Swift for Tensorflow.

[32]  B. Koonce Convolutional Neural Networks with Swift for Tensorflow: Image Recognition and Dataset Categorization , 2021 .

[33]  Eduardo Bayro-Corrochano,et al.  Multi-stage deep learning perception system for mobile robots , 2021, Integr. Comput. Aided Eng..

[34]  Weidong Wang,et al.  A novel tunnel-lining crack recognition system based on digital image technology , 2020 .

[35]  Zheng Tong,et al.  Advances of deep learning applications in ground-penetrating radar: A survey , 2020 .

[36]  T. Zayed,et al.  Deterioration mapping in subway infrastructure using sensory data of GPR , 2020 .

[37]  Bernardino Chiaia,et al.  Customised active monitoring system for structural control and maintenance optimisation , 2020 .

[38]  Vuong Minh Le,et al.  A Sensitivity and Robustness Analysis of GPR and ANN for High-Performance Concrete Compressive Strength Prediction Using a Monte Carlo Simulation , 2020, Sustainability.

[39]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Shuang Wang,et al.  Structural Damage Detection using Deep Convolutional Neural Network and Transfer Learning , 2019, KSCE Journal of Civil Engineering.

[41]  Fabio Tosti,et al.  Using Ground Penetrating Radar Methods to Investigate Reinforced Concrete Structures , 2019, Surveys in Geophysics.

[42]  Xuepeng Zhang,et al.  Quantitative condition inspection and assessment of tunnel lining , 2019, Automation in Construction.

[43]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[44]  Hui Li,et al.  Compressive-sensing data reconstruction for structural health monitoring: a machine-learning approach , 2019, Structural Health Monitoring.

[45]  Bo Chen,et al.  MnasNet: Platform-Aware Neural Architecture Search for Mobile , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Naif Alajlan,et al.  Artificial Neural Network Methods for the Solution of Second Order Boundary Value Problems , 2019, Computers, Materials & Continua.

[47]  Hojjat Adeli,et al.  INFRARED THERMOGRAPHY FOR DETECTING DEFECTS IN CONCRETE STRUCTURES , 2018, JOURNAL OF CIVIL ENGINEERING AND MANAGEMENT.

[48]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[49]  Paolo Napoletano,et al.  Benchmark Analysis of Representative Deep Neural Network Architectures , 2018, IEEE Access.

[50]  Kurt Bryan,et al.  Discrete Fourier Analysis and Wavelets: Applications to Signal and Image Processing, Second Edition , 2018 .

[51]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[52]  Manish Vishwakarma,et al.  Advances and Researches on Non Destructive Testing: A Review , 2018 .

[53]  Charu C. Aggarwal,et al.  Neural Networks and Deep Learning , 2018, Springer International Publishing.

[54]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[55]  Hojjat Adeli,et al.  New method for modal identification of super high‐rise building structures using discretized synchrosqueezed wavelet and Hilbert transforms , 2017 .

[56]  Halil Ceylan,et al.  Wireless MEMS for transportation infrastructure health monitoring , 2017 .

[57]  Carlos A. Perez-Ramirez,et al.  New methodology for modal parameters identification of smart civil structures using ambient vibrations and synchrosqueezed wavelet transform , 2016, Eng. Appl. Artif. Intell..

[58]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  Ismail Nikoufar,et al.  Mathematical Analysis II , 2016 .

[60]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[61]  Tomoki Shiotani,et al.  Advanced structural health monitoring of concrete structures with the aid of acoustic emission , 2014 .

[62]  Charles R. Farrar,et al.  Structural Health Monitoring: A Machine Learning Perspective , 2012 .

[63]  Jian Zhao,et al.  Structural health monitoring of underground facilities – technological issues and challenges , 2005 .

[64]  Hojjat Adeli,et al.  Time‐Frequency Signal Analysis of Earthquake Records Using Mexican Hat Wavelets , 2003 .

[65]  Ettore Cardarelli,et al.  Evaluation of tunnel stability using integrated geophysical methods , 2003 .

[66]  Mansor Nakhkash,et al.  Automatic detection of buried utilities and solid objects with GPR using neural networks and pattern recognition , 2000 .