Loosening Identification of Multi-Bolt Connections Based on Wavelet Transform and ResNet-50 Convolutional Neural Network

A high-strength bolt connection is the key component of large-scale steel structures. Bolt loosening and preload loss during operation can reduce the load-carrying capacity, safety, and durability of the structures. In order to detect loosening damage in multi-bolt connections of large-scale civil engineering structures, we proposed a multi-bolt loosening identification method based on time-frequency diagrams and a convolutional neural network (CNN) using vi-bro-acoustic modulation (VAM) signals. Continuous wavelet transform was employed to obtain the time-frequency diagrams of VAM signals as the features. Afterward, the CNN model was trained to identify the multi-bolt loosening conditions from the raw time-frequency diagrams intelligently. It helps to get rid of the dependence on traditional manual selection of simplex and ineffective damage index and to eliminate the influence of operational noise of structures on the identification accuracy. A laboratory test was carried out on bolted connection specimens with four high-strength bolts of different degrees of loosening. The effects of different excitations, CNN models, and dataset sizes were investigated. We found that the ResNet-50 CNN model taking time-frequency diagrams of the hammer excited VAM signals, as the input had better performance in identifying the loosened bolts with various degrees of loosening at different positions. The results indicate that the proposed multi-bolt loosening identification method based on VAM and ResNet-50 CNN can identify bolt loosening with a reasonable accuracy, computational efficiency, and robustness.

[1]  B. Samali,et al.  Crack detection of concrete structures using deep convolutional neural networks optimized by enhanced chicken swarm algorithm , 2022, Structural Health Monitoring.

[2]  S. Fang,et al.  Safety evaluation of truss bridges using continuous Bayesian networks , 2021, Structural Control and Health Monitoring.

[3]  Furui Wang A novel autonomous strategy for multi-bolt looseness detection using smart glove and Siamese double-path CapsNet , 2021, Structural Health Monitoring.

[4]  Wei-Xin Ren,et al.  Structural damage identification under nonstationary excitations through recurrence plot and multi-label convolutional neural network , 2021, Measurement.

[5]  Debing Zhuo,et al.  Damage identification of bolt connection in steel truss structures by using sound signals , 2021, Structural Health Monitoring.

[6]  Seunghee Park,et al.  Artificial Intelligence-Based Bolt Loosening Diagnosis Using Deep Learning Algorithms for Laser Ultrasonic Wave Propagation Data , 2020, Sensors.

[7]  Yang Wang,et al.  Acoustic emission wave classification for rail crack monitoring based on synchrosqueezed wavelet transform and multi-branch convolutional neural network , 2020, Structural Health Monitoring.

[8]  Senjian An,et al.  Deep residual network framework for structural health monitoring , 2020 .

[9]  Gangbing Song,et al.  Monitoring of multi-bolt connection looseness using a novel vibro-acoustic method , 2020 .

[10]  Gangbing Song,et al.  Bolt early looseness monitoring using modified vibro-acoustic modulation by time-reversal , 2019, Mechanical Systems and Signal Processing.

[11]  Xiao Liang,et al.  Image‐based post‐disaster inspection of reinforced concrete bridge systems using deep learning with Bayesian optimization , 2018, Comput. Aided Civ. Infrastructure Eng..

[12]  Niannian Wang,et al.  Bolt loosening angle detection technology using deep learning , 2018, Structural Control and Health Monitoring.

[13]  Michele Meo,et al.  IWSHM 2017: Structural health monitoring of the loosening in a multi-bolt structure using linear and modulated nonlinear ultrasound acoustic moments approach , 2018, Structural Health Monitoring.

[14]  Joo-Ho Choi,et al.  Convolutional neural network for gear fault diagnosis based on signal segmentation approach , 2018, Structural Health Monitoring.

[15]  Yang Yu,et al.  A novel deep learning-based method for damage identification of smart building structures , 2018, Structural Health Monitoring.

[16]  Majid Ramezani,et al.  Separation of amplitude and frequency modulations in Vibro-Acoustic Modulation Nondestructive Testing Method , 2018, Proc. Meet. Acoust..

[17]  Gangbing Song,et al.  A smart “shear sensing” bolt based on FBG sensors , 2018, Measurement.

[18]  Jian Li,et al.  Image Registration-Based Bolt Loosening Detection of Steel Joints , 2018, Sensors.

[19]  Seyed Majid Yadavar Nikravesh,et al.  A REVIEW PAPER ON LOOSENESS DETECTION METHODS IN BOLTED STRUCTURES , 2017 .

[20]  Gangbing Song,et al.  Measurement of the Length of Installed Rock Bolt Based on Stress Wave Reflection by Using a Giant Magnetostrictive (GMS) Actuator and a PZT Sensor , 2017, Sensors.

[21]  Gangbing Song,et al.  Impedance-Based Pre-Stress Monitoring of Rock Bolts Using a Piezoceramic-Based Smart Washer—A Feasibility Study , 2017, Sensors.

[22]  Heow Pueh Lee,et al.  A vibro-acoustic modulation method for the detection of delamination and kissing bond in composites , 2016 .

[23]  Dianguo Xu,et al.  Mechanical Fault Diagnosis of High Voltage Circuit Breakers Based on Wavelet Time-Frequency Entropy and One-Class Support Vector Machine , 2015, Entropy.

[24]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[26]  Douglas E. Adams,et al.  Theoretical and experimental evidence for using impact modulation to assess bolted joints , 2015 .

[27]  David Looney,et al.  Intrinsic multi-scale analysis: a multi-variate empirical mode decomposition framework , 2015, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[28]  Gerald Penn,et al.  Convolutional Neural Networks for Speech Recognition , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[29]  Gangbing Song,et al.  Review of Bolted Connection Monitoring , 2013, Int. J. Distributed Sens. Networks.

[30]  Danilo P. Mandic,et al.  Filter Bank Property of Multivariate Empirical Mode Decomposition , 2011, IEEE Transactions on Signal Processing.

[31]  Michele Meo,et al.  Structural health monitoring of bolted joints using linear and nonlinear acoustic/ultrasound methods , 2011 .

[32]  K. W. Wang,et al.  Investigation of the threshold behavior of subharmonics for damage detection of a structure with a breathing crack , 2010, Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[33]  Willy Sher,et al.  Artificial neural network for the selection of buildable structural systems , 2003 .

[34]  Alexander Sutin,et al.  Micro-damage diagnostics using Nonlinear Elastic Wave Spectroscopy (NEWS) , 2001 .

[35]  K. E.-A. Van Den Abeele,et al.  Nonlinear Elastic Wave Spectroscopy (NEWS) Techniques to Discern Material Damage, Part I: Nonlinear Wave Modulation Spectroscopy (NWMS) , 2000 .

[36]  Jasper Snoek,et al.  Faster & More Reliable Tuning of Neural Networks: Bayesian Optimization with Importance Sampling , 2021, AISTATS.

[37]  Rishi Gupta,et al.  Health Monitoring of Civil Structures with Integrated UAV and Image Processing System , 2015 .

[38]  Huang Jun-tao,et al.  A Controlled Tap Detection Method for Bolt Tightness , 2012 .

[39]  Janette Louise Jaques,et al.  Using impact modulation to identify loose bolts in a satellite structure , 2011 .

[40]  Douglas E. Adams,et al.  Experimental Study of Impact Modulation for Quantifying Loose Bolt Torque in On-Demand Satellites , 2010 .

[41]  Alexander Sutin,et al.  Nonlinear Vibro-Acoustic Nondestructive Testing Technique , 1998 .