Temperature variation compensated damage classification and localisation in ultrasonic guided wave SHM using self-learnt features and Gaussian mixture models

Conventional damage localization algorithms used in ultrasonic guided wave-based structural health monitoring (GW-SHM) rely on physics-defined features of GW signals. In addition to requiring domain knowledge of the interaction of various GW modes with various types of damages, they also suffer from errors due to variations in environmental and operating conditions (EOCs) in practical use cases. While several machine learning tools have been reported for EOC compensation, they need to be custom-designed for each combination of damage and structure due to their dependence on physics-defined feature extraction. Research on the use of deep learning tools such as convolutional neural networks (CNNs) for automated feature extraction in GW-SHM is in a nascent stage and has vast untapped potential for increasing the robustness of GW-SHM systems. In this work, we propose a CNN-based automated feature extraction framework coupled with Gaussian mixture model (GMM) based EOC compensation and damage classification and localization method. Features learnt by the CNNs are used for damage classification and localization of damage by modeling the probability distribution of the features using GMMs. The Kullback-Leibler (KL) divergence of these GMMs with respect to corresponding baseline GMMs are used as signal difference coefficients (SDCs) to compute damage indices (DIs) along various GW sensor paths, and thus for damage localization. The efficacy of the proposed method is demonstrated using FE generated GW-data for an aluminum plate with a network of six lead zirconate titanate (PZT) sensors, for three different types of damages (rivet hole, added mass, notch) at various temperatures (from 0 °C to 100 °C), with added white noise and pink noise to incorporate errors due to EOCs. We also present experimental validation of the method through characterization of notch damage in an aluminum panel under varying and non-uniform temperature profiles, using a portable custom-designed field programmable gate array (FPGA) based signal transduction and data acquisition system. We demonstrate that the method outperforms conventional EOC compensation method using GMM with physics-defined features for damage localization in GW-SHM systems prone to EOC variations.

[1]  P. Wilcox,et al.  Evaluation of the damage detection capability of a sparse-array guided-wave SHM system applied to a complex structure under varying thermal conditions , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[2]  Joseph L. Rose,et al.  Ultrasonic Guided Wave Imaging Techniques in Structural Health Monitoring , 2010 .

[3]  Nitesh P. Yelve,et al.  Optimizing location of damage within an enclosed area defined by an algorithm based on the Lamb wave response data , 2017 .

[4]  Lin Ye,et al.  Guided Lamb waves for identification of damage in composite structures: A review , 2006 .

[5]  Joel B. Harley,et al.  Uncertainty Aware Deep Neural Network for Multistatic Localization with Application to Ultrasonic Structural Health Monitoring , 2020, ArXiv.

[6]  Sauvik Banerjee,et al.  Identification of disbond and high density core region in a honeycomb composite sandwich structure using ultrasonic guided waves , 2016 .

[7]  Peter Cawley,et al.  Long-term stability of guided wave structural health monitoring using distributed adhesively bonded piezoelectric transducers , 2014 .

[8]  M. H. Ferri Aliabadi,et al.  Passive sensing method for impact localisation in composite plates under simulated environmental and operational conditions , 2019, Mechanical Systems and Signal Processing.

[9]  Hui Li,et al.  Computer vision and deep learning–based data anomaly detection method for structural health monitoring , 2019 .

[10]  Soo-Chul Lim,et al.  Structural vibration-based classification and prediction of delamination in smart composite laminates using deep learning neural network , 2019, Composites Part B: Engineering.

[11]  Yue Wang,et al.  An Improved Matching Pursuit-Based Temperature and Load Compensation Method for Ultrasonic Guided Wave Signals , 2020, IEEE Access.

[12]  M. Saqib Hameed,et al.  Transverse Damage Localization and Quantitative Size Estimation for Composite Laminates Based on Lamb Waves , 2019, IEEE Access.

[13]  Shiri Gordon,et al.  An efficient image similarity measure based on approximations of KL-divergence between two gaussian mixtures , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[14]  Lu Gan,et al.  Split‐spectrum processing technique for SNR enhancement of ultrasonic guided wave , 2018, Ultrasonics.

[15]  Fu-Kuo Chang,et al.  Load monitoring and compensation strategies for guided-waves based structural health monitoring using piezoelectric transducers , 2015 .

[16]  Yunfeng Zhang,et al.  Deep learning based crack damage detection technique for thin plate structures using guided lamb wave signals , 2019, Smart Materials and Structures.

[17]  Xinlin Qing,et al.  Identification and Compensation Technique of Non-Uniform Temperature Field for Lamb Wave-and Multiple Sensors-Based Damage Detection , 2019, Sensors.

[18]  Mario Bergés,et al.  Robust ultrasonic damage detection under complex environmental conditions using singular value decomposition. , 2015, Ultrasonics.

[19]  Hoon Sohn,et al.  Effects of environmental and operational variability on structural health monitoring , 2007, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[20]  G. C. Smith,et al.  Frequency-Shaping with Spatial Compensators , 2000 .

[21]  Joseph L. Rose,et al.  Ultrasonic Guided Waves in Solid Media , 2014 .

[22]  Peter Cawley,et al.  Guided wave health monitoring of complex structures by sparse array systems: Influence of temperature changes on performance , 2010 .

[23]  K. Schubert,et al.  On the influence of moisture absorption on Lamb wave propagation and measurements in viscoelastic CFRP using surface applied piezoelectric sensors , 2012 .

[24]  Amir H. Gandomi,et al.  Prediction error of Johansen cointegration residuals for structural health monitoring , 2021 .

[25]  Wieslaw J. Staszewski,et al.  Lamb wave based structural damage detection using cointegration and fractal signal processing , 2014 .

[26]  Moncef Gabbouj,et al.  Real-time vibration-based structural damage detection using one-dimensional convolutional neural networks , 2017 .

[27]  Douglas A. Reynolds,et al.  Gaussian Mixture Models , 2018, Encyclopedia of Biometrics.

[28]  Lei Qiu,et al.  Gaussian mixture model and delay-and-sum based 4D imaging of damage in aircraft composite structures under time-varying conditions , 2020 .

[29]  Mira Mitra,et al.  Guided wave based structural health monitoring: A review , 2016 .

[30]  T. Michaels,et al.  Guided wave signal processing and image fusion for in situ damage localization in plates , 2007 .

[31]  Jochen Moll,et al.  Efficient temperature compensation strategies for guided wave structural health monitoring. , 2010, Ultrasonics.

[32]  Mahindra Rautela,et al.  Ultrasonic guided wave based structural damage detection and localization using model assisted convolutional and recurrent neural networks , 2020, Expert Syst. Appl..

[33]  Peter Cawley,et al.  Independent Component Analysis for Improved Defect Detection in Guided Wave Monitoring , 2016, Proceedings of the IEEE.

[34]  Antonio F. Skarmeta,et al.  TinyML-Enabled Frugal Smart Objects: Challenges and Opportunities , 2020, IEEE Circuits and Systems Magazine.

[35]  Joaquim Figueiras,et al.  Damage detection under environmental and operational effects using cointegration analysis – Application to experimental data from a cable-stayed bridge , 2020 .

[36]  Shenfang Yuan,et al.  Multiphysics simulation method of lamb wave propagation with piezoelectric transducers under load condition , 2019, Chinese Journal of Aeronautics.

[37]  Peter Cawley,et al.  Structural health monitoring: Closing the gap between research and industrial deployment , 2018 .

[38]  S. Yuan,et al.  Multi-damage imaging of composite structures under environmental and operational conditions using guided wave and Gaussian mixture model , 2019, Smart Materials and Structures.

[39]  Shenfang Yuan,et al.  Gaussian mixture model–based path-synthesis accumulation imaging of guided wave for damage monitoring of aircraft composite structures under temperature variation , 2019 .

[40]  Alexander C. S. Douglass,et al.  Model-based statistical guided wave damage detection for an aluminum plate , 2020 .

[41]  Ilias N. Giannakeas,et al.  Digital clone testing platform for the assessment of SHM systems under uncertainty , 2022 .

[42]  Joel B. Harley,et al.  Structural damage detection using deep learning of ultrasonic guided waves , 2018 .

[43]  Tomasz Barszcz,et al.  Towards homoscedastic nonlinear cointegration for structural health monitoring , 2016 .

[44]  M. Mitra,et al.  Explainable 1-D convolutional neural network for damage detection using Lamb wave , 2022 .

[45]  Shenfang Yuan,et al.  Guided Wave-Convolutional Neural Network Based Fatigue Crack Diagnosis of Aircraft Structures , 2019, Sensors.

[46]  Rahim Gorgin,et al.  Environmental and operational conditions effects on Lamb wave based structural health monitoring systems: A review. , 2020, Ultrasonics.

[47]  Mahmood Shafiee,et al.  Structural Health Monitoring (SHM) and Determination of Surface Defects in Large Metallic Structures using Ultrasonic Guided Waves , 2018, Sensors.

[48]  W. Ostachowicz,et al.  Effects of debonding on Lamb wave propagation in a bonded composite structure under variable temperature conditions , 2018, Smart Materials and Structures.

[49]  Paul D. Wilcox,et al.  The temperature stability of guided wave structural health monitoring systems , 2006 .

[50]  Mohammad Modarres,et al.  Estimating damage size and remaining useful life in degraded structures using deep learning-based multi-source data fusion , 2020 .

[51]  S. Barnett,et al.  Philosophical Transactions of the Royal Society A : Mathematical , 2017 .

[52]  Cara A. C. Leckey,et al.  Simulation of guided‐wave ultrasound propagation in composite laminates: Benchmark comparisons of numerical codes and experiment , 2018, Ultrasonics.