Temporal and spatial deep learning network for infrared thermal defect detection

Abstract Most common types of defects for composite are debond and delamination. It is difficult to detect the inner defects on a complex shaped specimen by using conventional optical thermography nondestructive testing (NDT) methods. In this paper, a hybrid of spatial and temporal deep learning architecture for automatic thermography defects detection is proposed. The integration of cross network learning strategy has the capability to significantly minimize the uneven illumination and enhance the detection rate. The probability of detection (POD) has been derived to measure the detection results and this is coupled with comparison studies to verify the efficacy of the proposed method. The results show that visual geometry group-Unet (VGG-Unet) cross learning structure can significantly improve the contrast between the defective and non-defective regions. In addition, investigation of different feature extraction methods in which embedded in deep learning is conducted to optimize the learning structure. To investigate the efficacy and robustness of the proposed method, experimental studies have been carried out for inner debond defects on both regular and irregular shaped carbon fiber reinforced polymer (CFRP) specimens.

[1]  Wai Lok Woo,et al.  Unsupervised Diagnostic and Monitoring of Defects Using Waveguide Imaging With Adaptive Sparse Representation , 2016, IEEE Transactions on Industrial Informatics.

[2]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[3]  Xavier Maldague,et al.  Interactive Methodology for Optimized Defect Characterization by Quantitative Pulsed Phase Thermography , 2005 .

[4]  P. Venegas,et al.  Advances in RGB Projection Technique for Thermographic NDT: Channels Selection Criteria and Visualization Improvement , 2018 .

[5]  Martin Johnston,et al.  Variational Bayesian Subgroup Adaptive Sparse Component Extraction for Diagnostic Imaging System , 2018, IEEE Transactions on Industrial Electronics.

[6]  Yuan Yao,et al.  Thermographic clustering analysis for defect detection in CFRP structures , 2016 .

[7]  Wai Lok Woo,et al.  Automatic Relevance Determination of Adaptive Variational Bayes Sparse Decomposition for Micro-Cracks Detection in Thermal Sensing , 2017, IEEE Sensors Journal.

[8]  V. V. Shiryaev,et al.  A novel data processing algorithm in thermal property measurement and defect detection by using one-sided active infrared thermography , 2015, Commercial + Scientific Sensing and Imaging.

[9]  Mei Lin IMAGE PROCESSING IN PULSE HEATING INFRARED NONDESTRUCTIVE TEST , 2002 .

[10]  Wai Lok Woo,et al.  Ensemble variational Bayes tensor factorization for super resolution of CFRP debond detection , 2017 .

[11]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Yuan Yao,et al.  Defect detection in CFRP structures using pulsed thermographic data enhanced by penalized least squares methods , 2015 .

[13]  X. Maldague,et al.  New absolute contrast for pulsed thermography , 2002 .

[14]  Nik Rajic,et al.  Principal component thermography for flaw contrast enhancement and flaw depth characterisation in composite structures , 2002 .

[15]  Chunhui Zhao,et al.  Visual defect recognition and location for pulsed thermography images based on defect-background contrast analysis , 2018, 2018 33rd Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[16]  Yuan Yao,et al.  Automatic defect detection based on segmentation of pulsed thermographic images , 2017 .

[17]  A O Chulkov,et al.  Hardware and Software for Thermal Nondestructive Testing of Metallic and Composite Materials , 2016 .

[18]  Nazih Mechbal,et al.  Damage Detection of Composite Structure Using Independent Component Analysis , 2011 .

[19]  Deng Yong,et al.  Infrared image segmentation with 2-D maximum entropy method based on particle swarm optimization (PSO) , 2005 .

[20]  S. Marinetti,et al.  Pulse phase infrared thermography , 1996 .

[21]  Bardia Yousefi,et al.  Automatic IRNDT inspection applying sparse PCA-based clustering , 2017, 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE).

[22]  Wai Lok Woo,et al.  Automatic seeded region growing for thermography debonding detection of CFRP , 2018, NDT & E International.

[23]  Yunze He,et al.  Shared Excitation Based Nonlinear Ultrasound and Vibrothermography Testing for CFRP Barely Visible Impact Damage Inspection , 2018, IEEE Transactions on Industrial Informatics.

[24]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Wai Lok Woo,et al.  Physics-Based Image Segmentation Using First Order Statistical Properties and Genetic Algorithm for Inductive Thermography Imaging , 2017, IEEE Transactions on Image Processing.

[26]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[27]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Steven M. Shepard,et al.  Advances in thermographic signal reconstruction , 2015, Commercial + Scientific Sensing and Imaging.

[29]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[30]  Ermanno G. Grinzato,et al.  Inspecting thermal barrier coatings by IR thermography , 2003, SPIE Defense + Commercial Sensing.

[31]  Yuan Yao,et al.  Improved non-destructive testing of carbon fiber reinforced polymer (CFRP) composites using pulsed thermograph , 2015 .

[32]  Yuan Yao,et al.  Non-destructive testing of CFRP using pulsed thermographic data enhanced by wavelet transform-based image denoising , 2017, 2017 36th Chinese Control Conference (CCC).

[33]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Ermanno G. Grinzato,et al.  Statistical analysis of IR thermographic sequences by PCA , 2004 .

[35]  D. V. Rama Koti Reddy,et al.  Segmentation of Thermographic Sequences in Frequency Modulated Thermal Wave Imaging for NDE of GFRP , 2018 .

[36]  Xavier Maldague,et al.  Non-destructive defect evaluation of polymer composites via thermographic data analysis: A manifold learning method , 2019, Infrared Physics & Technology.

[37]  Wai Lok Woo,et al.  Impact Damage Detection and Identification Using Eddy Current Pulsed Thermography Through Integration of PCA and ICA , 2014, IEEE Sensors Journal.

[38]  Ian D. Reid,et al.  RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).