Nondestructive Defect Detection in Castings by Using Spatial Attention Bilinear Convolutional Neural Network

X-ray images of castings are widely used in manufacturing for quality assurance. This article investigates the X-ray-image-based defective detection. The main contributions in this article are twofold: first, a new full-image method is proposed to classify defective castings and nondefective ones; and second, by combining two technologies, spatial attention mechanism and bilinear pooling used in deep convolutional neural networks (CNNs), a new spatial attention bilinear CNN is proposed to enhance the representation power of CNN. To validate the above initiatives, extensive experimental studies have been carried out to show the advantages of the new method over a number of existing ones.

[1]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[2]  Tao Mei,et al.  Learning Multi-attention Convolutional Neural Network for Fine-Grained Image Recognition , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Jian Feng,et al.  An Estimation Method of Defect Size From MFL Image Using Visual Transformation Convolutional Neural Network , 2019, IEEE Transactions on Industrial Informatics.

[7]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Domingo Mery,et al.  Automatic Defect Recognition in X-Ray Testing Using Computer Vision , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[10]  Fang Wan,et al.  SIXray: A Large-Scale Security Inspection X-Ray Benchmark for Prohibited Item Discovery in Overlapping Images , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Byoung-Tak Zhang,et al.  Bilinear Attention Networks , 2018, NeurIPS.

[17]  Zhifen Zhang,et al.  Audible Sound-Based Intelligent Evaluation for Aluminum Alloy in Robotic Pulsed GTAW: Mechanism, Feature Selection, and Defect Detection , 2018, IEEE Transactions on Industrial Informatics.

[18]  Zhou Yu,et al.  Multi-modal Factorized Bilinear Pooling with Co-attention Learning for Visual Question Answering , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Domingo Mery,et al.  Computer Vision for X-Ray Testing , 2015, Springer International Publishing.

[20]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[21]  Chao Li,et al.  An Effective Method of Weld Defect Detection and Classification Based on Machine Vision , 2019, IEEE Transactions on Industrial Informatics.

[22]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[25]  A. Buja,et al.  Loss Functions for Binary Class Probability Estimation and Classification: Structure and Applications , 2005 .

[26]  Dong Yue,et al.  Chance-constrained H∞ control for a class of time-varying systems with stochastic nonlinearities: The finite-horizon case , 2019, Autom..

[27]  Kincho H. Law,et al.  Automatic localization of casting defects with convolutional neural networks , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[28]  Xi Yang,et al.  Surface Defect Detection via Entity Sparsity Pursuit With Intrinsic Priors , 2020, IEEE Transactions on Industrial Informatics.

[29]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[30]  Subhransu Maji,et al.  Bilinear Convolutional Neural Networks for Fine-Grained Visual Recognition , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Domingo Mery,et al.  GDXray: The Database of X-ray Images for Nondestructive Testing , 2015, Journal of Nondestructive Evaluation.

[32]  Wim Dewulf,et al.  Industrial X-Ray Computed Tomography , 2018 .