Automated detection of defects with low semantic information in X-ray images based on deep learning

Nondestructive testing using X-ray imaging has been widely adopted in the defect detection of casting parts for quality management. Deep learning has been proved to be an effective way to detect defects in X-ray images. In this work, Feature Pyramid Network (FPN) which has been utilized broadly in many applications is adopted as our baseline. In FPN, there mainly exits two issues: firstly, down sampling operation in Convolutional Neural Network is often utilized to enhance the perception field, causing the loss of location information in feature maps, and secondly, there exists feature imbalance in feature maps and proposals. DetNet and Path Aggregation Network are adopted to solve the two shortages. To further improve the recall rate, soft Non-Maximum Suppression (soft-NMS) is adopted to remain more proposals that have high classification confidence. Defects in X-ray images of casting parts are provided with low semantic information, causing the different instances between detection results and annotations in the same area. We propose soft Intersection Over Union (soft-IOU) criterion which could evaluate several results or ground truths in the near area, making it more accurate to evaluate detection results. The experimental results demonstrate that the three proposed strategies have better performance than the baseline for our dataset.

[1]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Ge Zhang,et al.  Approaches for improvement of the X-ray image defect detection of automobile casting aluminum parts based on deep learning , 2019, NDT & E International.

[3]  Yang Lei,et al.  Railway Subgrade Defect Automatic Recognition Method Based on Improved Faster R-CNN , 2018, Sci. Program..

[4]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[5]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Shu Liu,et al.  Path Aggregation Network for Instance Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  Jianzhong Fu,et al.  Defect diagnosis for polymeric samples via magnetic levitation , 2018, NDT & E International.

[8]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[9]  P. Withers,et al.  Quantitative X-ray tomography , 2014 .

[10]  Olatomiwa Badmos,et al.  Image-based defect detection in lithium-ion battery electrode using convolutional neural networks , 2020, J. Intell. Manuf..

[11]  Yujie Li,et al.  Railway track fastener defect detection based on image processing and deep learning techniques: A comparative study , 2019, Eng. Appl. Artif. Intell..

[12]  Wei Jiang,et al.  Bag of Tricks and a Strong Baseline for Deep Person Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  Xinggang Wang,et al.  Automated defect inspection of LED chip using deep convolutional neural network , 2019, J. Intell. Manuf..

[14]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[16]  Xiangyu Zhang,et al.  DetNet: Design Backbone for Object Detection , 2018, ECCV.

[17]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Rajalingappaa Shanmugamani,et al.  Detection and classification of surface defects of gun barrels using computer vision and machine learning , 2015 .

[19]  William T. Freeman,et al.  Latent hierarchical structural learning for object detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Jure Skvarč,et al.  Segmentation-based deep-learning approach for surface-defect detection , 2019, Journal of Intelligent Manufacturing.

[22]  T. Krivec,et al.  Advanced 3D failure characterization in multi-layered PCBs , 2016 .

[23]  Bahram Notghi,et al.  Optimal Wave Propagation-Based Nondestructive Test Design for Quantitative Damage Characterization , 2015 .

[24]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[25]  Domingo Mery,et al.  Automatic Defect Recognition in X-Ray Testing Using Computer Vision , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[26]  Larry S. Davis,et al.  Soft-NMS — Improving Object Detection with One Line of Code , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[27]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[28]  Anirban Mukherjee,et al.  Automatic Defect Detection on Hot-Rolled Flat Steel Products , 2013, IEEE Transactions on Instrumentation and Measurement.

[29]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[30]  Jack Chin Pang Cheng,et al.  Automated detection of sewer pipe defects in closed-circuit television images using deep learning techniques , 2018, Automation in Construction.

[31]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[32]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[33]  Domingo Mery,et al.  GDXray: The Database of X-ray Images for Nondestructive Testing , 2015, Journal of Nondestructive Evaluation.

[34]  Kincho H. Law,et al.  Automatic localization of casting defects with convolutional neural networks , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[35]  Domingo Mery,et al.  Computer vision technology for X-ray testing , 2014 .

[36]  Cataldo Guaragnella,et al.  Automatic ultrasonic inspection for internal defect detection in composite materials , 2008 .

[37]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[38]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[39]  D. Palumbo,et al.  Ultrasonic analysis and lock-in thermography for debonding evaluation of composite adhesive joints , 2016 .

[40]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[41]  Andreas Staude,et al.  Quantification of the capability of micro-CT to detect defects in castings using a new test piece and a voxel-based comparison method , 2011 .

[42]  Shri Sant,et al.  Defects, Causes and Their Remedies in Casting Process: A Review , 2014 .