Aluminum Casting Inspection Using Deep Learning: A Method Based on Convolutional Neural Networks

Castings produced for the automotive industry are considered important components for overall roadworthiness. To ensure the safety of construction, it is necessary to check every part thoroughly using non-destructive testing. X-ray testing rapidly became the accepted way of controlling the quality of die-cast pieces. In this paper, we present a Convolutional Neural Network (CNN) for defect detection in castings. In order to train the CNN model, a large dataset is necessary. We build the dataset by using synthetic defects. They are simulated using 3D ellipsoidal models and Generative Adversarial Networks (GAN). We compare different portions of ellipsoidal/GAN defects in the training subset. In our experiments, the use of GAN defects does not play a relevant role in this solution. However, ellipsoidal defects helped to achieve better performance. Ellipsoidal defects from any size and orientation could be superimposed onto real X-ray images in any location. In addition, we tested several CNN configurations, the best one, that we call Xnet-II, has 30 layers and more than 1,350,000 parameters. It has been trained using a dataset with around 640,000 patches containing 50% of ellipsoidal defects and 50% of real background captured from different casting types. The model was tested using sliding-windows methodology on whole X-ray images achieving promising results (mPA = 0.7102): the model was able to detect real defects from different casting types. We believe that the methodology presented could be used in similar projects that have to deal with automated detection of defects.

[1]  Dong Liang,et al.  A sparse-representation-based robust inspection system for hidden defects classification in casting components , 2015, Neurocomputing.

[2]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[3]  Robert E. Skinner,et al.  Nondestructive Testing to Identify Concrete Bridge Deck Deterioration , 2009 .

[4]  Domingo Mery,et al.  Automatic multiple view inspection using geometrical tracking and feature analysis in aluminum wheels , 2010, Machine Vision and Applications.

[5]  Peter J. Shull,et al.  X-Ray Imaging: Fundamentals, Industrial Techniques and Applications , 2016 .

[6]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Dieter Filbert,et al.  Automated flaw detection in aluminum castings based on the tracking of potential defects in a radioscopic image sequence , 2002, IEEE Trans. Robotics Autom..

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Domingo Mery,et al.  Computer Vision for X-Ray Testing , 2015, Springer International Publishing.

[11]  Domingo Mery,et al.  GDXray: The Database of X-ray Images for Nondestructive Testing , 2015, Journal of Nondestructive Evaluation.

[12]  Domingo Mery Automated radioscopic testing of aluminum die castings , 2006 .

[13]  Florent Retraint,et al.  Statistical detection of defects in radiographic images using an adaptive parametric model , 2014, Signal Process..

[14]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[15]  Domingo Mery,et al.  A review of methods for automated recognition of casting defects , 2002 .

[16]  Domingo Mery Automated Detection of Welding Defects without Segmentation , 2011 .

[17]  Domingo Mery Automated Detection of Welding Discontinuities without Segmentation , 2011 .

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Ying Huang,et al.  A New Trend Peak Algorithm with X-ray Image for Wheel Hubs Detection and Recognition , 2015, ISICA.

[20]  Domingo Mery,et al.  Robust automated multiple view inspection , 2007, Pattern Analysis and Applications.

[21]  Domingo Mery,et al.  Neural network method for failure detection with skewed class distribution , 2004 .

[22]  Domingo Mery,et al.  Automatic Defect Recognition in X-Ray Testing Using Computer Vision , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[23]  Domingo Mery,et al.  Visual inspection of glass bottlenecks by multiple-view analysis , 2010, Int. J. Comput. Integr. Manuf..

[24]  Tom White,et al.  Generative Adversarial Networks: An Overview , 2017, IEEE Signal Processing Magazine.

[25]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[26]  Hsiao-Wei Liu,et al.  Steel surface in-line inspection using machine vision , 2016, International Workshop on Pattern Recognition.

[27]  Theobald Fuchs,et al.  X-ray based methods for non-destructive testing and material characterization , 2008 .

[28]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[29]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[30]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[31]  Yu Yao,et al.  Detection of a casting defect tracked by deep convolution neural network , 2018, The International Journal of Advanced Manufacturing Technology.

[32]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[33]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[34]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[35]  Junsheng Zhang,et al.  Defect Detection of Aluminum Alloy Wheels in Radiography Images Using Adaptive Threshold and Morphological Reconstruction , 2018, Applied Sciences.

[36]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[37]  Xinping Guan,et al.  Application of a new image segmentation method to detection of defects in castings , 2009 .

[38]  Domingo Mery,et al.  Simulation of defects in aluminium castings using CAD models of flaws and real X-ray images , 2005 .

[39]  Zaixing He,et al.  Defect detection of castings in radiography images using a robust statistical feature. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[40]  F Ramírez,et al.  Detection of flaws in aluminium castings: a comparative study between generative and discriminant approaches , 2013 .

[41]  Kincho H. Law,et al.  Automatic localization of casting defects with convolutional neural networks , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[42]  Domingo Mery,et al.  Inspection of Complex Objects Using Multiple-X-Ray Views , 2015, IEEE/ASME Transactions on Mechatronics.

[43]  Domingo Mery A new algorithm for flaw simulation in castings by superimposing projections of 3D models onto X-ray images , 2001, SCCC 2001. 21st International Conference of the Chilean Computer Science Society.

[44]  Gennaro Scarselli,et al.  Nonlinear Imaging Method Using Second Order Phase Symmetry Analysis and Inverse Filtering , 2015 .

[45]  Domingo Mery,et al.  Flaw detection in aluminium die castings using simultaneous combination of multiple views , 2010 .

[46]  Qian Huang,et al.  Improving Automatic Detection of Defects in Castings by Applying Wavelet Technique , 2006, IEEE Transactions on Industrial Electronics.

[47]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[48]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Anandhanarayanan Kamalakannan,et al.  Spatial smoothing based segmentation method for internal defect detection in X-ray images of casting components , 2017, 2017 Trends in Industrial Measurement and Automation (TIMA).