One class based feature learning approach for defect detection using deep autoencoders

Abstract Detecting defects is an integral part of any manufacturing process. Most works still utilize traditional image processing algorithms to detect defects owing to the complexity and variety of products and manufacturing environments. In this paper, we propose an approach based on deep learning which uses autoencoders for extraction of discriminative features. It can detect different defects without using any defect samples during training. This method, where samples of only one class (i.e. defect-free samples) are available for training, is called One Class Classification (OCC). This OCC method can also be used for training a neural network when only one golden sample is available by generating many copies of the reference image by data augmentation. The trained model is then able to generate a descriptor—a unique feature vector of an input image. A test image captured by an Automatic Optical Inspection (AOI) camera is sent to the trained model to generate a test descriptor, which is compared with a reference descriptor to obtain a similarity score. After comparing the results of this method with a popular traditional similarity matching method SIFT, we find that in the most cases this approach is more effective and more flexible than the traditional image processing-based methods, and it can be used to detect different types of defects with minimum customization.

[1]  Weisi Lin,et al.  Saliency-Based Defect Detection in Industrial Images by Using Phase Spectrum , 2014, IEEE Transactions on Industrial Informatics.

[2]  Zuwairie Ibrahim,et al.  AN ALGORITHM TO GROUP DEFECTS ON PRINTED CIRCUIT BOARD FOR AUTOMATED VISUAL INSPECTION , 2008 .

[3]  Jason Weston,et al.  Semisupervised Neural Networks for Efficient Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Nicolaos B. Karayiannis,et al.  Detection of microcalcifications in digital mammograms using wavelets , 1998, IEEE Transactions on Medical Imaging.

[5]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[6]  Xiaodong Gu,et al.  A Surface Defect Detection Based on Convolutional Neural Network , 2017, ICVS.

[7]  Syed Abdul Rahman Syed Abu Bakar,et al.  An algorithm for classification of five types of defects on bare printed circuit board , 2008 .

[8]  Vincent Leemans,et al.  A real-time grading method of apples based on features extracted from defects , 2004 .

[9]  Olli Silvén,et al.  Wood Inspection With Non-Supervised Clustering , 2000 .

[10]  Domenec Puig,et al.  Pixel Classification by Divergence-Based Integration of Multiple Texture Methods and Its Application to Fabric Defect Detection , 2003, DAGM-Symposium.

[11]  Z. Ibrahim,et al.  Printed circuit board defect detection using mathematical morphology and MATLAB image processing tools , 2010, 2010 2nd International Conference on Education Technology and Computer.

[12]  Hong Liu,et al.  Improved bare PCB defect detection approach based on deep feature learning , 2018, The Journal of Engineering.

[13]  Yujie Li,et al.  Railway track fastener defect detection based on image processing and deep learning techniques: A comparative study , 2019, Eng. Appl. Artif. Intell..

[14]  B. Suvdaa,et al.  Steel Surface Defects Detection and Classification Using SIFT and Voting Strategy , 2012 .

[15]  Mathias Lux,et al.  Dimensionality Reduction for Image Features using Deep Learning and Autoencoders , 2017, CBMI.

[16]  Mohammed Bennamoun,et al.  Optimal Gabor filters for textile flaw detection , 2002, Pattern Recognit..

[17]  Erhardt Barth,et al.  Non-parametric texture defect detection using Weibull features , 2011, Electronic Imaging.

[18]  Lipo Wang,et al.  Deep Learning Applications in Medical Image Analysis , 2018, IEEE Access.

[19]  Maziah Mohamad,et al.  MATLAB based defect detection and classification of printed circuit board , 2012, 2012 Second International Conference on Digital Information and Communication Technology and it's Applications (DICTAP).

[20]  J.S.Chitode,et al.  Metal Surface Inspection for Defect Detectionand Classification using Gabor Filter , 2014 .

[21]  Jürgen Schmidhuber,et al.  Steel defect classification with Max-Pooling Convolutional Neural Networks , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[22]  Josef Kittler,et al.  Texture crack detection , 2005, Machine Vision and Applications.

[23]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[24]  Alexandru Telea,et al.  An Image Inpainting Technique Based on the Fast Marching Method , 2004, J. Graphics, GPU, & Game Tools.

[25]  Hichem Snoussi,et al.  A fast and robust convolutional neural network-based defect detection model in product quality control , 2017, The International Journal of Advanced Manufacturing Technology.

[26]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.