Deep-Learning-Based Small Surface Defect Detection via an Exaggerated Local Variation-Based Generative Adversarial Network

Surface detection of small defects plays a vital role in manufacturing and has attracted broad interest. It remains challenging primarily due to the small size of the defect relative to the large surface and the rare occurrence of defects. To address this problem, in this article we propose a novel machine vision approach for automatically identifying the tiny flaws that may appear in a single image. First, the presented defect exaggeration approach produces both the flawless image and the corresponding exaggerated version of the defect by taking the variations in the image as regularization terms. Second, a generative adversarial network (GAN) in conjunction with a convolutional neural network (CNN) is proposed to guarantee the accuracy of tiny surface defect detection by producing exaggerated defect image samples. Furthermore, the limited dataset of the training samples for defect detection is enlarged by exploiting the GAN technique with the variation exaggerated images. To evaluate the performance of our proposed method, we conduct comparison experiments between the state-of-the-art techniques with and without the proposed algorithm as well as comparison experiments between the state-of-the-art techniques and our method. The experimental results on different types of surface image samples demonstrate that the proposed method can significantly improve the performance of the state-of-the-art approaches while achieving a defect detection accuracy of 99.2%.

[1]  Mingzhu Wang,et al.  Development and Improvement of Deep Learning Based Automated Defect Detection for Sewer Pipe Inspection Using Faster R-CNN , 2018, EG-ICE.

[2]  Adam Finkelstein,et al.  PairedCycleGAN: Asymmetric Style Transfer for Applying and Removing Makeup , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[3]  Z. Hocenski,et al.  The Edge Detecting Methods in Ceramic Tiles Defects Detection , 2006, 2006 IEEE International Symposium on Industrial Electronics.

[4]  J. Ayarkwa Influence of wood defects on some mechanical properties of two tropical Ghanaian hardwoods , 1999 .

[5]  Amit Patra,et al.  An object-based coding scheme for frontal surface of defective fluted ingot. , 2006, ISA transactions.

[6]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[7]  Xiaodong Gu,et al.  Fully Convolutional Networks for Surface Defect Inspection in Industrial Environment , 2017, ICVS.

[8]  Michal Irani,et al.  Blind dehazing using internal patch recurrence , 2016, 2016 IEEE International Conference on Computational Photography (ICCP).

[9]  Tom White,et al.  Generative Adversarial Networks: An Overview , 2017, IEEE Signal Processing Magazine.

[10]  Asit K. Datta,et al.  Detecting Defects in Fabric with Laser-Based Morphological Image Processing , 2000 .

[11]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[12]  Yao Zhao,et al.  Simultaneously Color-Depth Super-Resolution with Conditional Generative Adversarial Network , 2017, ArXiv.

[13]  Qiangfu Zhao,et al.  Product Surface Defect Detection Based on Deep Learning , 2018, 2018 IEEE 16th Intl Conf on Dependable, Autonomic and Secure Computing, 16th Intl Conf on Pervasive Intelligence and Computing, 4th Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).

[14]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[15]  Du-Ming Tsai,et al.  A Shift-Tolerant Dissimilarity Measure for Surface Defect Detection , 2012, IEEE Transactions on Industrial Informatics.

[16]  Ahmad Afshar,et al.  Automatic detection and classification of the ceramic tiles' surface defects , 2017, Pattern Recognit..

[17]  Luc Van Gool,et al.  Generative Adversarial Style Transfer Networks for Face Aging , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[18]  Hang Zhang,et al.  Multi-style Generative Network for Real-time Transfer , 2017, ECCV Workshops.

[19]  Hui-Fuang Ng,et al.  Automatic thresholding for defect detection , 2004, Third International Conference on Image and Graphics (ICIG'04).

[20]  Yao Zhao,et al.  Simultaneous color-depth super-resolution with conditional generative adversarial networks , 2019, Pattern Recognit..

[21]  Claudio A. Perez,et al.  A neurofuzzy color image segmentation method for wood surface defect detection , 2005 .

[22]  Xiaodong Gu,et al.  A Surface Defect Detection Based on Convolutional Neural Network , 2017, ICVS.

[23]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Y. Im,et al.  Deformation behavior of the surface defects of low carbon steel in wire rod rolling , 2008 .

[25]  Minrui Fei,et al.  A sparse representation based fast detection method for surface defect detection of bottle caps , 2014, Neurocomputing.

[26]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Chih-Yen Chen,et al.  The Internet technology for defect detection system with deep learning method in smart factory , 2018, 2018 4th International Conference on Information Management (ICIM).

[28]  Adrian Burlacu,et al.  Defect Detection in Porcelain Industry Based on Deep Learning Techniques , 2017, 2017 19th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC).

[29]  Lining Sun,et al.  Surface defect detection method for glass substrate using improved Otsu segmentation. , 2015, Applied optics.