Unsupervised fabric defect detection based on a deep convolutional generative adversarial network

Detecting and locating surface defects in textured materials is a crucial but challenging problem due to factors such as texture variations and lack of adequate defective samples prior to testing. In this paper we present a novel unsupervised method for automatically detecting defects in fabrics based on a deep convolutional generative adversarial network (DCGAN). The proposed method extends the standard DCGAN, which consists of a discriminator and a generator, by introducing a new encoder component. With the assistance of this encoder, our model can reconstruct a given query image such that no defects but only normal textures will be preserved in the reconstruction. Therefore, when subtracting the reconstruction from the original image, a residual map can be created to highlight potential defective regions. Besides, our model generates a likelihood map for the image under inspection where each pixel value indicates the probability of occurrence of defects at that location. The residual map and the likelihood map are then synthesized together to form an enhanced fusion map. Typically, the fusion map exhibits uniform gray levels over defect-free regions but distinct deviations over defective areas, which can be further thresholded to produce a binarized segmentation result. Our model can be unsupervisedly trained by feeding with a set of small-sized image patches picked from a few defect-free examples. The training is divided into several successively performed stages, each under an individual training strategy. The performance of the proposed method has been extensively evaluated by a variety of real fabric samples. The experimental results in comparison with other methods demonstrate its effectiveness in fabric defect detection.

[1]  Du-Ming Tsai,et al.  Wavelet-based defect detection in solar wafer images with inhomogeneous texture , 2012, Pattern Recognit..

[2]  Muhammed Fatih Talu,et al.  Fabric defect detection systems and methods—A systematic literature review , 2016 .

[3]  Halil İbrahim Çelik,et al.  Development of a machine vision system: real-time fabric defect detection and classification with neural networks , 2014 .

[4]  Jihong Liu,et al.  Seam detection of inhomogeneously textured fabrics based on wavelet transform , 2015 .

[5]  Junfeng Jing,et al.  Patterned fabric defect detection via convolutional matching pursuit dual-dictionary , 2016 .

[6]  Du-Ming Tsai,et al.  Automated surface inspection for directional textures , 1999, Image Vis. Comput..

[7]  Mohammed Bennamoun,et al.  Optimal Gabor filters for textile flaw detection , 2002, Pattern Recognit..

[8]  Paolo Valigi,et al.  Automated defect detection in uniform and structured fabrics using Gabor filters and PCA , 2013, J. Vis. Commun. Image Represent..

[9]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[10]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[11]  Chunlei Li,et al.  Fabric defect detection algorithm based on Gabor filter and low-rank decomposition , 2016, International Conference on Digital Image Processing.

[12]  Guojun Wen,et al.  Automatic Fabric Defect Detection with a Multi-Scale Convolutional Denoising Autoencoder Network Model , 2018, Sensors.

[13]  Junfeng Jing,et al.  Fabric defect detection based on multi-scale wavelet transform and Gaussian mixture model method , 2015 .

[14]  Pengfei Li,et al.  Yarn-dyed fabric defect classification based on convolutional neural network , 2017 .

[15]  Lapo Governi,et al.  Machine vision tool for real-time detection of defects on textile raw fabrics , 2008 .

[16]  N. H. C. Yung,et al.  Automated fabric defect detection - A review , 2011, Image Vis. Comput..

[17]  Georg Langs,et al.  Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery , 2017, IPMI.

[18]  Grantham Pang,et al.  Regularity Analysis for Patterned Texture Inspection , 2009, IEEE Transactions on Automation Science and Engineering.

[19]  Minh N. Do,et al.  Semantic Image Inpainting with Perceptual and Contextual Losses , 2016, ArXiv.

[20]  Michael K. Ng,et al.  Patterned Fabric Inspection and Visualization by the Method of Image Decomposition , 2014, IEEE Transactions on Automation Science and Engineering.

[21]  ChaYoung-Jin,et al.  Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks , 2017 .

[22]  P. Nagabhushan,et al.  Automatic Detection of Texture Defects Using Texture-Periodicity and Gabor Wavelets , 2011, ArXiv.

[23]  Junfeng Jing,et al.  Yarn-dyed fabric defect classification based on convolutional neural network , 2017, International Conference on Digital Image Processing.

[24]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[25]  Junfeng Jing,et al.  Supervised defect detection on textile fabrics via optimal Gabor filter , 2014 .

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  Allan Hanbury,et al.  Finding defects in texture using regularity and local orientation , 2002, Pattern Recognit..

[28]  Ajay Kumar,et al.  Neural network based detection of local textile defects , 2003, Pattern Recognit..

[29]  Tae Jin Kang,et al.  Automated defect detection system using wavelet packet frame and Gaussian mixture model. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[30]  Oral Büyüköztürk,et al.  Autonomous Structural Visual Inspection Using Region‐Based Deep Learning for Detecting Multiple Damage Types , 2018, Comput. Aided Civ. Infrastructure Eng..

[31]  Qiuping Zhu,et al.  Fabric defect detection via small scale over-complete basis set , 2014 .

[32]  Jaume Escofet,et al.  Referenceless segmentation of flaws in woven fabrics. , 2007, Applied optics.

[33]  Jian Zhou,et al.  Dictionary learning framework for fabric defect detection , 2014 .

[34]  Hua Yang,et al.  An Unsupervised-Learning-Based Approach for Automated Defect Inspection on Textured Surfaces , 2018, IEEE Transactions on Instrumentation and Measurement.

[35]  Yundong Li,et al.  Deformable Patterned Fabric Defect Detection With Fisher Criterion-Based Deep Learning , 2017, IEEE Transactions on Automation Science and Engineering.