Surface Defect Detection via Entity Sparsity Pursuit With Intrinsic Priors

Computer vision based methods have been widely used in surface defect inspection. However, most of these approaches are task specific, and it is hard to transfer them to similar detection scenarios. This paper proposes an entity sparsity pursuit (ESP) method to identify surface defects. Based on the observation that surface image textures usually form a low-rank structure and the structure can be violated by the presence of rare defects, we formulate the detection task as a low-rank and ESP problem. To alleviate the feature shortage issue existed in industrial gray-scale images, we customize a kind of intuitive features for surface defect inspection. Different from previous work utilizing complicated regularization terms, we resort to mine intrinsic priors of defect images, which can be neatly incorporated into the designed architecture. The proposed model is compact and able to detect surface defects in an unsupervised manner. To fully evaluate the presented method, we conduct a series of experiments using three real-world and one synthetic defect datasets. Experimental results demonstrate that ESP outperforms state-of-the-art methods.

[1]  Jian Yang,et al.  Accurate and Efficient Inspection of Speckle and Scratch Defects on Surfaces of Planar Products , 2017, IEEE Transactions on Industrial Informatics.

[2]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[3]  Bing Li,et al.  Salient Object Detection via Structured Matrix Decomposition. , 2017, IEEE transactions on pattern analysis and machine intelligence.

[4]  Ari Ide-Ektessabi,et al.  A Contrast Adjustment Thresholding Method for Surface Defect Detection Based on Mesoscopy , 2015, IEEE Transactions on Industrial Informatics.

[5]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[6]  Shiqian Wu,et al.  Double Low-Rank and Sparse Decomposition for Surface Defect Segmentation of Steel Sheet , 2018, Applied Sciences.

[7]  Zhigang Liu,et al.  Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network , 2018, IEEE Transactions on Instrumentation and Measurement.

[8]  Daniel W. Apley,et al.  A Monitoring and Diagnostic Approach for Stochastic Textured Surfaces , 2018, Technometrics.

[9]  Zhi Liu,et al.  Segmentation Driven Low-rank Matrix Recovery for Saliency Detection , 2013, BMVC.

[10]  Feiping Nie,et al.  Efficient and Robust Feature Selection via Joint ℓ2, 1-Norms Minimization , 2010, NIPS.

[11]  Weisi Lin,et al.  Saliency-Based Defect Detection in Industrial Images by Using Phase Spectrum , 2014, IEEE Transactions on Industrial Informatics.

[12]  Mohammad R. Jahanshahi,et al.  NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion , 2018, IEEE Transactions on Industrial Electronics.

[13]  Hong Zhang,et al.  Automatic Visual Defect Detection Using Texture Prior and Low-Rank Representation , 2018, IEEE Access.

[14]  Ajay Kumar,et al.  Defect detection in textured materials using optimized filters , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[15]  Qingyong Li,et al.  A Hierarchical Extractor-Based Visual Rail Surface Inspection System , 2017, IEEE Sensors Journal.

[16]  Ying Tian,et al.  Steel Surface Defect Detection Using a New Haar–Weibull-Variance Model in Unsupervised Manner , 2017, IEEE Transactions on Instrumentation and Measurement.

[17]  Jiang Honghai,et al.  Detection of surface crack defects on ferrite magnetic tile , 2014 .

[18]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Antonio Criminisi,et al.  TextonBoost for Image Understanding: Multi-Class Object Recognition and Segmentation by Jointly Modeling Texture, Layout, and Context , 2007, International Journal of Computer Vision.

[20]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[21]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Yunhui Yan,et al.  A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects , 2013 .

[23]  Junfeng Yang,et al.  A Fast Algorithm for Edge-Preserving Variational Multichannel Image Restoration , 2009, SIAM J. Imaging Sci..

[24]  Andrew Zisserman,et al.  A Statistical Approach to Texture Classification from Single Images , 2004, International Journal of Computer Vision.

[25]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[26]  Jie Zhang,et al.  Fabric defect inspection using prior knowledge guided least squares regression , 2017, Multimedia Tools and Applications.

[27]  M. Mirmehdi,et al.  TEXEMS: Texture Exemplars for Defect Detection on Random Textured Surfaces , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Kay Chen Tan,et al.  A Generic Deep-Learning-Based Approach for Automated Surface Inspection , 2018, IEEE Transactions on Cybernetics.

[29]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[30]  Jayanta K. Chandra,et al.  Detection of defects in fabrics using subimage-based singular value decomposition , 2013 .

[31]  Du-Ming Tsai,et al.  Defect Detection in Solar Modules Using ICA Basis Images , 2013, IEEE Transactions on Industrial Informatics.

[32]  Ying Wu,et al.  A unified approach to salient object detection via low rank matrix recovery , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Hao Yan,et al.  Anomaly Detection in Images With Smooth Background via Smooth-Sparse Decomposition , 2017, Technometrics.

[34]  Xianqiang Yang,et al.  Corner Point-Based Coarse–Fine Method for Surface-Mount Component Positioning , 2018, IEEE Transactions on Industrial Informatics.

[35]  Yibin Huang,et al.  Surface defect saliency of magnetic tile , 2018, The Visual Computer.

[36]  Nathan Halko,et al.  Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions , 2009, SIAM Rev..

[37]  Qingling Li,et al.  Automatic Detection of Defects in Tire Radiographic Images , 2017, IEEE Transactions on Automation Science and Engineering.