Automatic Fabric Defect Detection Based on an Improved YOLOv5

Fabric defect detection is particularly remarkable because of the large textile production demand in China. Traditional manual detection method is inefficient, time-consuming, laborious, and costly. A deep learning technique is proposed in this work to perform automatic fabric defect detection by improving a YOLOv5 object detection algorithm. A teacher-student architecture is used to handle the shortage of fabric defect images. Specifically, a deep teacher network could precisely recognize fabric defects. After information distillation, a shallow student network could do the same thing in real-time with minimal performance degeneration. Moreover, multitask learning is introduced by simultaneously detecting ubiquitous and specific defects. Focal loss function and central constraints are introduced to improve the recognition performance. Evaluations are performed on the publicly available Tianchi AI and TILDA databases. Results indicate that the proposed method performs well compared with other methods and has excellent defect detection ability in the collected textile images.

[1]  Muhammad Umair Hassan,et al.  Tyre Defect Detection Based on GLCM and Gabor Filter , 2019, 2019 22nd International Multitopic Conference (INMIC).

[2]  Junfeng Jing,et al.  Fabric defect detection using the improved YOLOv3 model , 2020 .

[3]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Jinjiang Wang,et al.  Machine vision intelligence for product defect inspection based on deep learning and Hough transform , 2019, Journal of Manufacturing Systems.

[5]  Tanuja Sarode,et al.  Fabric Defect Detection Adopting Combined GLCM, Gabor Wavelet Features and Random Decision Forest , 2019, 3D Research.

[6]  Michel Cattoen,et al.  Automatic inspection of simply patterned material in the textile industry , 1994, Electronic Imaging.

[7]  Chi-Ho Chan,et al.  Fabric defect detection by Fourier analysis , 1999, Conference Record of the 1999 IEEE Industry Applications Conference. Thirty-Forth IAS Annual Meeting (Cat. No.99CH36370).

[8]  Muhammad Tariq Mahmood,et al.  Fabric Defect Detection Using Computer Vision Techniques: A Comprehensive Review , 2020 .

[9]  Zhenjie Hou,et al.  Fabric defect inspection based on lattice segmentation and Gabor filtering , 2017, Neurocomputing.

[10]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[11]  Safa Sadaghiyanfam,et al.  Using gray-level-co-occurrence matrix and wavelet transform for textural fabric defect detection: A comparison study , 2018, 2018 Electric Electronics, Computer Science, Biomedical Engineerings' Meeting (EBBT).

[12]  Guohua Liu,et al.  Fabric defect detection based on information entropy and frequency domain saliency , 2020, Vis. Comput..

[13]  Jun Li,et al.  A Fast Monochromatic Fabric Defect Fast Detection Method Based on Convolutional Neural Network , 2018 .

[14]  Hao Ma,et al.  Automatic fabric defect detection using a deep convolutional neural network , 2019, Coloration Technology.

[15]  Georg Heigold,et al.  Object-Centric Learning with Slot Attention , 2020, NeurIPS.

[16]  Guojun Wen,et al.  Automatic Fabric Defect Detection with a Multi-Scale Convolutional Denoising Autoencoder Network Model , 2018, Sensors.

[17]  Grantham Pang,et al.  Discriminative training approaches to fabric defect classification based on wavelet transform , 2004, Pattern Recognit..

[18]  Pradeep M. Patil,et al.  A review of automatic fabric defect detection techniques , 2009 .

[19]  Yingfeng Cai,et al.  Crossing or Not? Context-Based Recognition of Pedestrian Crossing Intention in the Urban Environment , 2021, IEEE Transactions on Intelligent Transportation Systems.

[20]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[21]  Jie Zhang,et al.  Fabric defect inspection using prior knowledge guided least squares regression , 2017, Multimedia Tools and Applications.

[22]  Nadia Baaziz,et al.  Automatic Fabric Defect Detection Using Learning-Based Local Textural Distributions in the Contourlet Domain , 2018, IEEE Transactions on Automation Science and Engineering.

[23]  Yuan Ye.  Fabric Defect Detection Using Fuzzy Inductive Reasoning Based on Image Histogram Statistic Variables , 2009, 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery.

[24]  Jian Sun,et al.  Object Detection Networks on Convolutional Feature Maps , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Xiaofeng Liu,et al.  Counting crowds using a scale-distribution-aware network and adaptive human-shaped kernel , 2020, Neurocomputing.

[26]  Xiaojun Jia,et al.  Fabric defect detection based on open source computer vision library OpenCV , 2010, 2010 2nd International Conference on Signal Processing Systems.

[27]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Jameel Ahmed,et al.  Content-Based Image Retrieval and Feature Extraction: A Comprehensive Review , 2019, Mathematical Problems in Engineering.

[29]  Bing Wei,et al.  Fabric Defect Detection Based on Faster RCNN , 2018, Artificial Intelligence on Fashion and Textiles.

[30]  Xuejuan Kang,et al.  A Universal and Adaptive Fabric Defect Detection Algorithm Based on Sparse Dictionary Learning , 2020, IEEE Access.

[31]  Hai Su,et al.  Multistage GAN for Fabric Defect Detection , 2019, IEEE Transactions on Image Processing.

[32]  Jing Wang,et al.  Fabric defect detection using Gabor filters and defect classification based on LBP and Tamura method , 2013 .

[33]  Jian Zhou,et al.  Dictionary learning framework for fabric defect detection , 2014 .

[34]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[35]  K. Srinivasan,et al.  FDAS: A Knowledge-based Framework for Analysis of Defects in Woven Textile Structures , 1992 .

[36]  De Xu,et al.  Automatic Metallic Surface Defect Detection and Recognition with Convolutional Neural Networks , 2018, Applied Sciences.

[37]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Yang Chen,et al.  A Novel Graph-Based Trajectory Predictor With Pseudo-Oracle , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[40]  Anna Kuznetsova,et al.  Detecting Apples in Orchards Using YOLOv3 and YOLOv5 in General and Close-Up Images , 2020, ISNN.