Computer-Vision-Based Fabric Defect Detection: A Survey

The investment in an automated fabric defect detection system is more than economical when reduction in labor cost and associated benefits are considered. The development of a fully automated web inspection system requires robust and efficient fabric defect detection algorithms. The inspection of real fabric defects is particularly challenging due to the large number of fabric defect classes, which are characterized by their vagueness and ambiguity. Numerous techniques have been developed to detect fabric defects and the purpose of this paper is to categorize and/or describe these algorithms. This paper attempts to present the first survey on fabric defect detection techniques presented in about 160 references. Categorization of fabric defect detection techniques is useful in evaluating the qualities of identified features. The characterization of real fabric surfaces using their structure and primitive set has not yet been successful. Therefore, on the basis of the nature of features from the fabric surfaces, the proposed approaches have been characterized into three categories; statistical, spectral and model-based. In order to evaluate the state-of-the-art, the limitations of several promising techniques are identified and performances are analyzed in the context of their demonstrated results and intended application. The conclusions from this paper also suggest that the combination of statistical, spectral and model-based approaches can give better results than any single approach, and is suggested for further research.

[1]  T. John Stonham,et al.  Surface inspection using texture recognition , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[2]  Mário A. T. Figueiredo,et al.  Defect Detection in Textile Images Using Gabor Filters , 2004, ICIAR.

[3]  Anil K. Jain,et al.  A Rule Based Approach for Visual Pattern Inspection , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  David Casasent,et al.  Practical Optical Fourier Analysis For High Speed Inspection , 1988 .

[5]  Umer Farooq,et al.  Machine vision using image data feedback for fault detection in complex deformable webs , 2004 .

[6]  Harsh Potlapalli,et al.  Image Analysis of Mispicks in Woven Fabric , 1995 .

[7]  Asit K. Datta,et al.  Detecting Defects in Fabric with Laser-Based Morphological Image Processing , 2000 .

[8]  Michel Cattoen,et al.  Automatic inspection of simply patterned material in the textile industry , 1994, Electronic Imaging.

[9]  Ajay Kumar,et al.  Inspection of surface defects using optimal FIR filters , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[10]  N. H. C. Yung,et al.  Fabric defect detection using adaptive wavelet , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[11]  C. W. Therrien,et al.  Decision, Estimation and Classification: An Introduction to Pattern Recognition and Related Topics , 1989 .

[12]  J. L. Dorrity,et al.  On-line defect detection for weaving systems , 1996, 1996 IEEE Annual Textile, Fiber and Film Industry Technical Conference.

[13]  Grantham Pang,et al.  Discriminative training approaches to fabric defect classification based on wavelet transform , 2004, Pattern Recognit..

[14]  Jeng-Jong Lin,et al.  Application of fuzzy set theory to diagnosis system for tracing breakdown causes in weaving , 1995, Proceedings IEEE Conference on Industrial Automation and Control Emerging Technology Applications.

[15]  M. Mufti,et al.  Automated fault detection and identification using a fuzzy-wavelet analysis technique , 1995, Conference Record AUTOTESTCON '95. 'Systems Readiness: Test Technology for the 21st Century'.

[16]  Zhigang Fan,et al.  Automated Inspection of Textile Fabrics Using Textural Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Mohammed Bennamoun,et al.  A constrained minimisation approach to optimise Gabor filters for detecting flaws in woven textiles , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[18]  Helen C. Shen,et al.  Texture inspection for defects using neural networks and support vector machines , 2002, Proceedings. International Conference on Image Processing.

[19]  PeiFeng Zeng,et al.  On-loom fabric inspection using multi-scale differentiation filtering , 2002, Conference Record of the 2002 IEEE Industry Applications Conference. 37th IAS Annual Meeting (Cat. No.02CH37344).

[20]  Thanos Stouraitis,et al.  Defect detection and classification on web textile fabric using multiresolution decomposition and neural networks , 1999, ICECS'99. Proceedings of ICECS '99. 6th IEEE International Conference on Electronics, Circuits and Systems (Cat. No.99EX357).

[21]  Horst A. Beyer,et al.  Performance analysis of CCD cameras for industrial inspection , 1993, Other Conferences.

[22]  Aura Conci,et al.  A Computer Vision Approach for Textile Inspection , 2000 .

[23]  Fionn Murtagh,et al.  Flaw Detection In Woven Textiles using Space-dependent Fourier Transform , 1997 .

[24]  E. R. Davies,et al.  Machine vision - theory, algorithms, practicalities , 2004 .

[25]  Aura Conci,et al.  A fractal image analysis system for fabric inspection based on a box-counting method , 1998, Comput. Networks.

[26]  Aysin Ertüzün,et al.  Using perceptual relation of regularity and anisotropy in the texture with independent component model for defect detection , 2007, Pattern Recognit..

[27]  Kenneth W. Tobin,et al.  Imaging tristimulus colorimeter for the evaluation of color in printed textiles , 1999, Electronic Imaging.

[28]  Hamed Sari-Sarraf,et al.  Online optical measurement and monitoring of yarn density in woven fabrics , 1996, Other Conferences.

[29]  Harsh Potlapalli,et al.  Texture characterization and defect detection using adaptive wavelets , 1996 .

[30]  S. Ozdemir,et al.  Markov random fields and Karhunen-Loeve transforms for defect inspection of textile products , 1996, Proceedings 1996 IEEE Conference on Emerging Technologies and Factory Automation. ETFA '96.

[31]  G. Longobardi,et al.  Neural networks for the optical recognition of defects in cloth , 1996 .

[32]  Anil K. Jain,et al.  Markov Random Field Texture Models , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Richard W. Conners,et al.  Identifying and Locating Surface Defects in Wood: Part of an Automated Lumber Processing System , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Petra Perner,et al.  A knowledge-based image-inspection system for automatic defect recognition, classification, and process diagnosis , 1994, Machine Vision and Applications.

[35]  Giuseppe Longobardi,et al.  Weaving defect detection by Fourier imaging , 1996, Other Conferences.

[36]  Anil K. Jain,et al.  A Survey of Automated Visual Inspection , 1995, Comput. Vis. Image Underst..

[37]  Allan Hanbury,et al.  Finding defects in texture using regularity and local orientation , 2002, Pattern Recognit..

[38]  K. Srinivasan,et al.  FDAS: A Knowledge-based Framework for Analysis of Defects in Woven Textile Structures , 1992 .

[39]  Jeng-Jong Lin,et al.  Applying an Artificial Neural Network to Pattern Recognition in Fabric Defects , 1995 .

[40]  Jeffrey A. Joines,et al.  Fabric defect detection using a genetic algorithm tuned wavelet filter , 2005 .

[41]  S. Zucker,et al.  Finding structure in Co-occurrence matrices for texture analysis , 1980 .

[42]  Aytül Erçil,et al.  Independent component analysis for texture defect detection , 2004 .

[43]  Koichi Hashimoto,et al.  Toward automated inspection of textile surfaces: removing the textural information by using wavelet shrinkage , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[44]  I. D. Longstaff,et al.  Improving Co-occurrence Matrix Feature Discrimination , 1995 .

[45]  J. Huart,et al.  Integration of computer vision onto weavers for quality control in the textile industry , 1994, Electronic Imaging.

[46]  L. Norton-Wayne,et al.  The automated inspection of lace using machine vision , 1995 .

[47]  Adrian E. Raftery,et al.  Linear flaw detection in woven textiles using model-based clustering , 1997, Pattern Recognit. Lett..

[48]  Giuseppe Longobardi,et al.  Defect detection in textured materials by optical filtering with structured detectors and self‐adaptable masks , 1996 .

[49]  Mark Bradshaw,et al.  The application of machine vision to the automated inspection of knitted fabrics , 1995 .

[50]  Ajay Kumar.  Automated inspection of textured web materials using real Gabor functions , 2002, Other Conferences.

[51]  Leonard Norton-Wayne,et al.  Machine vision for the automated inspection of web materials , 1993, Other Conferences.

[52]  Zhigang Fan,et al.  Rotation and scale invariant texture classification , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[53]  R.M. Haralick,et al.  Statistical and structural approaches to texture , 1979, Proceedings of the IEEE.

[54]  Giuseppe Longobardi,et al.  On-line textile quality control using optical Fourier transforms , 1996 .

[55]  Georg Lambert,et al.  Wavelet methods for texture defect detection , 1997, Proceedings of International Conference on Image Processing.

[56]  Phil Brodatz,et al.  Textures: A Photographic Album for Artists and Designers , 1966 .

[57]  T. G. King,et al.  Modified Hough transforms for feature recognition on deformable patterned materials , 1994, Image Vis. Comput..

[58]  I. Tsai,et al.  Automatic Inspection of Fabric Defects Using an Artificial Neural Network Technique , 1996 .

[59]  Bruce G. Batchelor,et al.  Automated Visual Inspection , 1985 .

[60]  R Scanne,et al.  Automated Visual Inspection: A Survey , 1982 .

[61]  Che-Seung Cho,et al.  Development of real-time vision-based fabric inspection system , 2005, IEEE Transactions on Industrial Electronics.

[62]  R. Bracewell.  The Fourier Transform and Its Applications , 1966 .

[63]  Li Tao,et al.  Machine vision in the inspection of patterned textile webs , 1997 .

[64]  A. Ertuzun,et al.  Texture defect detection using subband domain co-occurrence matrices , 1998, 1998 IEEE Southwest Symposium on Image Analysis and Interpretation (Cat. No.98EX165).

[65]  Grantham K. H. Pang,et al.  Discriminative fabric defect detection using adaptive wavelets , 2002 .

[66]  S. Fioravanti,et al.  A system for automated visual inspection of ceramic tiles , 1993, Proceedings of IECON '93 - 19th Annual Conference of IEEE Industrial Electronics.

[67]  Muid Ur-Rahman Mufti,et al.  Fault detection and identification using fuzzy wavelets , 1995 .

[68]  Sudeep Sarkar,et al.  Robust Visual Method for Assessing the Relative Performance of Edge-Detection Algorithms , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[69]  Mohammed Bennamoun,et al.  Defect detection in textile materials based on aspects of the HVS , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[70]  Fernand S. Cohen,et al.  Surface Inspection Based On Stochastic Modelling , 1986, Other Conferences.

[71]  Seung-Woo Kim,et al.  Rapid pattern inspection of shadow masks by machine vision integrated with Fourier optics , 1997 .

[72]  Alper Baykut,et al.  Real-time Defect Inspection of Textured Surfaces , 2000, Real Time Imaging.

[73]  Mohammed Bennamoun,et al.  Automatic visual inspection and flaw detection in textile materials: past, present and future , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[74]  A. Ertuzun,et al.  Defect detection in textile fabric images using wavelet transforms and independent component analysis , 2006, Pattern Recognition and Image Analysis.

[75]  Asit K. Datta,et al.  Defect Detection in Fabrics with a Joint Transform Correlation Technique: Theoretical Basis and Simulation , 1999 .

[76]  Ajay Kumar,et al.  Wavelet-based Detection of Local Textile Defects , 2001 .

[77]  Torfinn Taxt,et al.  Local frequency features for texture classification , 1994, Pattern Recognit..

[78]  Ajay Kumar,et al.  Neural network based detection of local textile defects , 2003, Pattern Recognit..

[79]  George J. Vachtsevanos,et al.  In-Process Fabric Defect Detection and Identification , 1998 .

[80]  Du-Ming Tsai,et al.  Automated surface inspection for directional textures , 1999, Image Vis. Comput..

[81]  Michael Unser,et al.  Feature extraction and decision procedure for automated inspection of textured materials , 1984, Pattern Recognit. Lett..

[82]  Du-Ming Tsai,et al.  Defect detection in textured surfaces using color ring-projection correlation , 2003, Machine Vision and Applications.

[83]  Roland T. Chin,et al.  Automated visual inspection: 1981 to 1987 , 1988, Computer Vision Graphics and Image Processing.

[84]  Josef Kittler,et al.  Color grading of randomly textured ceramic tiles using color histograms , 1999, IEEE Trans. Ind. Electron..

[85]  Stavros A. Koubias,et al.  Real-Time Vision-Based System for Textile Fabric Inspection , 2001, Real Time Imaging.

[86]  Gerard Lacey,et al.  Industrial inspection using Gaussian functions in a colour space , 2000, Image Vis. Comput..

[87]  Hannu Kauppinen.  A two stage defect recognition method for parquet slab grading , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[88]  James S. Goddard,et al.  Facet model and mathematical morphology for surface characterization , 1999, Optics East.

[89]  Josef Kittler,et al.  Texture crack detection , 2005, Machine Vision and Applications.

[90]  Frank Ade,et al.  Application Of Principal Component Analysis To The Inspection Of Industrial Goods , 1983, Other Conferences.

[91]  Xuezhi Yang,et al.  Discriminative fabric defect detection and classification using adaptive wavelet , 2003 .

[92]  H.R Yazdi,et al.  Application of 'vision in the loop' for inspection of lace fabric , 1998, Real Time Imaging.

[93]  Jaume Escofet,et al.  Detection of local defects in textile webs using Gabor filters , 1996, Other Conferences.

[94]  Jonathan G. Campbell,et al.  Automatic visual inspection of woven textiles using a two-stage defect detector , 1998 .

[95]  Bo Hsiao,et al.  Automatic surface inspection using wavelet reconstruction , 2001, Pattern Recognit..

[96]  Marco Branciforte,et al.  Defects detection and characterization by using cellular neural networks , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[97]  Hamed Sari-Sarraf,et al.  A generalized development environment for inspection of web materials , 1997, Proceedings of International Conference on Robotics and Automation.

[98]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[99]  Mohammed Bennamoun,et al.  Optimal textural features for flaw detection in textile materials , 1997, TENCON '97 Brisbane - Australia. Proceedings of IEEE TENCON '97. IEEE Region 10 Annual Conference. Speech and Image Technologies for Computing and Telecommunications (Cat. No.97CH36162).

[100]  A. Kumar,et al.  Real time DSP based identification of surface defects using content-based imaging technique , 2000, Proceedings of IEEE International Conference on Industrial Technology 2000 (IEEE Cat. No.00TH8482).

[101]  Richard W. Conners,et al.  A Theoretical Comparison of Texture Algorithms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[102]  Matti Pietikäinen,et al.  Real-time surface inspection by texture , 2003, Real Time Imaging.

[103]  C. Neubauer,et al.  Segmentation of defects in textile fabric , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[104]  L. H. C. Tippett,et al.  QUALITY CONTROL IN THE TEXTILE INDUSTRY , 1947 .

[105]  J. Gresser,et al.  Real-Time Fault Detection on Textiles Using Opto-electronic Processing , 1993 .

[106]  Graham A. Jullien,et al.  PC-based real-time defect imaging system for high-speed web inspection , 1993, Electronic Imaging.

[107]  Michael G. Thomason,et al.  Syntactic Pattern Recognition, An Introduction , 1978, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[108]  Chang-Chiun Huang,et al.  Neural-Fuzzy Classification for Fabric Defects , 2001 .

[109]  John D. Holt,et al.  Real-time Industrial Visual Inspection: A Review , 1995, Real Time Imaging.

[110]  Michel Robert,et al.  An edge detection ASIC for real time defect detection , 1992, [1992] Proceedings. Fifth Annual IEEE International ASIC Conference and Exhibit.

[111]  Ryan G. Rosandich.  Intelligent visual inspection , 1996 .

[112]  Dmitry Chetverikov.  Pattern regularity as a visual key , 2000, Image Vis. Comput..

[113]  Len Norton-Wayne,et al.  Machine Vision Inspection of Web Textile Fabric , 1992, BMVC.

[114]  Sungshin Kim,et al.  Wavelet analysis to fabric defects detection in weaving processes , 1999, ISIE '99. Proceedings of the IEEE International Symposium on Industrial Electronics (Cat. No.99TH8465).

[115]  Hamed Sari-Sarraf,et al.  Automated inspection of nonwoven web materials: a case study , 1994, Electronic Imaging.

[116]  Gkh Pang,et al.  CAVIS: A Low-cost Fabric Defect Inspection Machine based on Machine Vision , 2001 .

[117]  Ajay Kumar,et al.  Defect detection in textured materials using Gabor filters , 2000, Conference Record of the 2000 IEEE Industry Applications Conference. Thirty-Fifth IAS Annual Meeting and World Conference on Industrial Applications of Electrical Energy (Cat. No.00CH37129).

[118]  Randall R. Bresee,et al.  Fabric Defect Detection and Classification Using Image Analysis , 1995 .

[119]  Chi-Ho Chan,et al.  Fabric defect detection by Fourier analysis , 1999, Conference Record of the 1999 IEEE Industry Applications Conference. Thirty-Forth IAS Annual Meeting (Cat. No.99CH36370).

[120]  Duncan Wilson,et al.  Using uncertainty techniques to aid defect classification in an automated visual inspection system , 1997 .

[121]  Sonomatic Ltd,et al.  Ultrasonic imaging system , 1991 .

[122]  Fumio Harashima,et al.  Development of an Automatic Stencil Inspection System Using Modified Hough Transform and Fuzzy Logic , 2007, IEEE Transactions on Industrial Electronics.

[123]  Antonios Liakopoulos,et al.  Approach to quality control of texture web materials , 1995, Optics East.

[124]  G. Pang,et al.  Identification of surface defects in textured materials using wavelet packets , 2001, Conference Record of the 2001 IEEE Industry Applications Conference. 36th IAS Annual Meeting (Cat. No.01CH37248).

[125]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[126]  Pengfei Shi,et al.  An adaptive level-selecting wavelet transform for texture defect detection , 2007, Image Vis. Comput..

[127]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[128]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[129]  Amirhassan Monadjemi,et al.  Towards efficient texture classification and abnormality detection , 2004 .

[130]  Ajay Kumar,et al.  Defect detection in textured materials using optimized filters , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[131]  Ludovic Macaire,et al.  Flaw detection on galvanized metallic strips in real time by adaptive thresholding , 1993, Other Conferences.

[132]  Majid Mirmehdi,et al.  Restructured Eigenfilter Matching for Novelty Detection in Random Textures , 2004, BMVC.

[133]  E. R. Davies,et al.  Machine vision - theory, algorithms, practicalities (2. ed.) , 1997 .

[134]  Robert M. Hodgson,et al.  Texture Measures for Carpet Wear Assessment , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[135]  Ajay Kumar,et al.  Fabric defect segmentation using multichannel blob detectors , 2000 .

[136]  Errol J. Wood,et al.  Applying Fourier and Associated Transforms to Pattern Characterization in Textiles , 1990 .

[137]  Josef Kittler,et al.  Chromato-structural approach toward surface defect detection in random textured images , 1994, Electronic Imaging.

[138]  Mohammed Bennamoun,et al.  Automatic flaw detection in textiles using a Neyman-Pearson detector , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[139]  James S. Goddard,et al.  Vision system for on-loom fabric inspection , 1999 .

[140]  Francesco G. B. De Natale.  Rank-Order Functions for The Fast Detection of Texture Faults , 1996, Int. J. Pattern Recognit. Artif. Intell..

[141]  Mohammed Bennamoun,et al.  Optimal Gabor filters for textile flaw detection , 2002, Pattern Recognit..

[142]  Mohammed Bennamoun,et al.  Textile flaw detection using optimal Gabor filters , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[143]  Dominik R. Rohrmus.  Invariant web defect detection and classification system , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).