A Review of Recent Advances in Surface Defect Detection using Texture analysis Techniques

In this paper, we systematically review recent advances in surface inspection using computer vision and image processing techniques, particularly those based on texture analysis methods. The aim is to review the state-of-the-art techniques for the purposes of visual inspection and decision making schemes that are able to discriminate the features extracted from normal and defective regions. This field is so vast that it is impossible to cover all the aspects of visual inspection. This paper focuses on a particular but important subset which generally treats visual surface inspection as texture analysis problems. Other topics related to visual inspection such as imaging system and data acquisition are out of the scope of this survey. The surface defects are loosely separated into two types. One is local textural irregularities which is the main concern for most visual surface inspection applications. The other is global deviation of colour and/or texture, where local pattern or texture does not exhibit abnormalities. We refer this type of defects as shade or tonality problem. The second type of defects have been largely neglected until recently, particularly when colour imaging system has been widely used in visual inspection and where chromatic consistency plays an important role in quality control. The emphasis of this survey though is still on detecting local abnormalities, given the fact that majority of the reported works are dealing with the first type of defects. The techniques used to inspect textural abnormalities are discussed in four categories, statistical approaches, structural approaches, filter based methods, and model based approaches, with a comprehensive list of references to some recent works. Due to rising demand and practice of colour texture analysis in application to visual inspection, those works that are dealing with colour texture analysis are discussed separately. It is also worth noting that processing vector-valued data has its unique challenges, which conventional surface inspection methods have often ignored or do not encounter. We also compare classification approaches with novelty detection approaches at the decision making stage. Classification approaches often require supervised training and usually provide better performance than novelty detection based approaches where training is only carried out on defect-free samples. However, novelty detection is relatively easier to adapt and is particularly desirable when training samples are incomplete

[1]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Mohammed Bennamoun,et al.  Optimal Gabor filters for textile flaw detection , 2002, Pattern Recognit..

[3]  Roland T. Chin,et al.  Automated visual inspection: 1981 to 1987 , 1988, Computer Vision Graphics and Image Processing.

[4]  Olli Silven,et al.  Nonsegmenting defect detection and SOM-based classification for surface inspection using color vision , 1999, Industrial Lasers and Inspection.

[5]  James S. Goddard,et al.  Vision system for on-loom fabric inspection , 1999 .

[6]  Robert M. Hodgson,et al.  Texture Measures for Carpet Wear Assessment , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Josef Kittler,et al.  Color grading of randomly textured ceramic tiles using color histograms , 1999, IEEE Trans. Ind. Electron..

[8]  Hong-Dar Lin,et al.  Automated visual inspection of ripple defects using wavelet characteristic based multivariate statistical approach , 2007, Image Vis. Comput..

[9]  Asit K. Datta,et al.  Detecting Defects in Fabric with Laser-Based Morphological Image Processing , 2000 .

[10]  Bugao Xu,et al.  Identifying Fabric Structures with Fast Fourier Transform Techniques , 1996 .

[11]  Christoph Palm,et al.  Color texture classification by integrative Co-occurrence matrices , 2004, Pattern Recognit..

[12]  Matti Pietikäinen,et al.  Real-time surface inspection by texture , 2003, Real Time Imaging.

[13]  Steven Guan,et al.  A golden-template self-generating method for patterned wafer inspection , 2000, Machine Vision and Applications.

[14]  Bea Thai,et al.  Modeling and Classifying Symmetries Using a Multiscale Opponent Color Representation , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Amit Jain,et al.  A multiscale representation including opponent color features for texture recognition , 1998, IEEE Trans. Image Process..

[16]  Franz Pernkopf,et al.  Detection of surface defects on raw steel blocks using Bayesian network classifiers , 2004, Pattern Analysis and Applications.

[17]  Angel P. del Pobil,et al.  Classification system for pieces of Porcelanatto based on computer vision , 1994, Other Conferences.

[18]  Antti J. Koivo,et al.  Hierarchical classification of surface defects on dusty wood boards , 1994, Pattern Recognit. Lett..

[19]  Hannu Kauppinen A two stage defect recognition method for parquet slab grading , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[20]  Richard C. Dubes,et al.  Performance evaluation for four classes of textural features , 1992, Pattern Recognit..

[21]  Aura Conci,et al.  A system for real-time fabric inspection and industrial decision , 2002, SEKE '02.

[22]  D. Tsai,et al.  Defect detection in coloured texture surfaces using Gabor filters , 2005 .

[23]  Jaume Escofet,et al.  Detection of local defects in textile webs using Gabor filters , 1998 .

[24]  Zhu Xuefeng,et al.  Combination of wavelet analysis and color applied to automatic color grading of ceramic tiles , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[25]  Sameer Singh,et al.  Novelty detection: a review - part 1: statistical approaches , 2003, Signal Process..

[26]  Mohammed Bennamoun,et al.  Digital Image Processing Techniques for Automatic Textile Quality Control , 2003 .

[27]  Alok Gupta,et al.  Color and texture fusion: application to aerial image segmentation and GIS updating , 2000, Image Vis. Comput..

[28]  Edward J. Delp,et al.  Segmentation of textured images using a multiresolution Gaussian autoregressive model , 1999, IEEE Trans. Image Process..

[29]  Olli Silven,et al.  Real-time aspects of SOM-based visual surface inspection , 2002, IS&T/SPIE Electronic Imaging.

[30]  Bugao Xu Identifying Fabric Structures with Fast Fourier Transform Techniques , 1996 .

[31]  Samir Kouro,et al.  Unidimensional Modulation Technique for Cascaded Multilevel Converters , 2009, IEEE Transactions on Industrial Electronics.

[32]  Bo Hsiao,et al.  Automatic surface inspection using wavelet reconstruction , 2001, Pattern Recognit..

[33]  Alireza Khotanzad,et al.  Color Image Segmentation Using Multispectral Random Field Texture Model & Color Content Features , 2004 .

[34]  M. Mirmehdi,et al.  TEXEMS: Texture Exemplars for Defect Detection on Random Textured Surfaces , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[36]  Maria Petrou,et al.  Perceptual correction for colour grading of random textures , 2000, Machine Vision and Applications.

[37]  Mohammed Bennamoun,et al.  Optimal textural features for flaw detection in textile materials , 1997, TENCON '97 Brisbane - Australia. Proceedings of IEEE TENCON '97. IEEE Region 10 Annual Conference. Speech and Image Technologies for Computing and Telecommunications (Cat. No.97CH36162).

[38]  F. Ade,et al.  Characterization of textures by ‘Eigenfilters’ , 1983 .

[39]  Frédéric Truchetet,et al.  Review of industrial applications of wavelet and multiresolution-based signal and image processing , 2008, J. Electronic Imaging.

[40]  Dmitry Chetverikov Structural defects: general approach and application to textile inspection , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[41]  Aysin Ertüzün,et al.  Comparative evaluation of texture analysis algorithms for defect inspection of textile products , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[42]  W. Weny,et al.  Verifying Edges for Visual Inspection Purposes , 2007 .

[43]  J. Besag Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[44]  Nicola Ancona,et al.  Filter-based feature selection for rail defect detection , 2004 .

[45]  W. Wen,et al.  Verifying edges for visual inspection purposes , 1999, Pattern Recognit. Lett..

[46]  M. Pietikäinen,et al.  TEXTURE ANALYSIS WITH LOCAL BINARY PATTERNS , 2004 .

[47]  Josef Kittler,et al.  Defect detection in random colour textures , 1996, Image Vis. Comput..

[48]  Miquel Ralló,et al.  Wavelet based techniques for textile inspection , 2002 .

[49]  Hannu Kauppinen,et al.  COLOR AND TEXTURE BASED WOOD INSPECTION WITH NON-SUPERVISED CLUSTERING , 2001 .

[50]  Ajay Kumar,et al.  Neural network based detection of local textile defects , 2003, Pattern Recognit..

[51]  Ronald L. Westra,et al.  Printing quality control using template independent neurofuzzy defect classification , 1999 .

[52]  Richard W. Conners,et al.  Identifying and Locating Surface Defects in Wood: Part of an Automated Lumber Processing System , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Anil K. Jain,et al.  A Survey of Automated Visual Inspection , 1995, Comput. Vis. Image Underst..

[54]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.

[55]  S. Ozdemir,et al.  Markov random fields and Karhunen-Loeve transforms for defect inspection of textile products , 1996, Proceedings 1996 IEEE Conference on Emerging Technologies and Factory Automation. ETFA '96.

[56]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[57]  Harry Wechsler,et al.  Texture analysis — a survey , 1980 .

[58]  Tom Minka,et al.  Vision texture for annotation , 1995, Multimedia Systems.

[59]  Kazuhiko Shiranita,et al.  Determination of meat quality by texture analysis , 1998, Pattern Recognit. Lett..

[60]  J. Daugman Two-dimensional spectral analysis of cortical receptive field profiles , 1980, Vision Research.

[61]  F. Truchetet,et al.  A review on Industrial applications of wavelet and multiresolution based signal-image processing , 2007 .

[62]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[63]  Yong Huang,et al.  Texture decomposition by harmonics extraction from higher order statistics , 2004, IEEE Trans. Image Process..

[64]  Matti Pietikäinen,et al.  Gray Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2000, ECCV.

[65]  Matti Pietikäinen,et al.  Color Texture Classification with Color Histograms and Local Binary Patterns , 2002 .

[66]  Ramakant Nevatia,et al.  Structural Analysis of Natural Textures , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[67]  Chi-Ho Chan,et al.  Fabric defect detection by Fourier analysis , 1999, Conference Record of the 1999 IEEE Industry Applications Conference. Thirty-Forth IAS Annual Meeting (Cat. No.99CH36370).

[68]  Errol J. Wood,et al.  Applying Fourier and Associated Transforms to Pattern Characterization in Textiles , 1990 .

[69]  Pei-Wen Chen,et al.  Classifying Textile Faults with a Back-Propagation Neural Network Using Power Spectra , 1998 .

[70]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[71]  Jukka Iivarinen,et al.  Surface defect detection with histogram-based texture features , 2000, SPIE Optics East.

[72]  Josef Kittler,et al.  Automatic grading of ceramic tiles using machine vision , 1994, Proceedings of 1994 IEEE International Symposium on Industrial Electronics (ISIE'94).

[73]  Wilson S. Geisler,et al.  Texture segmentation using Gabor modulation/demodulation , 1987, Pattern Recognit. Lett..

[74]  F. López,et al.  A Study of Registration Methods for Ceramic Tile Inspection Purposes , 2001 .

[75]  Andrew Zisserman,et al.  Texture classification: are filter banks necessary? , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[76]  Peihua Gu,et al.  Free-form surface inspection techniques state of the art review , 2004, Comput. Aided Des..

[77]  Anil K. Jain,et al.  Texture classification and segmentation using multiresolution simultaneous autoregressive models , 1992, Pattern Recognit..

[78]  Fernando López-García,et al.  Surface Grading Using Soft Colour-Texture Descriptors , 2005, CIARP.

[79]  Josef Kittler,et al.  Automatic color grading of ceramic tiles using machine vision , 1997, IEEE Trans. Ind. Electron..

[80]  Sungshin Kim,et al.  Wavelet analysis to fabric defects detection in weaving processes , 1999, ISIE '99. Proceedings of the IEEE International Symposium on Industrial Electronics (Cat. No.99TH8465).

[81]  Michael Unser,et al.  Texture classification and segmentation using wavelet frames , 1995, IEEE Trans. Image Process..

[82]  Majid Mirmehdi,et al.  Segmentation of Color Textures , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[83]  Jacob Scharcanski,et al.  Stochastic texture analysis for monitoring stochastic processes in industry , 2005, Pattern Recognit. Lett..

[84]  Edward L. Chaney,et al.  Histogram Statistics of Local Image Regions for Object Segmentation , 2005 .

[85]  Ajay Kumar,et al.  Defect detection in textured materials using Gabor filters , 2000, Conference Record of the 2000 IEEE Industry Applications Conference. Thirty-Fifth IAS Annual Meeting and World Conference on Industrial Applications of Electrical Energy (Cat. No.00CH37129).

[86]  Amirhassan Monadjemi,et al.  Towards efficient texture classification and abnormality detection , 2004 .

[87]  Anil K. Jain,et al.  A Structural Approach To Identify Defects In Textured Images , 1988, Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics.

[88]  Ajay Kumar,et al.  Defect detection in textured materials using optimized filters , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[89]  Maria Petrou,et al.  Automatic registration of ceramic tiles for the purpose of fault detection , 2000, Machine Vision and Applications.

[90]  Song-Chun Zhu,et al.  Filters, Random Fields and Maximum Entropy (FRAME): Towards a Unified Theory for Texture Modeling , 1998, International Journal of Computer Vision.

[91]  Majid Mirmehdi,et al.  Restructured Eigenfilter Matching for Novelty Detection in Random Textures , 2004, BMVC.

[92]  Hui-Fuang Ng,et al.  Automatic thresholding for defect detection , 2004, Third International Conference on Image and Graphics (ICIG'04).

[93]  Jeng-Jong Lin,et al.  Applying an Artificial Neural Network to Pattern Recognition in Fabric Defects , 1995 .

[94]  Xianghua Xie,et al.  Texture Exemplars for Defect Detection on Random Textures , 2005, ICAPR.

[95]  Franz Pernkopf 3D surface inspection using coupled HMMs , 2004, ICPR 2004.

[96]  Ramon Baldrich,et al.  Texture and color features for tile classification , 1999, Industrial Lasers and Inspection.

[97]  J. M. Hans du Buf,et al.  A review of recent texture segmentation and feature extraction techniques , 1993 .

[98]  J. M. Hammersley,et al.  Markov fields on finite graphs and lattices , 1971 .

[99]  I. Kunttu,et al.  Shape-based retrieval of industrial surface defects using angular radius Fourier descriptor , 2007 .

[100]  Zoltan Kato,et al.  Unsupervised segmentation of color textured images using a multilayer MRF model , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[101]  Du-Ming Tsai,et al.  Automated surface inspection for directional textures , 1999, Image Vis. Comput..

[102]  Terry Caelli,et al.  On the classification of image regions by colour, texture and shape , 1993, Pattern Recognit..

[103]  Tony Lindeberg,et al.  An automatic assessment scheme for steel quality inspection , 2000, Machine Vision and Applications.

[104]  Fernando López-García,et al.  Fast Surface Grading Using Color Statistics in the CIE Lab Space , 2005, IbPRIA.

[105]  Alper Baykut,et al.  Real-time Defect Inspection of Textured Surfaces , 2000, Real Time Imaging.

[106]  Michael Unser,et al.  Feature extraction and decision procedure for automated inspection of textured materials , 1984, Pattern Recognit. Lett..

[107]  M. R. Turner,et al.  Texture discrimination by Gabor functions , 1986, Biological Cybernetics.

[108]  Du-Ming Tsai,et al.  Defect detection in textured surfaces using color ring-projection correlation , 2003, Machine Vision and Applications.

[109]  Xianghua Xie,et al.  Colour tonality inspection using eigenspace features , 2005, Machine Vision and Applications.

[110]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[111]  RussLL L. Ds Vnlos,et al.  SPATIAL FREQUENCY SELECTIVITY OF CELLS IN MACAQUE VISUAL CORTEX , 2022 .

[112]  Bruce G. Batchelor,et al.  Automated Visual Inspection , 1985 .

[113]  Che-Seung Cho,et al.  Development of real-time vision-based fabric inspection system , 2005, IEEE Transactions on Industrial Electronics.

[114]  Manuele Bicego,et al.  Statistical classification of raw textile defects , 2004, ICPR 2004.

[115]  D. Tsai,et al.  Automated surface inspection using Gabor filters , 2000 .

[116]  Majid Mirmehdi,et al.  Speed v. Accuracy for High Resolution Colour Texture Classification , 2002, BMVC.

[117]  Xuezhi Yang,et al.  Fabric defect classification using wavelet frames and minimum classification error training , 2002, Conference Record of the 2002 IEEE Industry Applications Conference. 37th IAS Annual Meeting (Cat. No.02CH37344).

[118]  D. Declercq,et al.  Texture classification using third order correlation tools , 1997, Proceedings of the IEEE Signal Processing Workshop on Higher-Order Statistics.

[119]  Majid Mirmehdi,et al.  Detection of Defects in Colour Texture Surfaces , 1994, MVA.

[120]  Song-Chun Zhu,et al.  FRAME: filters, random fields, and minimax entropy towards a unified theory for texture modeling , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[121]  Georgios Tziritas,et al.  Colour and texture segmentation using wavelet frame analysis, deterministic relaxation, and fast marching algorithms , 2004, J. Vis. Commun. Image Represent..

[122]  C. Neubauer,et al.  Segmentation of defects in textile fabric , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[123]  S. A. Hosseini Ravandi,et al.  Fourier Transform Analysis of Plain Weave Fabric Appearance , 1995 .

[124]  Chi-Ho Chan,et al.  Fabric defect detection by Fourier analysis , 1999, Conference Record of the 1999 IEEE Industry Applications Conference. Thirty-Forth IAS Annual Meeting (Cat. No.99CH36370).

[125]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[126]  Glenn Healey,et al.  Markov Random Field Models for Unsupervised Segmentation of Textured Color Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[127]  Du-Ming Tsai,et al.  Automated surface inspection for statistical textures , 2003, Image Vis. Comput..

[128]  Nelson H. C. Yung,et al.  Robust fabric defect detection and classification using multiple adaptive wavelets , 2005 .

[129]  Zhigang Fan,et al.  Automated Inspection of Textile Fabrics Using Textural Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[130]  Majid Mirmehdi,et al.  Segmentation of Colour Textures , 2000 .

[131]  Xianghua Xie,et al.  Localising surface defects in random colour textures using multiscale texem analysis in image eigenchannels , 2005, IEEE International Conference on Image Processing 2005.

[132]  Anil K. Jain,et al.  A spatial filtering approach to texture analysis , 1985, Pattern Recognit. Lett..

[133]  NiskanenMatti,et al.  Wood inspection with non-supervised clustering , 2003 .

[134]  Grantham K. H. Pang,et al.  Fabric defect segmentation using multichannel blob detectors , 2000 .

[135]  Matti Pietikäinen,et al.  Optimising Colour and Texture Features for Real-time Visual Inspection , 2002, Pattern Analysis & Applications.

[136]  John F. MacGregor,et al.  Estimation and monitoring of product aesthetics: application to manufacturing of “engineered stone” countertops , 2006, Machine Vision and Applications.

[137]  Aysin Ertüzün,et al.  An efficient method for texture defect detection: sub-band domain co-occurrence matrices , 2000, Image Vis. Comput..

[138]  Jaume Escofet,et al.  Inspection of fabric resistance to abrasion by Fourier analysis , 1998, Other Conferences.

[139]  Ashraf A. Kassim,et al.  A fast algorithm for detecting die extrusion defects in IC packages , 1998, Machine Vision and Applications.

[140]  Aura Conci,et al.  A fractal image analysis system for fabric inspection based on a box-counting method , 1998, Comput. Networks.

[141]  Brendan J. Frey,et al.  Epitomic analysis of appearance and shape , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[142]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[143]  Marc Schael Texture Defect Detection Using Invariant Textural Features , 2001, DAGM-Symposium.

[144]  Manuele Bicego,et al.  Statistical classification of raw textile defects , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[145]  Hafiz Adnan Habib,et al.  Modified Laws Energy Descriptor for Inspection of Ceramic Tiles , 2004 .

[146]  Alireza Khotanzad,et al.  Multispectral Random Field Models for Synthesis and Analysis of Color Images , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[147]  Harsh Potlapalli,et al.  Texture characterization and defect detection using adaptive wavelets , 1996 .

[148]  Alok Gupta,et al.  Color and texture fusion: application to aerial image segmentation and GIS updating , 1996, Proceedings Third IEEE Workshop on Applications of Computer Vision. WACV'96.

[149]  Sameer Singh,et al.  Novelty detection: a review - part 2: : neural network based approaches , 2003, Signal Process..

[150]  Michael J. Swain,et al.  Indexing via color histograms , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[151]  Jonathan G. Campbell,et al.  Automatic visual inspection of woven textiles using a two-stage defect detector , 1998 .

[152]  H. Sari-Sarraf,et al.  Vision system for on-loom fabric inspection , 1998, 1998 IEEE Annual Textile, Fiber and Film Industry Technical Conference (Cat. No.98CH36246).

[153]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[154]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[155]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[156]  P Perona,et al.  Preattentive texture discrimination with early vision mechanisms. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[157]  Ari Visa,et al.  Unsupervised segmentation of surface defects , 1996, Proceedings of 13th International Conference on Pattern Recognition.