A comprehensive review of defect detection in 3C glass components

Abstract With the development of consumer electronics industry, it is inevitable for the industry to use machine vision instead of manual inspection. In this paper, the defect detection of 3C glass components is summarized according to the actual production process. The defects of glass components are classified in details for the first time. The causes of these defects and the optical characteristics exhibited in the detection process are also analyzed. Because the detection effect is determined by classifier, the performance of various classifiers is discussed in details under the same criterion. On the whole, the neural network classifier is obviously better than the traditional methods, and the unsupervised classifier is better than the supervised one. The current detection accuracy is about 90%, and the computational complexity of high-accuracy classifiers is large. In the future, the improvement of accuracy and the reduction of computational complexity are still the research focus.

[1]  Yong Jin Park,et al.  A new algorithm on the automatic TFT‐LCD mura defects inspection based on an effective background reconstruction , 2017 .

[2]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[3]  Domingo Guinea,et al.  Multi-modal defect detection of residual oxide scale on a cold stainless steel strip , 2010, Machine Vision and Applications.

[4]  Torbjørn Eltoft,et al.  Homomorphic wavelet-based statistical despeckling of SAR images , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Yu-De Lin,et al.  Automatic defect inspection system of colour filters using Taguchi-based neural network , 2013 .

[6]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[8]  Yi-Hung Liu,et al.  Automatic inline defect detection for a thin film transistor–liquid crystal display array process using locally linear embedding and support vector data description , 2008 .

[9]  Jens Schneider,et al.  Finite-element analysis of the residual stresses in tempered glass plates with holes or cut-outs , 2018 .

[10]  Shir-Kuan Lin,et al.  Automatic optical inspection system for 3D surface profile measurement of multi-microlenses using the optimal inspection path , 2014 .

[11]  Younghoon Song,et al.  Wavelet-Based Image Enhancement for Defect Detection in Thin Film Transistor Liquid Crystal Display Panel , 2006 .

[12]  Du-Ming Tsai,et al.  1D-based defect detection in patterned TFT-LCD panels using characteristic fractal dimension and correlations , 2009, Machine Vision and Applications.

[13]  Ho-Kyung Lee,et al.  Automatic Inspection of TFT-LCD Glass Substrates Using Optimized Support Vector Machines , 2012 .

[14]  Satish Kumar Injeti,et al.  Optimal multilevel thresholding selection for brain MRI image segmentation based on adaptive wind driven optimization , 2018, Measurement.

[15]  Seung-Ho Lee,et al.  Automatic Mura Detection for Display Film Using Mask Filtering in Wavelet Transform , 2015, IEICE Trans. Inf. Syst..

[16]  Lining Sun,et al.  Surface defect detection method for glass substrate using improved Otsu segmentation. , 2015, Applied optics.

[17]  Wuyi Ming,et al.  Defect detection of LGP based on combined classifier with dynamic weights , 2019, Measurement.

[18]  Xin Fu,et al.  Touch screen defect inspection based on sparse representation in low resolution images , 2015, Multimedia Tools and Applications.

[19]  Gerald Schaefer,et al.  Anisotropic Mean Shift Based Fuzzy C-Means Segmentation of Dermoscopy Images , 2009, IEEE Journal of Selected Topics in Signal Processing.

[20]  Hong-Dar Lin,et al.  Flaw detection of domed surfaces in LED packages by machine vision system , 2011, Expert Syst. Appl..

[21]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[22]  Chen Gong,et al.  Detection method of the LGP warpage degree based on edge detection evaluation function , 2017 .

[23]  Di Li,et al.  Defect inspection and extraction of the mobile phone cover glass based on the principal components analysis , 2014 .

[24]  Yangzhou Gan,et al.  An Effective Defect Inspection Method for LCD Using Active Contour Model , 2013, IEEE Transactions on Instrumentation and Measurement.

[25]  Maria Petrou,et al.  Next Generation Artificial Vision Systems - Reverse Engineering the Human Visual System , 2008, Artech House Series Bioinformatics and Biomedical Imaging.

[26]  Jian Gao,et al.  Automatic surface defect detection for mobile phone screen glass based on machine vision , 2017, Appl. Soft Comput..

[27]  Li Kun,et al.  Background Suppression of LCD Mura Defect Using B-spline Surface Fitting , 2014 .

[28]  A. Oppenheim,et al.  Homomorphic analysis of speech , 1968 .

[29]  Chinghua Hung,et al.  Ultrasonic vibration-assisted optical glass hot embossing process , 2012 .

[30]  Rong-Seng Chang,et al.  Pretest Gap Mura on TFT LCDs Using the Optical Interference Pattern Sensing Method and Neural Network Classification , 2013, IEEE Transactions on Industrial Electronics.

[31]  Yanhui Guo,et al.  An effective color image segmentation approach using neutrosophic adaptive mean shift clustering , 2018 .

[32]  Euripides G. M. Petrakis,et al.  A survey on industrial vision systems, applications, tools , 2003, Image Vis. Comput..

[33]  Deok-Hwan Kim,et al.  An effective and efficient defect inspection system for TFT-LCD polarised films using adaptive thresholds and shape-based image analyses , 2010 .

[34]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Anurag Jain,et al.  Compression Molding of Aspherical Glass Lenses–A Combined Experimental and Numerical Analysis , 2005 .

[36]  Liang-Chia Chen,et al.  An effective image segmentation method for noisy low-contrast unbalanced background in Mura defects using balanced discrete-cosine-transfer (BDCT) , 2013 .

[37]  Sunil Agrawal,et al.  Detection of Defects in Glass Sheet using C.S.C based Segmentation Method , 2013 .

[38]  Bo Li,et al.  TFT-LCD Mura Defect Detection Based on ICA and Multi-channels Fusion , 2016, 2016 3rd International Conference on Information Science and Control Engineering (ICISCE).

[39]  Xiang Rong,et al.  Size measurement based on a two-camera machine vision system for the bayonets of automobile brake pads , 2018 .

[40]  Hamid K. Aghajan,et al.  Patterned wafer inspection by high resolution spectral estimation techniques , 2005, Machine Vision and Applications.

[41]  J. Gómez Ortega,et al.  An industrial vision system for surface quality inspection of transparent parts , 2013, The International Journal of Advanced Manufacturing Technology.

[42]  Du-Ming Tsai,et al.  Defect detection in inhomogeneously textured sputtered surfaces using 3D Fourier image reconstruction , 2007, Machine Vision and Applications.

[43]  Seongkyu Yoon,et al.  Decision support in machine vision system for monitoring of TFT-LCD glass substrates manufacturing , 2014 .

[44]  Wen-Kuan Lin,et al.  LED strobe lighting for machine vision inspection , 2013, 2013 International Symposium on Next-Generation Electronics.

[45]  Javier Gámez García,et al.  A sensor planning system for automated headlamp lens inspection , 2009, Expert Syst. Appl..

[46]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[47]  H G Adelmann,et al.  Butterworth equations for homomorphic filtering of images , 1998, Comput. Biol. Medicine.

[48]  Guojun Zhang,et al.  Reduction of Energy Consumption and Thermal Deformation in WEDM by Magnetic Field Assisted Technology , 2020, International Journal of Precision Engineering and Manufacturing-Green Technology.

[49]  Der-Baau Perng,et al.  Automated SMD LED inspection using machine vision , 2011 .

[50]  Han Ding,et al.  A New Mura Defect Inspection Way for TFT-LCD Using Level Set Method , 2009, IEEE Signal Processing Letters.

[51]  Filippo Attivissimo,et al.  Calibration of an Inspection System for Online Quality Control of Satin Glass , 2010, IEEE Transactions on Instrumentation and Measurement.

[52]  Khaled Abou-El-Hossein,et al.  Review of single-point diamond turning process in terms of ultra-precision optical surface roughness , 2020 .

[53]  Deepak S. Turaga,et al.  No reference PSNR estimation for compressed pictures , 2004, Signal Process. Image Commun..

[54]  Xin Chen,et al.  Online Visual Inspectionsystem for OLED Defects , 2012 .

[55]  Thomas H. Reiss,et al.  The revised Fundamental Theorem of Moment Invariants , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  Kay Chen Tan,et al.  A Generic Deep-Learning-Based Approach for Automated Surface Inspection , 2018, IEEE Transactions on Cybernetics.

[57]  Ming Chang,et al.  Development of an optical inspection platform for surface defect detection in touch panel glass , 2016 .

[58]  Xin Jin,et al.  ScratchNet: Detecting the Scratches on Cellphone Screen , 2017, CCCV.

[59]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[60]  A. Górny,et al.  Electrical and optical properties of glasses and glass-ceramics , 2018, Journal of Non-Crystalline Solids.

[61]  Song Zhan,et al.  Structured Light System with Accuracy Improved by the Use of LCD Pattern for Calibration , 2008 .

[62]  Jim-Min Lin,et al.  An automatic template generating method of machine vision system in TFT LCD assembly and positioning process with genetic algorithm , 2009 .

[63]  M. Katayama,et al.  TFT-LCD technology , 1999 .

[64]  Shu-Kai S. Fan,et al.  Automatic detection of Mura defect in TFT-LCD based on regression diagnostics , 2010, Pattern Recognit. Lett..

[65]  Yi-Hung Liu,et al.  Automatic target defect identification for TFT-LCD array process inspection using kernel FCM-based fuzzy SVDD ensemble , 2009, Expert Syst. Appl..

[66]  Yi-Hung Liu,et al.  High-speed inline defect detection for TFT-LCD array process using a novel support vector data description , 2011, Expert Syst. Appl..

[67]  Youping Chen,et al.  A classification method of glass defect based on multiresolution and information fusion , 2011 .

[68]  H.-C. Liu,et al.  Liquid crystal display surface uniformity defect inspection using analysis of variance and exponentially weighted moving average techniques , 2005 .

[69]  Javier Gámez García,et al.  A machine vision system for defect characterization on transparent parts with non-plane surfaces , 2010, Machine Vision and Applications.

[70]  Jun Ma,et al.  Multi-objective optimization of glass multi-station bending machining for smartphone curved screen , 2019, Journal of the Brazilian Society of Mechanical Sciences and Engineering.

[71]  Chern-Sheng Lin,et al.  Automatic inspection and strategy for surface defects in the PI coating process of TFT‐LCD panels , 2011 .

[72]  Ankit Chaudhary,et al.  Fabric defect detection based on GLCM and Gabor filter: A comparison , 2013 .

[73]  Liang-Chia Chen,et al.  Automatic TFT-LCD mura defect inspection using discrete cosine transform-based background filtering and 'just noticeable difference' quantification strategies , 2008 .

[74]  N. Doan,et al.  A fast image enhancement technique using a new scanning path for critical dimension measurement of glass panels , 2012 .

[75]  H. V. Ravindra,et al.  Optimization of machining parameters in turning Nimonic-75 using machine vision and acoustic emission signals by Taguchi technique , 2019, Measurement.

[76]  Feng Zhang,et al.  Vision-Based Defect Detection for Mobile Phone Cover Glass using Deep Neural Networks , 2018, International Journal of Precision Engineering and Manufacturing.

[77]  Bayram Akdemir,et al.  Comparison of Edge Detection Algorithms for Texture Analysis on Glass Production , 2015 .

[78]  Der-Baau Perng,et al.  Automatic optical inspection system for IC molding surface , 2016, J. Intell. Manuf..

[79]  Zude Zhou,et al.  An online defects inspection method for float glass fabrication based on machine vision , 2008 .

[80]  Wen-Yong Yu,et al.  Online auto-detection method and system of presswork quality , 2007 .

[81]  Bengt Fornberg,et al.  The Runge phenomenon and spatially variable shape parameters in RBF interpolation , 2007, Comput. Math. Appl..

[82]  Yi-Hung Liu,et al.  Automatic Defect Detection for TFT-LCD Array Process Using Quasiconformal Kernel Support Vector Data Description , 2011, International journal of molecular sciences.

[83]  Jian Gao,et al.  Imbalanced defect classification for mobile phone screen glass using multifractal features and a new sampling method , 2017, Multimedia Tools and Applications.

[84]  Du-Ming Tsai,et al.  An anisotropic diffusion-based defect detection for low-contrast glass substrates , 2008, Image Vis. Comput..

[85]  J. Daugman Two-dimensional spectral analysis of cortical receptive field profiles , 1980, Vision Research.

[86]  Kil-Houm Park,et al.  Adaptive Surface Fitting for Inspection of FPD Devices Using Multilevel B-spline Approximation , 2005, TENCON 2005 - 2005 IEEE Region 10 Conference.

[87]  Hye-Jeong Kim,et al.  Experimental study of glass molding process and transcription characteristics of mold surface in molding of aspheric glass lenses , 2011 .

[88]  Victor S. Frost,et al.  A Model for Radar Images and Its Application to Adaptive Digital Filtering of Multiplicative Noise , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[89]  Matti Pietikäinen,et al.  Gray Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2000, ECCV.

[90]  Kazutaka Taniguchi,et al.  A mura detection method , 2006, Pattern Recognit..

[91]  Yang Ni,et al.  Study on a novel laser measurement system for float glass thickness , 2008, 2008 IEEE International Conference on Mechatronics and Automation.

[92]  Tracy L. Faber Next generation artificial vision systems: reverse engineering the human visual system , 2009 .

[93]  M. K. Abdel Rahman,et al.  Formation of Cellular-Structure Material From Automotive Glass Waste and Sawdust , 2013 .

[94]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[95]  Der-Baau Perng,et al.  Directional textures auto-inspection using discrete cosine transform , 2011 .

[96]  Kazufumi Ito,et al.  Gaussian filters for nonlinear filtering problems , 2000, IEEE Trans. Autom. Control..

[97]  Suk In Yoo,et al.  Image Restoration for Quantifying TFT-LCD Defect Levels , 2008, IEICE Trans. Inf. Syst..

[98]  Ashraf A. Kassim,et al.  Automated estimation of misconvergence in color monitors , 2004, IEEE Transactions on Consumer Electronics.

[99]  Xin Bi,et al.  An automatic detection method of mura defects for liquid crystal display using real Gabor filters , 2015, 2015 8th International Congress on Image and Signal Processing (CISP).

[100]  Chung-Feng Jeffrey Kuo,et al.  Automatic inspection system of LED chip using two-stages back-propagation neural network , 2014, J. Intell. Manuf..

[101]  N. H. C. Yung,et al.  Automated fabric defect detection - A review , 2011, Image Vis. Comput..

[102]  Jae Yeong Lee,et al.  Automatic Detection of Region-Mura Defect in TFT-LCD , 2004, IEICE Trans. Inf. Syst..

[103]  Hans Marmolin,et al.  Subjective MSE Measures , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[104]  Chern-Sheng Lin,et al.  High‐speed TFT LCD defect‐detection system with genetic algorithm , 2008 .

[105]  Du-Ming Tsai,et al.  Automated surface inspection for directional textures , 1999, Image Vis. Comput..