Vision-Based Defect Detection for Mobile Phone Cover Glass using Deep Neural Networks

The emergency of surface defect would significantly influence the quality of MPCG (Mobile Phone Cover Glass). Therefore, efficient defect detection is highly required in the manufacturing process. Focusing on the problem, an automatic detection system is developed in this paper. The system adopts backlight imaging technology to improve the signal to noise ration and imaging effect. Then, a modified segmentation method is presented for defect extraction and measurement based on deep neural networks. In the method, a novel data generation process is provided, with which the drawback that huge amount of data is required for training deep structured networks can be overcome. Finally, experiments are well conducted to verify that satisfactory performance is achieved with the proposed method.

[1]  A. O. Martins Luiz,et al.  Automatic detection of surface defects on rolled steel using Computer Vision and Artificial Neural Networks , 2010, IECON 2010 - 36th Annual Conference on IEEE Industrial Electronics Society.

[2]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[3]  Cheng Wu,et al.  Semi-Supervised and Unsupervised Extreme Learning Machines , 2014, IEEE Transactions on Cybernetics.

[4]  Rob Fergus,et al.  Semi-Supervised Learning with Context-Conditional Generative Adversarial Networks , 2016, ArXiv.

[5]  Zhang Ying.  Preliminary research of surface defect recognition based on machine vision , 2007 .

[6]  Anirban Mukherjee,et al.  Automatic Defect Detection on Hot-Rolled Flat Steel Products , 2013, IEEE Transactions on Instrumentation and Measurement.

[7]  Camille Couprie,et al.  Semantic Segmentation using Adversarial Networks , 2016, NIPS 2016.

[8]  Max Welling,et al.  Semi-supervised Learning with Deep Generative Models , 2014, NIPS.

[9]  Bart De Schutter,et al.  Deep convolutional neural networks for detection of rail surface defects , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[10]  Masakazu Ejiri,et al.  An Automatic Wafer Inspection System Using Pipelined Image Processing Techniques , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[12]  Di Li,et al.  Defect inspection and extraction of the mobile phone cover glass based on the principal components analysis , 2014 .

[13]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[14]  Jian Gao,et al.  Imbalanced defect classification for mobile phone screen glass using multifractal features and a new sampling method , 2017, Multimedia Tools and Applications.

[15]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  Xin Fu,et al.  Touch screen defect inspection based on sparse representation in low resolution images , 2015, Multimedia Tools and Applications.

[17]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[18]  Tao Xiang,et al.  Transfer Learning by Ranking for Weakly Supervised Object Annotation , 2017, BMVC.

[19]  Jian Gao,et al.  Automatic surface defect detection for mobile phone screen glass based on machine vision , 2017, Appl. Soft Comput..

[20]  Subhransu Maji,et al.  3D Shape Induction from 2D Views of Multiple Objects , 2016, 2017 International Conference on 3D Vision (3DV).

[21]  Rajat Raina,et al.  Self-taught learning: transfer learning from unlabeled data , 2007, ICML '07.

[22]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[23]  George Papandreou,et al.  Weakly- and Semi-Supervised Learning of a DCNN for Semantic Image Segmentation , 2015, ArXiv.

[24]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[25]  De Xu,et al.  Development of detection techniques of surface defects for large aperture optical elements based on machine vision , 2014, Proceedings of the 33rd Chinese Control Conference.

[26]  Eder Santana,et al.  Learning a Driving Simulator , 2016, ArXiv.

[27]  Kuang-Chao Fan,et al.  Development of an Automated Optical Inspection System for Mobile Phone Panels , 2013 .

[28]  Kay Chen Tan,et al.  A Generic Deep-Learning-Based Approach for Automated Surface Inspection , 2018, IEEE Transactions on Cybernetics.

[29]  Dong-Joong Kang,et al.  Machine learning-based imaging system for surface defect inspection , 2016, International Journal of Precision Engineering and Manufacturing-Green Technology.

[30]  Bernd Scholz-Reiter,et al.  Learning Defect Classifiers for Textured Surfaces Using Neural Networks and Statistical Feature Representations , 2013 .

[31]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.