Real-time defect detection network for polarizer based on deep learning

Quality analysis of the polarizer of a production line can be performed using image processing technology. The existing method of detecting defective images based on deep learning can ensure accurate classification; however, its detection speed is low, the model requires a large amount of memory, and it is difficult to meet the real-time requirements of online detection systems when hardware resources are limited. Therefore, in this study a lightweight polarizer defect detection network, called DDN, was developed based on deep learning. First, a parallel module was designed to build the network. This module has two main advantages. First, it mixes different convolution template sizes, and can fuse the features of different scales and extract more defect features than the traditional convolution layer. Second, depthwise separable convolution is used to replace full convolution in this module, which significantly reduces the number of parameters and the multiply-accumulate operations. Finally, a global average pooling (GAP) layer is used instead of a fully connected layer. The GAP layer has no parameters to optimize, which substantially reduces the number of network parameters. Experimental results show that the proposed method is better than existing methods in terms of classification speed, precision, and memory consumption for polarizer detection, and can satisfy real-time requirements.

[1]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[2]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[3]  Yuanlong Deng,et al.  A novel imaging-enhancement-based inspection method for transparent aesthetic defects in a polymeric polarizer , 2017 .

[4]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Kay Chen Tan,et al.  A Generic Deep-Learning-Based Approach for Automated Surface Inspection , 2018, IEEE Transactions on Cybernetics.

[7]  Jack Chin Pang Cheng,et al.  Automated detection of sewer pipe defects in closed-circuit television images using deep learning techniques , 2018, Automation in Construction.

[8]  Xiangyu Zhang,et al.  ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Song Han,et al.  Deep Compression: Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding , 2015, ICLR.

[11]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Dumitru Erhan,et al.  Deep Neural Networks for Object Detection , 2013, NIPS.

[13]  Yuanlong Deng,et al.  Aesthetic defect characterization of a polymeric polarizer via structured light illumination , 2016 .

[14]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[15]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  C. Manjula,et al.  Deep neural network based hybrid approach for software defect prediction using software metrics , 2018, Cluster Computing.

[18]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Song Han,et al.  Learning both Weights and Connections for Efficient Neural Network , 2015, NIPS.

[20]  Domingo Mery,et al.  Automatic Defect Recognition in X-Ray Testing Using Computer Vision , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[21]  ChaYoung-Jin,et al.  Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks , 2017 .

[22]  Yuanlong Deng,et al.  Inspection of extremely slight aesthetic defects in a polymeric polarizer using the edge of light between black and white stripes , 2018 .

[23]  Xinggang Wang,et al.  Automated defect inspection of LED chip using deep convolutional neural network , 2019, J. Intell. Manuf..

[24]  Yong Zhang,et al.  Blister Defect Detection Based on Convolutional Neural Network for Polymer Lithium-Ion Battery , 2019, Applied Sciences.

[25]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[26]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.