Defect detection in code characters with complex backgrounds based on BBE.

Computer vision technologies have been widely implemented in the defect detection. However, most of the existing detection methods generally require images with high quality, and they can only process code characters on simple backgrounds with high contrast. In this paper, a defect detection approach based on deep learning has been proposed to efficiently perform defect detection of code characters on complex backgrounds with a high accuracy. Specifically, image processing algorithms and data enhancement techniques were utilized to generate a large number of defect samples to construct a large data set featuring a balanced positive and negative sample ratio. The object detection network called BBE was build based on the core module of EfficientNet. Experimental results show that the mAP of the model and the accuracy reach 0.9961 and 0.9985, respectively. Individual character detection results were screened by setting relevant quality inspection standards to evaluate the overall quality of the code characters, the results of which have verified the effectiveness of the proposed method for industrial production. Its accuracy and speed are high with high robustness and transferability to other similar defect detection tasks. To the best of our knowledge, this report describes the first time that the BBE has been applied to defect inspections for real plastic container industry.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Syed Yasser Arafat,et al.  Urdu-Text Detection and Recognition in Natural Scene Images Using Deep Learning , 2020, IEEE Access.

[4]  Yao Qin,et al.  Summary of Scene Text Detection and Recognition , 2020, 2020 15th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[5]  Farica Perdana Putri,et al.  A Combined Edge Detection Analysis and Clustering based Approach for Real Time Text Detection , 2019, 2019 5th International Conference on New Media Studies (CONMEDIA).

[6]  Han Wang,et al.  A vision-based character inspection system for tire mold , 2017 .

[7]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[9]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Jun Sun,et al.  A novel text structure feature extractor for Chinese scene text detection and recognition , 2017, 2016 23rd International Conference on Pattern Recognition (ICPR).

[11]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[12]  Jieping Ye,et al.  Object Detection in 20 Years: A Survey , 2019, Proceedings of the IEEE.

[13]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[14]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[15]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[16]  Xiaofeng Wang,et al.  A Novel Method based on Character Segmentation for Slant Chinese Screen-render Text Detection and Recognition , 2020, 2020 15th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[17]  Chao Hu,et al.  Character recognition based on corner detection and convolution neural network , 2017, 2017 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[18]  Zicong Jiang,et al.  Real-time object detection method for embedded devices , 2020 .

[19]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[21]  C. L. Philip Chen,et al.  License Plate Character Segmentation Using Key Character Location and Projection Analysis , 2018, 2018 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC).

[22]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[23]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2015, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Chao Yang,et al.  A Survey on Deep Transfer Learning , 2018, ICANN.

[25]  Quoc V. Le,et al.  EfficientDet: Scalable and Efficient Object Detection , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[27]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[28]  Pan He,et al.  Detecting Text in Natural Image with Connectionist Text Proposal Network , 2016, ECCV.

[29]  Vladimir V. Arlazarov,et al.  Two-Step CNN Framework for Text Line Recognition in Camera-Captured Images , 2020, IEEE Access.

[30]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[31]  Jan Vos,et al.  A flexible sigmoid function of determinate growth. , 2003, Annals of botany.

[32]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[33]  Tanima Dutta,et al.  Cluttered TextSpotter: An End-to-End Trainable Light-Weight Scene Text Spotter for Cluttered Environment , 2020, IEEE Access.

[34]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[35]  Sanjay Kumar Biswash,et al.  An approach towards text detection from complex images using morphological techniques , 2018, 2018 2nd International Conference on Inventive Systems and Control (ICISC).

[36]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[37]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[38]  Shen Shaohong,et al.  Research on Chinese characters recognition in complex background images , 2017, 2017 2nd International Conference on Image, Vision and Computing (ICIVC).

[39]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Hongwei Li,et al.  A Text Detection Algorithm for Image of Student Exercises Based on CTPN and Enhanced YOLOv3 , 2020, IEEE Access.

[41]  Huang Min.  Study of digit recognition based on BP neural network , 2007 .