Tiny-BDN: An Efficient and Compact Barcode Detection Network

This paper presents a novel approach for accurate barcodes detection in real and challenging environments using compact deep neural networks. Our approach is based on Convolutional Neural Network (<italic>CNN</italic>) and neural network compression, which can detect the four vertexes coordinates of a barcode accurately and quickly. Our approach consists of four stages: (<inline-formula><tex-math notation="LaTeX">$i$</tex-math></inline-formula>) feature extraction by a base network, (<inline-formula><tex-math notation="LaTeX">$ii$</tex-math></inline-formula>) region proposal network (<italic>RPN</italic>) training, (<inline-formula><tex-math notation="LaTeX">$iii$</tex-math></inline-formula>) barcode classification and coordinates regression, and (<inline-formula><tex-math notation="LaTeX">$iv$</tex-math></inline-formula>) weights pruning and recoding. The model is trained in the first three stages and then compressed in the fourth stage to reduce the size of the trained model. In order to remove the effect of geometric distortion during barcode decoding, we add a distortion removal module to the end of the trained model. In experiments, we validate our approach on a challenging large-scale dataset. Compared with previous methods, our method can locate the coordinates of a barcode accurately and quickly and enhance decoding rate through distortion removal. In addition, the storage and memory overheads of our model are reduced through model compression, which shows great potential in industrial applications.

[1]  J. Coughlan,et al.  BLaDE: Barcode Localization and Decoding Engine , 2013 .

[2]  Xiongkuo Min,et al.  Objective Quality Evaluation of Dehazed Images , 2019, IEEE Transactions on Intelligent Transportation Systems.

[3]  Xianming Liu,et al.  A Blind Quality Measure for Industrial 2D Matrix Symbols Using Shallow Convolutional Neural Network , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[4]  Guangtao Zhai,et al.  Fine localization and distortion resistant detection of multi-class barcode in complex environments , 2020, Multimedia Tools and Applications.

[5]  Xu Liu,et al.  A camera-based mobile data channel: capacity and analysis , 2008, ACM Multimedia.

[6]  Zhiru Zhang,et al.  Binarized Convolutional Neural Networks with Separable Filters for Efficient Hardware Acceleration , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Zhiyong Gao,et al.  BAN, A Barcode Accurate Detection Network , 2018, 2018 IEEE Visual Communications and Image Processing (VCIP).

[8]  Larry S. Davis,et al.  NISP: Pruning Networks Using Neuron Importance Score Propagation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Junmo Kim,et al.  A Gift from Knowledge Distillation: Fast Optimization, Network Minimization and Transfer Learning , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[11]  László G. Nyúl,et al.  Efficient visual code localization with neural networks , 2017, Pattern Analysis and Applications.

[12]  R. Muniz,et al.  A robust software barcode reader using the Hough transform , 1999, Proceedings 1999 International Conference on Information Intelligence and Systems (Cat. No.PR00446).

[13]  Xiongkuo Min,et al.  EMBDN: An Efficient Multiclass Barcode Detection Network for Complicated Environments , 2019, IEEE Internet of Things Journal.

[14]  Guangtao Zhai,et al.  Protection and Hiding Algorithm of QR Code Based on Multi-channel Visual Masking , 2019, 2019 IEEE Visual Communications and Image Processing (VCIP).

[15]  Jian Cheng,et al.  Quantized Convolutional Neural Networks for Mobile Devices , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Ming-Syan Chen,et al.  A General Scheme for Extracting QR Code from a Non-uniform Background in Camera Phones and Applications , 2007, Ninth IEEE International Symposium on Multimedia (ISM 2007).

[17]  Xiongkuo Min,et al.  Blind Quality Assessment Based on Pseudo-Reference Image , 2018, IEEE Transactions on Multimedia.

[18]  Ignazio Gallo,et al.  Robust Angle Invariant 1D Barcode Detection , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[19]  Jian Sun,et al.  Deep Learning with Low Precision by Half-Wave Gaussian Quantization , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Yutao Liu,et al.  Blind Image Quality Estimation via Distortion Aggravation , 2018, IEEE Transactions on Broadcasting.

[22]  Zoltan Vamossy,et al.  QR Code detection using parallel lines , 2013, 2013 IEEE 14th International Symposium on Computational Intelligence and Informatics (CINTI).

[23]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Jianfei Cai,et al.  Efficient quadtree based block-shift filtering for deblocking and deringing , 2009, J. Vis. Commun. Image Represent..

[25]  Asim Munawar,et al.  Low-computation egocentric barcode detector for the blind , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[26]  Roberto Manduchi,et al.  Reading 1D Barcodes with Mobile Phones Using Deformable Templates , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Lianwen Jin,et al.  Deep Matching Prior Network: Toward Tighter Multi-oriented Text Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[29]  Asim Munawar,et al.  Real-Time Barcode Detection in the Wild , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[30]  Weisi Lin,et al.  A Psychovisual Quality Metric in Free-Energy Principle , 2012, IEEE Transactions on Image Processing.

[31]  Xiongkuo Min,et al.  Quality Evaluation of Image Dehazing Methods Using Synthetic Hazy Images , 2019, IEEE Transactions on Multimedia.

[32]  Adam Herout,et al.  Real-time precise detection of regular grids and matrix codes , 2013, Journal of Real-Time Image Processing.

[33]  Zhiqiang Shen,et al.  Learning Efficient Convolutional Networks through Network Slimming , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[34]  László G. Nyúl,et al.  A Novel Method for Accurate and Efficient Barcode Detection with Morphological Operations , 2012, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems.

[35]  Bo Chen,et al.  Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[36]  Xiaoyi Jiang,et al.  Robust recognition of 1-D barcodes using camera phones , 2008, 2008 19th International Conference on Pattern Recognition.

[37]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Jianxin Wu,et al.  ThiNet: A Filter Level Pruning Method for Deep Neural Network Compression , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[39]  Hiroshi Hanaizumi,et al.  Barcode readers using the camera device in mobile phones , 2004, 2004 International Conference on Cyberworlds.

[40]  Song Han,et al.  Deep Compression: Compressing Deep Neural Network with Pruning, Trained Quantization and Huffman Coding , 2015, ICLR.

[41]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[42]  Guangtao Zhai,et al.  The Invisible QR Code , 2015, ACM Multimedia.

[43]  Cong Xu,et al.  Coordinating Filters for Faster Deep Neural Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[44]  Ali Farhadi,et al.  XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks , 2016, ECCV.

[45]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Asit K. Mishra,et al.  Apprentice: Using Knowledge Distillation Techniques To Improve Low-Precision Network Accuracy , 2017, ICLR.

[47]  Jian Sun,et al.  Efficient and accurate approximations of nonlinear convolutional networks , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Weisi Lin,et al.  Efficient Deblocking With Coefficient Regularization, Shape-Adaptive Filtering, and Quantization Constraint , 2008, IEEE Transactions on Multimedia.

[49]  Xiangyu Zhang,et al.  Channel Pruning for Accelerating Very Deep Neural Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[50]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Christian Floerkemeier,et al.  Blur-resistant joint 1D and 2D barcode localization for smartphones , 2013, MUM.

[52]  Adam Herout,et al.  Fast detection and recognition of QR codes in high-resolution images , 2013, SCCG.