EMBDN: An Efficient Multiclass Barcode Detection Network for Complicated Environments

This article presents a novel method for efficient barcodes detection in real and complicated environments using a convolutional neural network (CNN)-based model. The method is developed as a preprocess-module of existing decoders to enhance decoding rates. Our method is trained as an end-to-end model to determine accurate locations of four barcode vertexes. Our method consists of four modules: 1) base net module; 2) region proposals generator; 3) classification and regression module; and 4) distortion removal module. The feature of barcodes extracted from the base net is fed to the next module. Region proposals are generated and selected as region of interest (ROI). Then the ROI are forward propagated to the classification and regression module to determine the positions and shapes of the barcodes. Finally, the distortion removal module is used to remove the geometric distortion according to regression parameters acquired from the previous step. The accurate position and distorted barcodes shape can be determined and corrected by our method. We validate our method on a challenging large-scale dataset in experiments. Compared with the previous methods, our method provides an end-to-end solution to determine accurate locations of barcode vertexes, which shows an excellent performance on detection accuracy. In addition, our method can enhance decoding rate through distortion removal.

[1]  Simon Lucey,et al.  Inverse Compositional Spatial Transformer Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  R. Muniz,et al.  A robust software barcode reader using the Hough transform , 1999, Proceedings 1999 International Conference on Information Intelligence and Systems (Cat. No.PR00446).

[3]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[4]  Ole Winther,et al.  Recurrent Spatial Transformer Networks , 2015, ArXiv.

[5]  Roberto Manduchi,et al.  Reading 1D Barcodes with Mobile Phones Using Deformable Templates , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Giuseppe Aceto,et al.  Mobile Encrypted Traffic Classification Using Deep Learning: Experimental Evaluation, Lessons Learned, and Challenges , 2019, IEEE Transactions on Network and Service Management.

[7]  Nina S. T. Hirata,et al.  Fast QR Code Detection in Arbitrarily Acquired Images , 2011, 2011 24th SIBGRAPI Conference on Graphics, Patterns and Images.

[8]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Hongfei Lin,et al.  Convolutional neural networks for expert recommendation in community question answering , 2017, Science China Information Sciences.

[10]  Orhan Bulan,et al.  High Capacity Color Barcodes: Per Channel Data Encoding via Orientation Modulation in Elliptical Dot Arrays , 2011, IEEE Transactions on Image Processing.

[11]  Yutao Liu,et al.  Blind Image Quality Estimation via Distortion Aggravation , 2018, IEEE Transactions on Broadcasting.

[12]  Zoltan Vamossy,et al.  QR Code detection using parallel lines , 2013, 2013 IEEE 14th International Symposium on Computational Intelligence and Informatics (CINTI).

[13]  Hai Deng,et al.  Design of a Reconfigurable RFID Sensing Tag as a Generic Sensing Platform Toward the Future Internet of Things , 2014, IEEE Internet of Things Journal.

[14]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[15]  László G. Nyúl,et al.  Efficient visual code localization with neural networks , 2017, Pattern Analysis and Applications.

[16]  Wei Li,et al.  R2CNN: Rotational Region CNN for Orientation Robust Scene Text Detection , 2017, ArXiv.

[17]  László G. Nyúl,et al.  Efficient 1D and 2D Barcode Detection Using Mathematical Morphology , 2013, ISMM.

[18]  Xiongkuo Min,et al.  Objective Quality Evaluation of Dehazed Images , 2019, IEEE Transactions on Intelligent Transportation Systems.

[19]  Ignazio Gallo,et al.  Robust Angle Invariant 1D Barcode Detection , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[20]  Shusen Yang,et al.  Lightweight Management of Resource-Constrained Sensor Devices in Internet of Things , 2015, IEEE Internet of Things Journal.

[21]  Asim Munawar,et al.  Real-Time Barcode Detection in the Wild , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[22]  Weisi Lin,et al.  Efficient Deblocking With Coefficient Regularization, Shape-Adaptive Filtering, and Quantization Constraint , 2008, IEEE Transactions on Multimedia.

[23]  Antonio Pescapè,et al.  Mobile Encrypted Traffic Classification Using Deep Learning , 2018, 2018 Network Traffic Measurement and Analysis Conference (TMA).

[24]  Xiangyang Xue,et al.  Arbitrary-Oriented Scene Text Detection via Rotation Proposals , 2017, IEEE Transactions on Multimedia.

[25]  Xiongkuo Min,et al.  Blind Quality Assessment Based on Pseudo-Reference Image , 2018, IEEE Transactions on Multimedia.

[26]  Adam Herout,et al.  Fast detection and recognition of QR codes in high-resolution images , 2013, SCCG.

[27]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Ming-Syan Chen,et al.  A General Scheme for Extracting QR Code from a Non-uniform Background in Camera Phones and Applications , 2007, ISM 2007.

[29]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Sherali Zeadally,et al.  An Analysis of RFID Authentication Schemes for Internet of Things in Healthcare Environment Using Elliptic Curve Cryptography , 2015, IEEE Internet of Things Journal.

[31]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Christian Floerkemeier,et al.  Blur-resistant joint 1D and 2D barcode localization for smartphones , 2013, MUM.

[33]  Xiongkuo Min,et al.  Quality Evaluation of Image Dehazing Methods Using Synthetic Hazy Images , 2019, IEEE Transactions on Multimedia.

[34]  Adam Herout,et al.  Real-time precise detection of regular grids and matrix codes , 2013, Journal of Real-Time Image Processing.

[35]  Xu Liu,et al.  A camera-based mobile data channel: capacity and analysis , 2008, ACM Multimedia.

[36]  Asim Munawar,et al.  Low-computation egocentric barcode detector for the blind , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[37]  Weisi Lin,et al.  A Psychovisual Quality Metric in Free-Energy Principle , 2012, IEEE Transactions on Image Processing.

[38]  Jianfei Cai,et al.  Efficient quadtree based block-shift filtering for deblocking and deringing , 2009, J. Vis. Commun. Image Represent..

[39]  László G. Nyúl,et al.  A Novel Method for Accurate and Efficient Barcode Detection with Morphological Operations , 2012, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems.

[40]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[41]  Wenxian Yu,et al.  A coupled convolutional neural network for small and densely clustered ship detection in SAR images , 2018, Science China Information Sciences.

[42]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.

[43]  Thomas B. Moeslund,et al.  Real-Time Barcode Detection and Classification using Deep Learning , 2017, IJCCI.

[44]  J. Coughlan,et al.  BLaDE: Barcode Localization and Decoding Engine , 2013 .

[45]  Abdelsalam Helal,et al.  Scalable Cloud–Sensor Architecture for the Internet of Things , 2016, IEEE Internet of Things Journal.

[46]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Hiroshi Hanaizumi,et al.  Barcode readers using the camera device in mobile phones , 2004, 2004 International Conference on Cyberworlds.

[48]  Hong-Bin Shen,et al.  Identifying RNA-binding proteins using multi-label deep learning , 2018, Science China Information Sciences.

[49]  Xiaoyi Jiang,et al.  Robust recognition of 1-D barcodes using camera phones , 2008, 2008 19th International Conference on Pattern Recognition.