Automatic Container Code Localization and Recognition via an Efficient Code Detector and Sequence Recognition*

The challenge of container code localization and recognition is that the code varies in size, position, and arrangements according to the container style and environmental changes. This paper proposes an automatic container code localization and recognition system via an efficient code detector and a sequence recognizer. The code detector locates text features on the backend of the container and extracts the code through segmentation, which increases the stability of code localization. The proposed recognition algorithm regards the code as three separate sequences and recognizes them through a recurrentconvolutional neural network to improve efficiency and accuracy. To verify the validity, a test dataset is established containing about 700 high-resolution images and over 2000 gray-scale code patches. The proposed code localization and recognition algorithm is verified on the dataset in experiments and achieves overall accuracy of 93.98% at about 0.1s per-frame.

[1]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Shuchang Zhou,et al.  EAST: An Efficient and Accurate Scene Text Detector , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Xiang Bai,et al.  An End-to-End Trainable Neural Network for Image-Based Sequence Recognition and Its Application to Scene Text Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[5]  Ernest Valveny,et al.  ICDAR 2015 competition on Robust Reading , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[6]  Kwang-Baek Kim,et al.  An Intelligent System for Container Image Recognition Using ART2-Based Self-organizing Supervised Learning Algorithm , 2006, SEAL.

[7]  Hartmut Neven,et al.  PhotoOCR: Reading Text in Uncontrolled Conditions , 2013, 2013 IEEE International Conference on Computer Vision.

[8]  Xiaohai He,et al.  An automated vision system for container-code recognition , 2012, Expert Syst. Appl..

[9]  Wenyu Liu,et al.  TextBoxes: A Fast Text Detector with a Single Deep Neural Network , 2016, AAAI.

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Shijian Lu,et al.  Accurate Scene Text Recognition Based on Recurrent Neural Network , 2014, ACCV.

[12]  Jürgen Schmidhuber,et al.  Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks , 2006, ICML.

[13]  Alberto J. Pérez Jiménez,et al.  Preprocessing and Recognition of Characters in Container Codes , 2002, ICPR.

[14]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Yeongjae Cheon,et al.  PVANET: Deep but Lightweight Neural Networks for Real-time Object Detection , 2016, ArXiv.

[16]  Lovekesh Vig,et al.  Automatic Container Code Recognition via Spatial Transformer Networks and Connected Component Region Proposals , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[17]  Andrew Zisserman,et al.  Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition , 2014, ArXiv.

[18]  Youngwoo Yoon,et al.  Automatic Container Code Recognition from Multiple Views , 2016 .

[19]  Yuning Jiang,et al.  UnitBox: An Advanced Object Detection Network , 2016, ACM Multimedia.

[20]  Knut Reinert,et al.  SeqAn An efficient, generic C++ library for sequence analysis , 2008, BMC Bioinformatics.

[21]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[22]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[23]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[24]  Silvana G. Dellepiane,et al.  Recognition of container code characters through gray-level feature extraction and gradient-based classifier optimization , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..