Towards Human-Level License Plate Recognition

License plate recognition (LPR) is a fundamental component of various intelligent transport systems, which is always expected to be accurate and efficient enough. In this paper, we propose a novel LPR framework consisting of semantic segmentation and character counting, towards achieving human-level performance. Benefiting from innovative structure, our method can recognize a whole license plate once rather than conducting character detection or sliding window followed by per-character recognition. Moreover, our method can achieve higher recognition accuracy due to more effectively exploiting global information and avoiding sensitive character detection, and is time-saving due to eliminating one-by-one character recognition. Finally, we experimentally verify the effectiveness of the proposed method on two public datasets (AOLP and Media Lab) and our License Plate Dataset. The results demonstrate our method significantly outperforms the previous state-of-the-art methods, and achieves the accuracies of more than 99% for almost all settings.

[1]  Keiichi Yamada,et al.  Robust license-plate recognition method for passing vehicles under outside environment , 2000, IEEE Trans. Veh. Technol..

[2]  Xu Liu,et al.  Highway Vehicle Counting in Compressed Domain , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[5]  Chunhua Shen,et al.  Reading Car License Plates Using Deep Convolutional Neural Networks and LSTMs , 2016, ArXiv.

[6]  A. Çapar,et al.  License Plate Recognition From Still Images and Video Sequences: A Survey , 2008, IEEE Transactions on Intelligent Transportation Systems.

[7]  Wael Badawy,et al.  Automatic License Plate Recognition (ALPR): A State-of-the-Art Review , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  M. Nakagawa,et al.  A method for identifying specific vehicles using template matching , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[9]  Sei-Wang Chen,et al.  Critical Motion Detection of Nearby Moving Vehicles in a Vision-Based Driver-Assistance System , 2009, IEEE Transactions on Intelligent Transportation Systems.

[10]  Andrew Zisserman,et al.  Learning To Count Objects in Images , 2010, NIPS.

[11]  Jan-Olof Eklundh,et al.  Reading Street Signs using a Generic Structured Object Detection and Signature Recognition Approach , 2009, VISAPP.

[12]  Vladimir A. Protopopescu,et al.  Anomaly Detection in Radiation Sensor Data With Application to Transportation Security , 2009, IEEE Transactions on Intelligent Transportation Systems.

[13]  Kwang In Kim,et al.  Learning-based approach for license plate recognition , 2000, Neural Networks for Signal Processing X. Proceedings of the 2000 IEEE Signal Processing Society Workshop (Cat. No.00TH8501).

[14]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Siyu Zhu,et al.  End-to-end system of license plate localization and recognition , 2015, J. Electronic Imaging.

[16]  Lambert Spaanenburg,et al.  Car license plate recognition with neural networks and fuzzy logic , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[17]  Gee-Sern Hsu,et al.  License plate recognition for categorized applications , 2011, Proceedings of 2011 IEEE International Conference on Vehicular Electronics and Safety.

[18]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Tran Le Hong Du,et al.  Building an Automatic Vehicle License-Plate Recognition System , 2022 .

[20]  Orhan Bulan,et al.  Segmentation- and Annotation-Free License Plate Recognition With Deep Localization and Failure Identification , 2017, IEEE Transactions on Intelligent Transportation Systems.

[21]  MengChu Zhou,et al.  Critical Scenarios and Their Identification in Parallel Railroad Level Crossing Traffic Control Systems , 2010, IEEE Transactions on Intelligent Transportation Systems.

[22]  Yong Haur Tay,et al.  Segmentation-free Vehicle License Plate Recognition using ConvNet-RNN , 2017, ArXiv.

[23]  Ioannis Anagnostopoulos,et al.  A License Plate-Recognition Algorithm for Intelligent Transportation System Applications , 2006, IEEE Transactions on Intelligent Transportation Systems.

[24]  Stefano Cagnoni,et al.  VEHICLE LICENSE PLATE RECOGNITION BY MEANS OF CELLULAR AUTOMATA , 1998 .

[25]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Yue Wu,et al.  License Plate Recognition Using Deep FCN , 2016, ICCSIP.

[27]  P. Davies,et al.  License plate recognition technology for toll violation enforcement , 1990 .

[28]  Gee-Sern Hsu,et al.  Application-Oriented License Plate Recognition , 2013, IEEE Transactions on Vehicular Technology.

[29]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[30]  Wei Pan,et al.  Fuzzy-based algorithm for color recognition of license plates , 2008, Pattern Recognit. Lett..

[31]  Andrew Zisserman,et al.  Interactive Object Counting , 2014, ECCV.

[32]  Hans Hegt,et al.  A high performance license plate recognition system , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[33]  Mei Yu,et al.  An approach to Korean license plate recognition based on vertical edge matching , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[34]  Afshin Dehghan,et al.  License Plate Detection and Recognition Using Deeply Learned Convolutional Neural Networks , 2017, ArXiv.