Multi-national and Multi-language License Plate Detection using Convolutional Neural Networks

Many real-life machine and computer vision applications are focusing on object detection and recognition. In recent years, deep learning-based approaches gained increasing interest due to their high accuracy levels. License Plate (LP) detection and classification have been studied extensively over the last decades. However, more accurate and language-independent approaches are still required. This paper presents a new approach to detect LPs and recognize their country, language, and layout. Furthermore, a new LP dataset for both multi-national and multi-language detection, with either one-line or two-line layouts is presented. The YOLOv2 detector with ResNet feature extraction core was utilized for LP detection, and a new low complexity convolutional neural network architecture was proposed to classify LPs. Results show that the proposed approach achieves an average detection precision of 99.57%, whereas the country, language, and layout classification accuracy is 99.33%.

[1]  Deepali Virmani,et al.  FDREnet: Face Detection and Recognition Pipeline , 2019, Engineering, Technology & Applied Science Research.

[2]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Jian Yao,et al.  Multi-Oriented and Scale-Invariant License Plate Detection Based on Convolutional Neural Networks , 2019, Sensors.

[4]  M. Shrivastava,et al.  An Efficient Algorithm Proposed For Smoke Detection in Video Using Hybrid Feature Selection Techniques , 2019, Engineering, Technology & Applied Science Research.

[5]  William R. Schwartz,et al.  A Robust Real-Time Automatic License Plate Recognition Based on the YOLO Detector , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[6]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[9]  Matti Pietikäinen,et al.  Deep Learning for Generic Object Detection: A Survey , 2018, International Journal of Computer Vision.

[10]  Pavel Zemcík,et al.  Holistic recognition of low quality license plates by CNN using track annotated data , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[11]  Hyoseok Yoon,et al.  Multi-Style License Plate Recognition System using K-Nearest Neighbors , 2019, KSII Trans. Internet Inf. Syst..

[12]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  Weidong Min,et al.  New approach to vehicle license plate location based on new model YOLO-L and plate pre-identification , 2019, IET Image Process..

[14]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Lianwen Jin,et al.  A New CNN-Based Method for Multi-Directional Car License Plate Detection , 2018, IEEE Transactions on Intelligent Transportation Systems.

[19]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[20]  Hyung Il Koo,et al.  Deep-learning-based license plate detection method using vehicle region extraction , 2017 .

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Wael Badawy,et al.  Automatic License Plate Recognition (ALPR): A State-of-the-Art Review , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[24]  Seok-Bum Ko,et al.  Deep learning‐based embedded license plate localisation system , 2019, IET Intelligent Transport Systems.

[25]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[26]  Liusheng Huang,et al.  Towards End-to-End License Plate Detection and Recognition: A Large Dataset and Baseline , 2018, ECCV.

[27]  Adel M. Alimi,et al.  DELP-DAR System for License Plate Detection and Recognition , 2019, Pattern Recognit. Lett..

[28]  Krisjanis Nesenbergs,et al.  FCN and LSTM Based Computer Vision System for Recognition of Vehicle Type, License Plate Number, and Registration Country , 2018, Automatic Control and Computer Sciences.

[29]  Syed Ali Raza,et al.  License plate detection for multi-national vehicles: An illumination invariant approach in multi-lane environment , 2019, Comput. Electr. Eng..

[30]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[31]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[32]  Sang-Woong Lee,et al.  Multinational License Plate Recognition Using Generalized Character Sequence Detection , 2020, IEEE Access.

[33]  Sajid Hussain,et al.  Multinational vehicle license plate detection in complex backgrounds , 2017, J. Vis. Commun. Image Represent..

[34]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[35]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[36]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Chunhua Shen,et al.  Toward End-to-End Car License Plate Detection and Recognition With Deep Neural Networks , 2019, IEEE Transactions on Intelligent Transportation Systems.

[39]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.