Object Localization and Detection for Real-Time Automatic License Plate Detection (ALPR) System Using RetinaNet Algorithm

Automatic License Plate Detection (ALPR) has become important for various fields such as access control and traffic monitoring. The most important steps in ALPR are the license plate localization and detection. Factors affecting the accuracy of the localization and detection of the license plate are due to the uncontrolled environment factors such as lighting conditions, blurred images, occlusion, non standardized plates, irregular image acquisition. In recent years, many researches focus on the use of deep learning network to obtain a more accurate localization and detection of license plate for a better accuracy and effective ALPR system. The main reason for using these types of networks is due to the capability of the networks to automatically localize and detect the license plates in uncontrolled environment. This paper presents the use of one of the deep learning technique which is RetinaNet algorithm and the Convolution Neural Network (CNN) ResNet-50 to localize and detect the license plates taken from video images. The videos were taken in real time both during the daytime and night-time. Over 3,000 images are extracted over 7 days of video recording which are trained using the network. The results show the accuracy of 97.82% which is an improvement compared to a Vertical Projection and Cascade Classifier implemented on this application.

[1]  Gianluca Francini,et al.  Deep Classifiers-Based License Plate Detection, Localization and Recognition on GPU-Powered Mobile Platform , 2017, Future Internet.

[2]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[3]  Christian Wolf,et al.  Learning to detect, localize and recognize many text objects in document images from few examples , 2018, International Journal on Document Analysis and Recognition (IJDAR).

[4]  Mahmoud R. El-Sakka,et al.  Object Detection and Localization Using Deep Convolutional Networks with Softmax Activation and Multi-class Log Loss , 2016, ICIAR.

[5]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Lu Xin,et al.  License plate detection and localization in complex scenes based on deep learning , 2018, 2018 Chinese Control And Decision Conference (CCDC).

[9]  Saeid Sanei,et al.  Incorporating negentropy in saliency-based search free car number plate localization , 2016, 2016 IEEE International Conference on Digital Signal Processing (DSP).

[10]  Subhadip Basu,et al.  License Plate Localization Using Vertical Edge Map and Hough Transform Based Technique , 2012 .

[11]  Wael Badawy,et al.  Automatic License Plate Recognition (ALPR): A State-of-the-Art Review , 2013, IEEE Transactions on Circuits and Systems for Video Technology.