Automatic License Plate Recognition via sliding-window darknet-YOLO deep learning

Abstract Automatic License Plate Recognition (ALPR) is an important research topic in the intelligent transportation system and image recognition fields. In this work, we address the problem of car license plate detection using a You Only Look Once (YOLO)-darknet deep learning framework. In this paper, we use YOLO's 7 convolutional layers to detect a single class. The detection method is a sliding-window process. The object is to recognize Taiwan's car license plates. We use an AOLP dataset which contained 6 digit car license plates. The sliding window detects each digit of the license plate, and each window is then detected by a single YOLO framework. The system achieves approximately 98.22% accuracy on license plate detection and 78% accuracy on license plate recognition. The system executes a single detection recognition phase, which needs around 800 ms to 1 s for each input image. The system is also tested with different condition complexities, such as rainy background, darkness and dimness, and different hues and saturation of images.

[1]  Divya Mathur,et al.  A Novel Approach to Improve Sobel Edge Detector , 2016 .

[2]  Enzeng Dong,et al.  An Improved Convolution Neural Network for Object Detection Using YOLOv2 , 2018, 2018 IEEE International Conference on Mechatronics and Automation (ICMA).

[3]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Wenjin Tao,et al.  American Sign Language alphabet recognition using Convolutional Neural Networks with multiview augmentation and inference fusion , 2018, Eng. Appl. Artif. Intell..

[5]  Lin Lei,et al.  An enhanced deep convolutional neural network for densely packed objects detection in remote sensing images , 2017, 2017 International Workshop on Remote Sensing with Intelligent Processing (RSIP).

[6]  Rung Ching Chen,et al.  Semi-supervised adaptive feature analysis and its application for multimedia understanding , 2018, Multimedia Tools and Applications.

[7]  Sani Irwan Md Salim,et al.  Convolutional Neural Network for Person and Car Detection using YOLO Framework , 2018 .

[8]  Shuo Wu,et al.  Real-time object recognition algorithm based on deep convolutional neural network , 2018, 2018 IEEE 3rd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA).

[9]  Wei Li,et al.  Diverse Region-Based CNN for Hyperspectral Image Classification , 2018, IEEE Transactions on Image Processing.

[10]  Jiaxin Wang,et al.  An efficient method of license plate location , 2005, Pattern Recognit. Lett..

[11]  Thomas S. Huang,et al.  Robust license plate detection using image saliency , 2010, 2010 IEEE International Conference on Image Processing.

[12]  Sun-Joong Kim,et al.  Shot category detection based on object detection using convolutional neural networks , 2018, 2018 20th International Conference on Advanced Communication Technology (ICACT).

[13]  Alejandro Baldominos Gómez,et al.  Evolutionary convolutional neural networks: An application to handwriting recognition , 2017, Neurocomputing.

[14]  Kang-Hyun Jo,et al.  HSI color based vehicle license plate detection , 2008, 2008 International Conference on Control, Automation and Systems.

[15]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Bipin Rajendran,et al.  Spiking neural networks for handwritten digit recognition - Supervised learning and network optimization , 2018, Neural Networks.

[17]  Antonio Plaza,et al.  A new deep convolutional neural network for fast hyperspectral image classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[18]  Maya R. Gupta,et al.  Theory and Use of the EM Algorithm , 2011, Found. Trends Signal Process..

[19]  Ioannis Anagnostopoulos,et al.  License Plate Recognition From Still Images and Video Sequences: A Survey , 2008, IEEE Transactions on Intelligent Transportation Systems.

[20]  A. S. Semenov,et al.  Optimization Of Convolutional Neural Network For Object Recognition On Satellite Images , 2018, 2018Systems of Signal Synchronization, Generating and Processing in Telecommunications (SYNCHROINFO).

[21]  Wenling Zhou,et al.  License Plate Extraction Based on Vertical Edge Detection and Mathematical Morphology , 2009, 2009 International Conference on Computational Intelligence and Software Engineering.

[22]  Gee-Sern Hsu,et al.  Application-Oriented License Plate Recognition , 2013, IEEE Transactions on Vehicular Technology.

[23]  Chunhua Shen,et al.  Reading car license plates using deep neural networks , 2018, Image Vis. Comput..

[24]  Boubakeur Boufama,et al.  Automatic license plate recognition: A comparative study , 2015, 2015 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[25]  Qingming Huang,et al.  A configurable method for multi-style license plate recognition , 2009, Pattern Recognit..

[26]  Tarun Kumar,et al.  An Efficient Approach for Automatic Number Plate Recognition for Low Resolution Images , 2016, ICNCC '16.

[27]  Saeid Sanei,et al.  Real-time search-free multiple license plate recognition via likelihood estimation of saliency , 2016, Comput. Electr. Eng..

[28]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  Neha Sharma,et al.  An Analysis Of Convolutional Neural Networks For Image Classification , 2018 .

[30]  Yan Liang,et al.  Deep convolutional neural networks for diabetic retinopathy detection by image classification , 2018, Comput. Electr. Eng..

[31]  Chunhua Shen,et al.  Toward End-to-End Car License Plate Detection and Recognition With Deep Neural Networks , 2019, IEEE Transactions on Intelligent Transportation Systems.

[32]  Chao Li,et al.  Real-Time Anti-Interference Location of Vehicle License Plates Using High-Definition Video , 2009, IEEE Intelligent Transportation Systems Magazine.

[33]  Kyung-shik Shin,et al.  Hierarchical convolutional neural networks for fashion image classification , 2019, Expert Syst. Appl..