Convolutional neural networks for license plate detection in images

License plate detection is a challenging task when dealing with open environments and images captured from a certain distance by low-cost cameras. In this paper, we propose an approach for detecting license plates based on a convolutional neural network which models a function that produces a score for each image sub-region, allowing us to estimate the locations of the detected license plates by combining the results obtained from sparse overlapping regions. Experiments were performed on a challenging benchmark, containing 4,070 license plates in 1,829 images, captured under several weather conditions. The proposed approach achieved a precision of 0.87 and recall of 0.83, outperforming a state-of-the-art detector — a promising result, given that the experiments were performed on single images, without any kind of preprocessing or temporal integration.

[1]  Kavita Bala,et al.  Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  David S. Doermann,et al.  Text Detection and Recognition in Imagery: A Survey , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  A. Çapar,et al.  License Plate Recognition From Still Images and Video Sequences: A Survey , 2008, IEEE Transactions on Intelligent Transportation Systems.

[5]  Matthieu Cord,et al.  Snoopertext: A multiresolution system for text detection in complex visual scenes , 2010, 2010 IEEE International Conference on Image Processing.

[6]  Mayank Garg,et al.  Real-Time License Plate Recognition and Speed Estimation from Video Sequences , 2013 .

[7]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[9]  Yong Haur Tay,et al.  Two-Stage License Plate Detection Using Gentle Adaboost and SIFT-SVM , 2009, 2009 First Asian Conference on Intelligent Information and Database Systems.

[10]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[11]  Jorge Stolfi,et al.  T-HOG: An effective gradient-based descriptor for single line text regions , 2013, Pattern Recognit..

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Wael Badawy,et al.  Automatic License Plate Recognition (ALPR): A State-of-the-Art Review , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Ying-Nong Chen,et al.  The Application of a Convolution Neural Network on Face and License Plate Detection , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[15]  Qi Tian,et al.  Principal Visual Word Discovery for Automatic License Plate Detection , 2012, IEEE Transactions on Image Processing.

[16]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[17]  Mahmood Fathy,et al.  Ieee Transactions on Intelligent Transportation Systems 1 an Iranian License Plate Recognition System Based on Color Features , 2022 .

[18]  Jiří Matas,et al.  Unconstrained licence plate and text localization and recognition , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[19]  Musa Mohd Mokji,et al.  License plate localization based on edge-geometrical features using morphological approach , 2013, 2013 IEEE International Conference on Image Processing.

[20]  Licia Capra,et al.  Urban Computing: Concepts, Methodologies, and Applications , 2014, TIST.

[21]  Rodrigo Minetto,et al.  A Video-Based System for Vehicle Speed Measurement in Urban Roadways , 2017, IEEE Transactions on Intelligent Transportation Systems.

[22]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[23]  Khalid Aboura,et al.  License plate localization using a statistical analysis of Discrete Fourier Transform signal , 2014, Comput. Electr. Eng..

[24]  C. V. Jiji,et al.  Automatic number plate recognition system using modified stroke width transform , 2013, 2013 Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG).

[25]  Bo Li,et al.  Component-Based License Plate Detection Using Conditional Random Field Model , 2013, IEEE Transactions on Intelligent Transportation Systems.

[26]  Thomas S. Huang,et al.  Robust license plate detection using image saliency , 2010, 2010 IEEE International Conference on Image Processing.