Real Time Indian License Plate Detection using Deep Neural Networks and Optical Character Recognition using LSTM Tesseract

Among the ranking of the largest road network in the world, India stood at third position. According to a survey held in 2016 the total number of vehicles in India were 260 million. Therefore, there is a necessity to develop Expert Automatic Number Plate Recognition (ANPR) systems in India because of the tremendous rise in the number of automobiles flying on the roads. It would help in proper tracking of the vehicles,expert traffic examining, tracing stolen vehicles, supervising parking toll and imposing strict actions against red light breaching. Implementing an ANPR expert system in real life seems to be a challenging task because of the variety of number plate (NP) formats,designs, shapes, color, scales, angles and non-uniform lightning situations during image accession. So, we implemented an ANPR system which acts more robustly in different challenging scenarios then the previous proposed ANPR systems.The goal of this paper,is to design a robust technique forLicense Plate Detection(LPD) in the images using deep neural networks, Pre-process the detected license platesand performLicense Plate Recognition (LPR) usingLSTMTesseract OCR Engine. According to our experimentalresults, we have successfully achieved robust results withLPD accuracy of 99% and LPR accuracy of 95%just like commercial ANPR systemsi.e., Open-ALPRand Plate Recognizer.

[1]  Wael Badawy,et al.  Automatic License Plate Recognition (ALPR): A State-of-the-Art Review , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  David Menotti,et al.  Brazilian License Plate Detection Using Histogram of Oriented Gradients and Sliding Windows , 2013, ArXiv.

[3]  William R. Schwartz,et al.  A Robust Real-Time Automatic License Plate Recognition Based on the YOLO Detector , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[4]  David Menotti,et al.  Real-Time Automatic License Plate Recognition through Deep Multi-Task Networks , 2018, 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[5]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  David Menotti,et al.  License plate recognition based on temporal redundancy , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[7]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[8]  Hojin Cho,et al.  Canny Text Detector: Fast and Robust Scene Text Localization Algorithm , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Daijin Kim,et al.  Scene text detection with robust character candidate extraction method , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[10]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[11]  Cheng-Hung Lin,et al.  An efficient license plate recognition system using convolution neural networks , 2018, 2018 IEEE International Conference on Applied System Invention (ICASI).

[12]  Hafiz Adnan Habib,et al.  Space invariant vehicle recognition for toll plaza monitoring and auditing system , 2009, 2009 IEEE 13th International Multitopic Conference.

[13]  Yanjie Yao,et al.  Vehicle License Plate Recognition Based on Extremal Regions and Restricted Boltzmann Machines , 2016, IEEE Transactions on Intelligent Transportation Systems.

[14]  Jayshree M. Kundargi,et al.  Automatic Number Plate Recognition Using Artificial Neural Network , 2015 .

[15]  Saeid Rahati,et al.  Vehicle Recognition Using Contourlet Transform and SVM , 2008, Fifth International Conference on Information Technology: New Generations (itng 2008).

[16]  Cláudio Rosito Jung,et al.  Real-Time Brazilian License Plate Detection and Recognition Using Deep Convolutional Neural Networks , 2017, 2017 30th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[17]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Jun-Wei Hsieh,et al.  Symmetrical SURF and Its Applications to Vehicle Detection and Vehicle Make and Model Recognition , 2014, IEEE Transactions on Intelligent Transportation Systems.

[19]  Dong Sun Park,et al.  Real-Time License Plate Detection Based on Faster R-CNN , 2016 .

[20]  Cláudio Rosito Jung,et al.  License Plate Detection and Recognition in Unconstrained Scenarios , 2018, ECCV.