Recognition of Vehicle License Plates Based on Image Processing

In this study, we have proposed an algorithm that solves the problems which occur during the recognition of a vehicle license plate through closed-circuit television (CCTV) by using a deep learning model trained with a general database. The deep learning model which is commonly used suffers with a disadvantage of low recognition rate in the tilted and low-resolution images, as it is trained with images acquired from the front of the license plate. Furthermore, the vehicle images acquired by using CCTV have issues such as limitation of resolution and perspective distortion. Such factors make it difficult to apply the commonly used deep learning model. To improve the recognition rate, an algorithm which is a combination of the super-resolution generative adversarial network (SRGAN) model, and the perspective distortion correction algorithm is proposed in this paper. The accuracy of the proposed algorithm was verified with a character recognition algorithm YOLO v2, and the recognition rate of the vehicle license plate image was improved 8.8% from the original images.

[1]  Xuezhi Wang,et al.  A plexus-convolutional neural network framework for fast remote sensing image super-resolution in wavelet domain , 2021, IET Image Process..

[2]  Won-Keun Yang,et al.  Multi Modal Sensor Training Dataset for the Robust Object Detection and Tracking in Outdoor Surveillance (MMO (Multi Modal Outdoor) Dataset) , 2020 .

[3]  Enhancement Method of CCTV Video Quality Based on SRGAN , 2018 .

[4]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[5]  Septimiu E. Salcudean,et al.  A new era: artificial intelligence and machine learning in prostate cancer , 2019, Nature Reviews Urology.

[6]  Samia Nefti-Meziani,et al.  Perspective Distortion Modeling for Image Measurements , 2020, IEEE Access.

[7]  Jitendra Malik,et al.  Analyzing the Performance of Multilayer Neural Networks for Object Recognition , 2014, ECCV.

[8]  Boby George,et al.  An Efficient Multiple-Loop Sensor Configuration Applicable for Undisciplined Traffic , 2013, IEEE Transactions on Intelligent Transportation Systems.

[9]  Hui-Xiong Xu,et al.  Artificial intelligence in ultrasound. , 2021, European journal of radiology.

[10]  Doo-Hyun Choi,et al.  License Plate Image Generation using Generative Adversarial Networks for End-To-End License Plate Character Recognition from a Small Set of Real Images , 2020, Applied Sciences.

[11]  Minho Lee,et al.  Robust Lane Detection Based On Convolutional Neural Network and Random Sample Consensus , 2014, ICONIP.

[12]  Jiaxin Wang,et al.  An efficient method of license plate location , 2005, Pattern Recognit. Lett..

[13]  Jing Liu,et al.  Optimized YOLOv3 Algorithm and Its Application in Traffic Flow Detections , 2020, Applied Sciences.

[14]  Juan Du,et al.  Understanding of Object Detection Based on CNN Family and YOLO , 2018 .

[15]  Anastasios Tefas,et al.  Re-identification framework for long term visual object tracking based on object detection and classification , 2020, Signal Process. Image Commun..

[16]  Byoung-Ju Yun,et al.  Cutting Blade Measurement of an Ultrasonic Cutting Machine Using Multi-Step Detection , 2019 .