Research of automatic recognition of car license plates based on deep learning for convergence traffic control system

The technology that can recognize the license plates of vehicles in real time and manage them automatically is a key element of building an intelligent transportation system. License plate recognition is the most important technique in vehicle image processing used to identify a vehicle. Object recognition using a camera is greatly influenced by environmental factors in which the camera is installed. When the vehicle image is acquired, the image is distorted due to the tilting of the license plate, reflection of light, lighting effects, rainy weather, and nighttime, so that it is difficult to accurately recognize the license plate. In addition, when the geometric distortion of the license plate image or the degradation of the image quality is intensified, it may be more difficult to automatically recognize the license plate image. Therefore, in this paper, we propose a deep learning–based vehicles’ license plate recognition method to detect license plate and recognize characters accurately in complex and diverse environments. As a deep learning model, the YOLO model can be used to detect robust license plates in a variety of environments and to recognize characters quickly and accurately. It can also be seen that the license plate accurately recognizes the license plate with geometric distortion.

[1]  Zuwena Musoromy,et al.  Edge detection comparison for license plate detection , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[2]  Rached Taktak,et al.  Road modelling and vehicle detection by using image processing , 1994, Proceedings of IEEE International Conference on Systems, Man and Cybernetics.

[3]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  William R. Schwartz,et al.  A Robust Real-Time Automatic License Plate Recognition Based on the YOLO Detector , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[5]  Yasue Mitsukura,et al.  License plate detection system in rainy days , 2003, Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Computational Intelligence in Robotics and Automation for the New Millennium (Cat. No.03EX694).

[6]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  K. Nallaperumal,et al.  A license plate localization using morphology and recognition , 2008, 2008 Annual IEEE India Conference.

[8]  J KriegmanDavid,et al.  Eigenfaces vs. Fisherfaces , 1997 .

[9]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[10]  Yanjie Yao,et al.  Vehicle License Plate Recognition Based on Extremal Regions and Restricted Boltzmann Machines , 2016, IEEE Transactions on Intelligent Transportation Systems.

[11]  Shouxun Liu,et al.  License plate location method based on texture and color , 2013, 2013 IEEE 4th International Conference on Software Engineering and Service Science.

[12]  Changping Liu,et al.  A fast license plate extraction method on complex background , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[13]  Hang Joon Kim,et al.  Automatic recognition of a car license plate using color image processing , 1994, Proceedings of 1st International Conference on Image Processing.

[14]  Yen-Wei Chen,et al.  Two-Stage YOLOv2 for Accurate License-Plate Detection in Complex Scenes , 2019, 2019 IEEE International Conference on Consumer Electronics (ICCE).

[15]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[16]  Nikos Komodakis,et al.  A Robust and Efficient Approach to License Plate Detection , 2017, IEEE Transactions on Image Processing.

[17]  S. Ogata,et al.  A stereo-based vehicle detection method under windy conditions , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[18]  Wael Badawy,et al.  Automatic License Plate Recognition (ALPR): A State-of-the-Art Review , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Witold Pedrycz,et al.  Vehicle license plate detection using region-based convolutional neural networks , 2018, Soft Comput..

[20]  Jiaxin Wang,et al.  An efficient method of license plate location , 2005, Pattern Recognit. Lett..

[21]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Keiichi Yamada,et al.  Robust license-plate recognition method for passing vehicles under outside environment , 2000, IEEE Trans. Veh. Technol..

[23]  Orhan Bulan,et al.  Segmentation- and Annotation-Free License Plate Recognition With Deep Localization and Failure Identification , 2017, IEEE Transactions on Intelligent Transportation Systems.

[24]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[25]  Rahim Panahi,et al.  Accurate Detection and Recognition of Dirty Vehicle Plate Numbers for High-Speed Applications , 2017, IEEE Transactions on Intelligent Transportation Systems.

[26]  Feng Yang,et al.  Vehicle license plate location based on histogramming and mathematical morphology , 2005, Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID'05).

[27]  Md Monirul Islam,et al.  Automatic license plate detection in hazardous condition , 2016, J. Vis. Commun. Image Represent..

[28]  Kostia Robert,et al.  Video-based traffic monitoring at day and night vehicle features detection tracking , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[29]  Milos Oravec,et al.  SUPPORT VECTOR MACHINES, PCA AND LDA IN FACE RECOGNITION , 2008 .

[30]  Cláudio Rosito Jung,et al.  License Plate Detection and Recognition in Unconstrained Scenarios , 2018, ECCV.

[31]  Eleftherios Kayafas,et al.  A template-guided approach to vehicle surveillance and access control , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[32]  Cláudio Rosito Jung,et al.  Real-Time Brazilian License Plate Detection and Recognition Using Deep Convolutional Neural Networks , 2017, 2017 30th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[33]  Chunhua Shen,et al.  Reading Car License Plates Using Deep Convolutional Neural Networks and LSTMs , 2016, ArXiv.

[34]  Gee-Sern Hsu,et al.  Robust license plate detection in the wild , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).