ROI-based Deep Learning Method for Variable-length License Plate Character Segmentation

License plate character segmentation plays link function between license plate detection and recognition. It is based on the results of license plate detection and produces segmented characters for subsequent recognition module. Character is the region of interest (ROI) in the license plate. Previous works focus on fixed-length license plates and face challenging on the slant plates. To solve the problem, we propose an ROI-based deep learning method for variable-length license plate character segmentation. It treats all the characters as objects and converts character segmentation as object detection. This paper exploits Faster R-CNN to detect the possible character regions. Region Proposal Network is designed to provide sufficient proposals for character detection of license plate and full connected network can modify the candidate boxes and predict the character class simultaneously. Moreover, we create a dataset for character segmentation of license plate. Experimental results demonstrate that our method can achieve a high accuracy in three scenes compared with some state-of-the-art approaches.

[1]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[2]  Songlin Sun,et al.  License Plate Segmentation Method Using Deep Learning Techniques , 2018, Lecture Notes in Electrical Engineering.

[3]  C. L. Philip Chen,et al.  License Plate Character Segmentation Using Key Character Location and Projection Analysis , 2018, 2018 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC).

[4]  Gee-Sern Hsu,et al.  Application-Oriented License Plate Recognition , 2013, IEEE Transactions on Vehicular Technology.

[5]  C. L. Philip Chen,et al.  Moving Cast Shadows Segmentation Using Illumination Invariant Feature , 2020, IEEE Transactions on Multimedia.

[6]  Mei Xie,et al.  A Novel Approach for License Plate Character Segmentation , 2006, 2006 1ST IEEE Conference on Industrial Electronics and Applications.

[7]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Cláudio Rosito Jung,et al.  Real-Time Brazilian License Plate Detection and Recognition Using Deep Convolutional Neural Networks , 2017, 2017 30th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[9]  Ligang Miao,et al.  License plate character segmentation algorithm based on variable-length template matching , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[10]  Cheokman Wu,et al.  A Macao license plate recognition system , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[11]  Nikos Komodakis,et al.  A Robust and Efficient Approach to License Plate Detection , 2017, IEEE Transactions on Image Processing.

[12]  Palaiahnakote Shivakumara,et al.  A New GVF Arrow Pattern for Character Segmentation from Double Line License Plate Images , 2017, 2017 4th IAPR Asian Conference on Pattern Recognition (ACPR).

[13]  Wael Badawy,et al.  Automatic License Plate Recognition (ALPR): A State-of-the-Art Review , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Kil-Taek Lim,et al.  Learning Based Character Segmentation Method for Various License Plates , 2019, 2019 16th International Conference on Machine Vision Applications (MVA).

[15]  Chi-Man Pun,et al.  A Macao license plate recognition system based on edge and projection analysis , 2010, 2010 8th IEEE International Conference on Industrial Informatics.

[16]  Yong Zhao,et al.  A license plate segmentation algorithm based on MSER and template matching , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[17]  Yong Zhao,et al.  Background subtraction using dual-class backgrounds , 2016, 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[18]  Yong Zhao,et al.  License plate detection based on fully convolutional networks , 2017, J. Electronic Imaging.

[19]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[20]  Guoyou Wang,et al.  A two-stage character segmentation method for Chinese license plate , 2015, Comput. Electr. Eng..

[21]  William R. Schwartz,et al.  A Robust Real-Time Automatic License Plate Recognition Based on the YOLO Detector , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[22]  David Menotti,et al.  Benchmark for license plate character segmentation , 2016, J. Electronic Imaging.

[23]  Sergio Guadarrama,et al.  Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  C. L. Philip Chen,et al.  Universal Approximation Capability of Broad Learning System and Its Structural Variations , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Chi-Man Pun,et al.  An Edge-Based Macao License Plate Recognition System , 2011, Int. J. Comput. Intell. Syst..