End-to-end system of license plate localization and recognition

Abstract. An end-to-end license plate recognition system is proposed. It is composed of preprocessing, detection, segmentation, and character recognition to find and recognize plates from camera-based still images. The system utilizes connected component (CC) properties to quickly extract the license plate region. A two-stage CC filtering is utilized to address both shape and spatial relationship information to produce high precision and to recall values for detection. Floating peak and valleys of projection profiles are used to cut the license plates into individual characters. A turning function-based method is proposed to quickly and accurately recognize each character. It is further accelerated using curvature histogram-based support vector machine. The INFTY dataset is used to train the recognition system, and MediaLab license plate dataset is used for testing. The proposed system achieved 89.45% F-measure for detection and 87.33% accuracy for overall recognition rate which is comparable to current state-of-the-art systems.

[1]  Mei Yu,et al.  An approach to Korean license plate recognition based on vertical edge matching , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[2]  Qi Tian,et al.  Principal Visual Word Discovery for Automatic License Plate Detection , 2012, IEEE Transactions on Image Processing.

[3]  Amit Patel,et al.  License Plate Recognition System , 2002 .

[4]  L. Spaanenburg,et al.  License plate recognition using DTCNNs , 1998, 1998 Fifth IEEE International Workshop on Cellular Neural Networks and their Applications. Proceedings (Cat. No.98TH8359).

[5]  Bo Li,et al.  A vehicle license plate recognition system based on analysis of maximally stable extremal regions , 2012, Proceedings of 2012 9th IEEE International Conference on Networking, Sensing and Control.

[6]  Zhonghai Wang,et al.  Automatic vehicle license plate recognition with color component texture detection and template matching , 2013, Defense, Security, and Sensing.

[7]  Amit Kumar Das,et al.  Text segmentation from scanned land map images using radon transform based projection profile , 2011, 2011 International Conference of Soft Computing and Pattern Recognition (SoCPaR).

[8]  Wei Pan,et al.  A new method of vehicle license plate location under complex scenes , 2010, 2010 2nd International Conference on Advanced Computer Control.

[9]  Horst Bischof,et al.  Real-Time License Plate Recognition on an Embedded DSP-Platform , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Hsi-Jian Lee,et al.  Detection and recognition of license plate characters with different appearances , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[11]  Hang Joon Kim,et al.  A recognition of vehicle license plate using a genetic algorithm based segmentation , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[12]  Kosin Chamnongthai,et al.  The recognition of car license plate for automatic parking system , 1999, ISSPA '99. Proceedings of the Fifth International Symposium on Signal Processing and its Applications (IEEE Cat. No.99EX359).

[13]  Ali Ziya Alkar,et al.  Efficient Embedded Neural-Network-Based License Plate Recognition System , 2008, IEEE Transactions on Vehicular Technology.

[14]  Raja Bala,et al.  Image simulation for automatic license plate recognition , 2012, Other Conferences.

[15]  Paolo Ferragina,et al.  Optical recognition of motor vehicle license plates , 1995 .

[16]  Hang Joon Kim,et al.  Locating car license plates using neural networks , 1999 .

[17]  Yo-Ping Huang,et al.  A template-based model for license plate recognition , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[18]  Esther M. Arkin,et al.  An efficiently computable metric for comparing polygonal shapes , 1991, SODA '90.

[19]  Li Yao,et al.  An efficient license plate character recognition algorithm based on shape context , 2013, Other Conferences.

[20]  Mei Xie,et al.  An effective method of locating lisence plate in complex scenes , 2013, Other Conferences.

[21]  Changping Liu,et al.  A hybrid License Plate Extraction Method Based On Edge Statistics and Morphology , 2004, ICPR.

[22]  Hang Joon Kim,et al.  Automatic recognition of a car license plate using color image processing , 1994, Proceedings of 1st International Conference on Image Processing.

[23]  Nidapan Sureerattanan,et al.  Car license plate recognition through Hausdorff distance technique , 2005, 17th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'05).

[24]  Jun-Wei Hsieh,et al.  Morphology-based license plate detection from complex scenes , 2002, Object recognition supported by user interaction for service robots.

[25]  Keiichi Yamada,et al.  Robust license-plate recognition method for passing vehicles under outside environment , 2000, IEEE Trans. Veh. Technol..

[26]  Ioannis Anagnostopoulos,et al.  License Plate Recognition From Still Images and Video Sequences: A Survey , 2008, IEEE Transactions on Intelligent Transportation Systems.

[27]  Sos S. Agaian,et al.  Practical automatic Arabic license plate recognition system , 2011, Electronic Imaging.

[28]  Zongyue Wang,et al.  Vehicle license plate recognition based on geometry restraints and multi-feature decision , 2005, International Symposium on Multispectral Image Processing and Pattern Recognition.

[29]  Sei-Wang Chen,et al.  Automatic license plate recognition , 2004, IEEE Transactions on Intelligent Transportation Systems.

[30]  Guoyou Wang,et al.  A new algorithm for license plate localization in open environment using color pair and stroke width features of character , 2013, Other Conferences.

[31]  Kwang In Kim,et al.  Learning-based approach for license plate recognition , 2000, Neural Networks for Signal Processing X. Proceedings of the 2000 IEEE Signal Processing Society Workshop (Cat. No.00TH8501).

[32]  Farhad Faradji,et al.  A Morphological-Based License Plate Location , 2007, 2007 IEEE International Conference on Image Processing.

[33]  Renlong Pan,et al.  An Efficient Method for Skew Correction of License Plate , 2010, 2010 Second International Workshop on Education Technology and Computer Science.

[34]  Lambert Spaanenburg,et al.  Car license plate recognition with neural networks and fuzzy logic , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[35]  Dai Yan,et al.  A high performance license plate recognition system based on the web technique , 2001, ITSC 2001. 2001 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.01TH8585).

[36]  Hsi-Chieh Lee,et al.  Hybrid neuro-fuzzy approach for automatic vehicle license plate recognition , 1998, Defense, Security, and Sensing.

[37]  Lei Hu,et al.  Rotation-robust math symbol recognition and retrieval using outer contours and image subsampling , 2013, Electronic Imaging.

[38]  Changshui Zhang,et al.  A new algorithm for character segmentation of license plate , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[39]  Muhammad Sarfraz,et al.  Saudi Arabian license plate recognition system , 2003, 2003 International Conference on Geometric Modeling and Graphics, 2003. Proceedings.

[40]  Yang Yang,et al.  Research and implementation of license plate recognition technology , 2012, 2012 24th Chinese Control and Decision Conference (CCDC).

[41]  Ioannis Anagnostopoulos,et al.  A License Plate-Recognition Algorithm for Intelligent Transportation System Applications , 2006, IEEE Transactions on Intelligent Transportation Systems.