Convolutional neural networks-based intelligent recognition of Chinese license plates

License plate recognition has gained extensive applications in many fields. Some interesting algorithms and models have been developed to deal with the issues in the location, segmentation and recognition processes. This paper focuses on the intelligent recognition of Chinese license plates with daily life backgrounds by designing new convolutional neural networks. Firstly, to extract Chinese license plates from the images subject to daily life backgrounds, which is more difficult than from those with fixed background, a color edge algorithm is proposed to detect specific edges of input image. A color-depressed grayscale conversion method is presented to preprocess plate samples with poor quality, and an improved relocation method is given to eliminate plate frames. Then a combination of connected component analysis and projection analysis is implemented for the segmentation. Finally, simplified and recurrent convolutional neural networks are designed to automatically recognize the characters (the first one is Chinese character, which is followed by six alphanumeric characters). A total of 2189 images containing Chinese license plates are collected manually with different backgrounds. Tested on these samples, the location rate of $$98.95\%$$98.95%, segmentation rate of $$96.58\%$$96.58% and recognition rate of $$98.09\%$$98.09% are, respectively, achieved by our algorithms. The accuracy rate of recognition of Chinese license plates reaches $$93.74\%$$93.74%, and it averagely takes 318 ms to complete the recognition of a license plate, which meets the real-time processing requirement.

[1]  Changping Liu,et al.  A hybrid License Plate Extraction Method Based On Edge Statistics and Morphology , 2004, ICPR.

[2]  Ioannis Anagnostopoulos,et al.  A License Plate-Recognition Algorithm for Intelligent Transportation System Applications , 2006, IEEE Transactions on Intelligent Transportation Systems.

[3]  Kenji Kanayama,et al.  Development of vehicle-license number recognition system using real-time image processing and its application to travel-time measurement , 1991, [1991 Proceedings] 41st IEEE Vehicular Technology Conference.

[4]  Keechul Jung,et al.  Neural network-based text location in color images , 2001, Pattern Recognit. Lett..

[5]  Juan José Pantrigo,et al.  High performance memetic algorithm particle filter for multiple object tracking on modern GPUs , 2012, Soft Comput..

[6]  Sung Bum Pan,et al.  A face recognition system based on convolution neural network using multiple distance face , 2017, Soft Comput..

[7]  Xiangjian He,et al.  Mean shift for accurate license plate localization , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[8]  Jiaxin Wang,et al.  An efficient method of license plate location , 2005, Pattern Recognit. Lett..

[9]  Jing-Ming Guo,et al.  License Plate Localization and Character Segmentation With Feedback Self-Learning and Hybrid Binarization Techniques , 2008, IEEE Transactions on Vehicular Technology.

[10]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[11]  Modjtaba Rouhani,et al.  Two fast and accurate heuristic RBF learning rules for data classification , 2016, Neural Networks.

[12]  Xiaohui Xie,et al.  Handwritten Hangul recognition using deep convolutional neural networks , 2014, International Journal on Document Analysis and Recognition (IJDAR).

[13]  Sei-Wang Chen,et al.  Automatic license plate recognition , 2004, IEEE Transactions on Intelligent Transportation Systems.

[14]  Changshui Zhang,et al.  A new algorithm for character segmentation of license plate , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[15]  Alireza Ahmadyfard,et al.  An edge-based color-aided method for license plate detection , 2009, Image Vis. Comput..

[16]  Wei Pan,et al.  Fuzzy-based algorithm for color recognition of license plates , 2008, Pattern Recognit. Lett..

[17]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[18]  Pengfei Shi,et al.  Handwritten Bangla numeral recognition system and its application to postal automation , 2007, Pattern Recognit..

[19]  Ye Zhang,et al.  Vehicle number plate recognition using mathematical morphology and neural networks , 2008 .

[20]  He Huang,et al.  Car plate character recognition using a convolutional neural network with shared hidden layers , 2015, 2015 Chinese Automation Congress (CAC).

[21]  Mahmood Fathy,et al.  Ieee Transactions on Intelligent Transportation Systems 1 an Iranian License Plate Recognition System Based on Color Features , 2022 .

[22]  Meng Wang,et al.  Recognition of Handwritten Characters in Chinese Legal Amounts by Stacked Autoencoders , 2014, 2014 22nd International Conference on Pattern Recognition.

[23]  Mehran Rasooli Farsi License Plate Detection based on Element Analysis and Characters Recognition , 2011 .

[24]  Shaimaa Ahmed El-Said Shadow aware license plate recognition system , 2015, Soft Comput..

[25]  S. Hamidreza Kasaei,et al.  New Morphology-Based Method for Robust Iranian Car Plate Detection and Recognition , 2010 .

[26]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[27]  Hassan Bevrani,et al.  A Novel Approach for Vehicle License Plate Localization and Recognition , 2011 .

[28]  Oded Cats,et al.  An online learning approach to eliminate Bus Bunching in real-time , 2016, Appl. Soft Comput..

[29]  Gee-Sern Hsu,et al.  Application-Oriented License Plate Recognition , 2013, IEEE Transactions on Vehicular Technology.

[30]  Qi Tian,et al.  Principal Visual Word Discovery for Automatic License Plate Detection , 2012, IEEE Transactions on Image Processing.

[31]  Pengfei Shi,et al.  An Algorithm for License Plate Recognition Applied to Intelligent Transportation System , 2011, IEEE Transactions on Intelligent Transportation Systems.

[32]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[33]  Yifan Gong,et al.  Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[34]  Wael Badawy,et al.  Automatic License Plate Recognition (ALPR): A State-of-the-Art Review , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  Kwang-Baek Kim,et al.  Recognition of Identifiers from Shipping Container Images Using Fuzzy Binarization and Enhanced Fuzzy RBF Network , 2007, Soft Comput..

[36]  Y. Yao,et al.  On Early Stopping in Gradient Descent Learning , 2007 .

[37]  Qingming Huang,et al.  A configurable method for multi-style license plate recognition , 2009, Pattern Recognit..

[38]  Rodolfo Zunino,et al.  Vector quantization for license-plate location and image coding , 2000, IEEE Trans. Ind. Electron..

[39]  Jing Bie,et al.  License Plate Recognition Algorithm for Passenger Cars in Chinese Residential Areas , 2012, Sensors.

[40]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[41]  Jun Sun,et al.  Handwritten Character Recognition by Alternately Trained Relaxation Convolutional Neural Network , 2014, 2014 14th International Conference on Frontiers in Handwriting Recognition.

[42]  Jae-il Jung,et al.  License plate extraction method for identification of vehicle violations at a railway level crossing , 2011 .