Robust search-free car number plate localization incorporating hierarchical saliency

There are two major shortcomings associated with presently implemented automatic license plate recognition (ALPR) systems: first, processing images with complex background is time-consuming and second, the results are not sufficiently accurate. To overcome these problems and also to achieve a robust recognition of multiple car number plates, saliency detection based on the ALPR system is used in this paper and also an improved and more effective definition of saliency is presented. In this new approach, the notion of the directionality of the edges using Gabor filtering and the detection of the patterns of numbers using L1-norm have been added to the traditional saliency detection method. The proposed algorithm was tested on 660 images; some consisting of two or more cars. A detection accuracy of 94.77% and an average execution time of 40 ms for 600 × 800 images are the marked outcomes. The proposed SB-ALPR method outperforms most of the state of the art techniques in terms of execution time and accuracy, and can be used in real-time applications. Also, unlike some recently introduced saliency-based ALPR methods, our two-stage saliency detection approach exploits smaller numbers of sample sizes to reduce the computation cost.

[1]  Saliency Robust Search-Free Car Number Plate Localization Incorporating Hierarchical Saliency , 2016 .

[2]  Jin Hyung Kim,et al.  Color Texture-Based Object Detection: An Application to License Plate Localization , 2002, SVM.

[3]  Changping Liu,et al.  A hybrid License Plate Extraction Method Based On Edge Statistics and Morphology , 2004, ICPR.

[4]  Byung Tae Chun,et al.  Design of real time vehicle identification system , 1994, Proceedings of IEEE International Conference on Systems, Man and Cybernetics.

[5]  B. Gu,et al.  Visual Attention Saliency Model for License Plate Location , 2015 .

[6]  Hong-ke Xu,et al.  A New Approach of the Vehicle License Plate Location , 2005, Sixth International Conference on Parallel and Distributed Computing Applications and Technologies (PDCAT'05).

[7]  Yanjie Yao,et al.  Vehicle License Plate Recognition Based on Extremal Regions and Restricted Boltzmann Machines , 2016, IEEE Transactions on Intelligent Transportation Systems.

[8]  Rodolfo Zunino,et al.  Vector quantization for license-plate location and image coding , 2000, IEEE Trans. Ind. Electron..

[9]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[10]  Hsi-Jian Lee,et al.  Detection and recognition of license plate characters with different appearances , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[11]  Li Shaofa,et al.  Color analysis for Chinese car plate recognition , 2003, IEEE International Conference on Robotics, Intelligent Systems and Signal Processing, 2003. Proceedings. 2003.

[12]  E.D. Di Claudio,et al.  Car plate recognition by neural networks and image processing , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[13]  Alireza Ahmadyfard,et al.  An edge-based color-aided method for license plate detection , 2009, Image Vis. Comput..

[14]  Saeid Sanei,et al.  Search-free license plate localization based on saliency and local variance estimation , 2015, Other Conferences.

[15]  Day-Fann Shen,et al.  License Plate Extraction in Low Resolution Video , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[16]  J. Barroso,et al.  Number plate reading using computer vision , 1997, ISIE '97 Proceeding of the IEEE International Symposium on Industrial Electronics.

[17]  Kang-Hyun Jo,et al.  Vehicle License Plate Detection Method Based on Sliding Concentric Windows and Histogram , 2009, J. Comput..

[18]  Jiaxin Wang,et al.  An efficient method of license plate location , 2005, Pattern Recognit. Lett..

[19]  Mahmood Fathy,et al.  Ieee Transactions on Intelligent Transportation Systems 1 an Iranian License Plate Recognition System Based on Color Features , 2022 .

[20]  Thomas S. Huang,et al.  Robust license plate detection using image saliency , 2010, 2010 IEEE International Conference on Image Processing.

[21]  Farhad Faradji,et al.  A Morphological-Based License Plate Location , 2007, 2007 IEEE International Conference on Image Processing.

[22]  Wael Badawy,et al.  Automatic License Plate Recognition (ALPR): A State-of-the-Art Review , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  A. Çapar,et al.  License Plate Recognition From Still Images and Video Sequences: A Survey , 2008, IEEE Transactions on Intelligent Transportation Systems.

[24]  Pietro Perona,et al.  Overcomplete steerable pyramid filters and rotation invariance , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[25]  T-T Nguyen,et al.  A real time license plate detection system based on boosting learning algorithm , 2012, 2012 5th International Congress on Image and Signal Processing.

[26]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[27]  Mei Yu,et al.  An approach to Korean license plate recognition based on vertical edge matching , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[28]  Pengfei Shi,et al.  An Algorithm for License Plate Recognition Applied to Intelligent Transportation System , 2011, IEEE Transactions on Intelligent Transportation Systems.

[29]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Jiří Matas,et al.  Unconstrained licence plate and text localization and recognition , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[31]  Sei-Wang Chen,et al.  Automatic license plate recognition , 2004, IEEE Transactions on Intelligent Transportation Systems.

[32]  Zhu Wei-gang,et al.  A study of locating vehicle license plate based on color feature and mathematical morphology , 2002, 6th International Conference on Signal Processing, 2002..

[33]  Shi-Jinn Horng,et al.  A sliding window technique for efficient license plate localization based on discrete wavelet transform , 2011, Expert Syst. Appl..