Real-time search-free multiple license plate recognition via likelihood estimation of saliency

A search-free car license plate localization method based on 3-D Bayesian saliency estimation has been developed for the first time.This method uses a 3-D object tracking algorithm based on Bayesian methods to estimate the 3-D salient regions by exploiting the motion information in the videos.The algorithm is fast and robust to variation in the environment and is suitable for localizing multiple plates.The tracking approach exhibits acceptable accuracy for different noise and artefact levels.The localization method uses adaptive size in closing to improve the accuracy. Display Omitted In this paper, we propose a novel search-free localization method based on 3-D Bayesian saliency estimation. This method uses a new 3-D object tracking algorithm which includes: object detection, shadow detection and removal, and object recognition based on Bayesian methods. The algorithm is tested over three image datasets with different levels of complexities, and the results are compared with those of benchmark methods in terms of speed and accuracy. Unlike most search-based license-plate extraction methods, our proposed 3-D Bayesian saliency algorithm has lower execution time (less than 60źms), more accuracy, and it is a search-free algorithm which works in noisy backgrounds.

[1]  Shing-Chow Chan,et al.  A new visual object tracking algorithm using Bayesian Kalman filter , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[2]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[3]  Yingying Zhao,et al.  Background extraction algorithm base on Partition Weighed Histogram , 2012, 2012 3rd IEEE International Conference on Network Infrastructure and Digital Content.

[4]  Maya R. Gupta,et al.  Sequential Bayesian estimation of the probability of detection for tracking , 2009, 2009 12th International Conference on Information Fusion.

[5]  S. Mohamed Mansoor Roomi,et al.  Accurate license plate localization , 2011, 2011 International Conference on Computer, Communication and Electrical Technology (ICCCET).

[6]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[7]  Sanjivani Shantaiya,et al.  Multiple Object Tracking using Kalman Filter and Optical Flow , 2015 .

[8]  Saeid Sanei,et al.  Robust search-free car number plate localization incorporating hierarchical saliency , 2016 .

[9]  Xiangjian He,et al.  Automatic License Plate Recognition: a Review , 2004, CISST.

[10]  Wael Badawy,et al.  Automatic License Plate Recognition (ALPR): A State-of-the-Art Review , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Zhengzhi Wang,et al.  Single-image shadow detection and removal using local colour constancy computation , 2015, IET Image Process..

[12]  Suet-Peng Yong,et al.  Image processing based vehicle detection and tracking method , 2014, 2014 International Conference on Computer and Information Sciences (ICCOINS).

[13]  Shuicheng Yan,et al.  Object Tracking With Only Background Cues , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Alan C. Bovik,et al.  Handbook of Image and Video Processing (Communications, Networking and Multimedia) , 2005 .

[15]  Kajal A. Mandhare,et al.  Automatic License Plate Recognition , 2015 .

[16]  Saeid Sanei,et al.  Search-free license plate localization based on saliency and local variance estimation , 2015, Other Conferences.

[17]  Reji P.I,et al.  License Plate Localization: A Review , 2014 .

[18]  Ioannis Anagnostopoulos,et al.  A License Plate-Recognition Algorithm for Intelligent Transportation System Applications , 2006, IEEE Transactions on Intelligent Transportation Systems.

[19]  Guishan Xiang Robust face tracking based on bayesian probability , 2009, 2009 9th International Conference on Electronic Measurement & Instruments.

[20]  Xiaobo Lu,et al.  An Accurate Shadow Removal Method for Vehicle Tracking , 2010, 2010 International Conference on Artificial Intelligence and Computational Intelligence.

[21]  Luo Di,et al.  Texture Analysis for Shadow Removing and Tracking of Vehicle in Traffic Monitoring System , 2008, 2008 International Symposium on Intelligent Information Technology Application Workshops.

[22]  Benjamin Pfaff,et al.  Handbook Of Image And Video Processing , 2016 .

[23]  H. Harada,et al.  A method of object tracking based on particle filter and optical flow , 2009, 2009 ICCAS-SICE.

[24]  Chung-Bin Wu,et al.  An efficient background extraction and object segmentation algorithm for realtime applications , 2012, 2012 IEEE Asia Pacific Conference on Circuits and Systems.

[25]  Hsi-Jian Lee,et al.  Extraction and recognition of license plates of motorcycles and vehicles on highways , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[26]  Chung-Cheng Chiu,et al.  A Robust Object Segmentation System Using a Probability-Based Background Extraction Algorithm , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Przemyslaw Mazurek,et al.  Vehicle Tracking Using a Multi-scale Bayesian Algorithm for a Perspective Image of a Road , 2011, TST.

[28]  Aslani Sepehr,et al.  Optical Flow Based Moving Object Detection and Tracking for Traffic Surveillance , 2014, ICEE 2014.

[29]  Rodolfo Zunino,et al.  Vector quantization for license-plate location and image coding , 2000, IEEE Trans. Ind. Electron..

[30]  J. Saniie,et al.  Design flow for robust license plate localization , 2011, 2011 IEEE INTERNATIONAL CONFERENCE ON ELECTRO/INFORMATION TECHNOLOGY.

[31]  Ju Jia Zou,et al.  Real-time vehicle shadow detection , 2015 .

[32]  Fred Daum,et al.  Bayesian multiple target tracking, 2nd edition [Book review] , 2014, IEEE Aerospace and Electronic Systems Magazine.

[33]  Aakash Gupta,et al.  Vehicle license plate localization using wavelets , 2013, 2013 IEEE CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES.

[34]  M. Gokmen,et al.  Integrating Differential Evolution and Condensation Algorithms for License Plate Tracking , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[35]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[36]  Kunfeng Wang,et al.  Video processing techniques for traffic flow monitoring: A survey , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).