Using super resolution to enhance license plates recognition accuracy

License Plate Recognition (LPR) has become one of the most widely used applications. One of the main factors affecting the accuracy of LPR is the quality of the image containing the plate. In case of video-based solutions, many frames are captured for the same car. Super Resolution (SR) techniques can be used for enhancing LPR accuracy by constructing one high resolution image from a number of low resolution images that belong to the same car. However because of the nature of the detected object (car plate), motion analysis as well as object perspective correction need to be taken into consideration when applying the SR algorithm over the provided series of video frames containing the moving car, in order to enhance the resolution of the plate area. This paper aims at providing an implementation for a SR algorithm where input frames are put together into one high-resolution image after detecting the license plate and removing the noisy frames to provide one clear and focused image as an output. OpenCV library was modified to support this implementation. This implementation enhanced the accuracy of an LPR solution by approximately 7% enhancement while trying to not increase the computational complexity of the original solution.

[1]  N. Patel,et al.  Automatic Licenses Plate Recognition , 2013 .

[2]  Cosmin Bercea,et al.  Confidence-aware Levenberg-Marquardt optimization for joint motion estimation and super-resolution , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[3]  Mohamed Mahmoud Abdelwahab,et al.  AUTOMATIC NUMBER PLATE RECOGNITION SYSTEM , 2011, International Research Journal of Modernization in Engineering Technology and Science.

[4]  Aggelos K. Katsaggelos,et al.  Video Super-Resolution With Convolutional Neural Networks , 2016, IEEE Transactions on Computational Imaging.

[5]  Wesley De Neve,et al.  Improved License Plate Recognition for Low-Resolution CCTV Forensics by Integrating Sparse Representation-Based Super-Resolution , 2013, IWDW.

[6]  Alex S. Greaves Multi-Frame Video Super-Resolution Using Convolutional Neural Networks , 2016 .

[7]  Michael Elad,et al.  Robust shift and add approach to superresolution , 2003, SPIE Optics + Photonics.

[8]  Xiang Zhu,et al.  Fast super-resolution for license plate image reconstruction , 2008, 2008 19th International Conference on Pattern Recognition.

[9]  Xiang Zhu,et al.  Fast Super-Resolution Reconstruction for Video-Based Pattern Recognition , 2008, 2008 Fourth International Conference on Natural Computation.

[10]  Daniel Cremers,et al.  Video Super Resolution Using Duality Based TV-L1 Optical Flow , 2009, DAGM-Symposium.

[11]  Weili Zeng,et al.  A Generalized DAMRF Image Model for Super-Resolution of License Plates , 2010, 2010 Symposium on Photonics and Optoelectronics.

[12]  V. Moslemi De-blurring methodology of license plate using sparse representation , 2012, 2012 2nd International eConference on Computer and Knowledge Engineering (ICCKE).