Joint Image Deblurring and Binarization for License Plate Images using Deep Generative Adversarial Networks

Image deblurring is a highly ill-posed inverse problem where it aims to estimate the sharp image from blurred image with or without the knowledge about the blurring process. Despite the success of model-based image deblurring methods where the deconvolution is a major step to recover the sharp image, its usage in practice is still limited, especially when many factors such as object motion, camera motion, non-uniform sensitivity of the imaging device contribute to imaging process. In automatic license plate recognition (ALPR) of moving vehicle, the blurred image severely reduces the accuracy of recognition. Meanwhile, though the binarized image of license plate has an important role in ALPR systems, its accuracy is largely affected by the blurred image. In this paper, we use a deep architecture based on Generative Adversarial Networks to jointly perform image deblurring and image binarization for license plate images. Our model directly maps from blurred image to binary image without going through the deblurring as in conventional method. The proposed method is benefited from the fact that the ground-truth, sharp license plates are difficult to acquire for moving object, while the accurate binary images can be manually derived from blurred ones.

[1]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[3]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[4]  Dianne P. O'Leary,et al.  Deblurring Images: Matrices, Spectra and Filtering , 2006, J. Electronic Imaging.

[5]  Svoboda Pavel,et al.  CNN for license plate motion deblurring , 2016 .

[6]  Shubham Pachori,et al.  Deep Generative Filter for Motion Deblurring , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[7]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[8]  Tae Hyun Kim,et al.  Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Wael Badawy,et al.  Automatic License Plate Recognition (ALPR): A State-of-the-Art Review , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Chuan Li,et al.  Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks , 2016, ECCV.

[11]  Bernhard Schölkopf,et al.  Space-Variant Single-Image Blind Deconvolution for Removing Camera Shake , 2010, NIPS.

[12]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[13]  Rama Chellappa,et al.  Motion Deblurring: Algorithms and Systems , 2014 .

[14]  Jiri Matas,et al.  DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  Jean Ponce,et al.  Learning a convolutional neural network for non-uniform motion blur removal , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).