A Next-Generation Secure Cloud-Based Deep Learning License Plate Recognition for Smart Cities

License Plate Recognition System (LPRS) plays a vital role in smart city initiatives such as traffic control, smart parking, toll management and security. In this article, a cloud-based LPRS is addressed in the context of efficiency where accuracy and speed of processing plays a critical role towards its success. Signature-based features technique as a deep convolutional neural network in a cloud platform is proposed for plate localization, character detection and segmentation. Extracting significant features makes the LPRS to adequately recognize the license plate in a challenging situation such as i) congested traffic with multiple plates in the image ii) plate orientation towards brightness, iii) extra information on the plate, iv) distortion due to wear and tear and v) distortion about captured images in bad weather like as hazy images. Furthermore, the deep learning algorithm computed using bare-metal cloud servers with kernels optimized for NVIDIA GPUs, which speed up the training phase of the CNN LPDS algorithm. The experiments and results show the superiority of the performance in both recall and precision and accuracy in comparison with traditional LP detecting systems.

[1]  Muhittin Gökmen,et al.  License Plate Character Segmentation Based on the Gabor Transform and Vector Quantization , 2003, ISCIS.

[2]  Christos-Nikolaos E. Anagnostopoulos,et al.  License Plate Recognition: A Brief Tutorial , 2014, IEEE Intelligent Transportation Systems Magazine.

[3]  Keiichi Yamada,et al.  Robust license-plate recognition method for passing vehicles under outside environment , 2000, IEEE Trans. Veh. Technol..

[4]  A. Çapar,et al.  License Plate Recognition From Still Images and Video Sequences: A Survey , 2008, IEEE Transactions on Intelligent Transportation Systems.

[5]  John Tran,et al.  cuDNN: Efficient Primitives for Deep Learning , 2014, ArXiv.

[6]  Sos S. Agaian,et al.  Secure Proxy Service Using p-Fibonacci Transformation of Cosine Coefficients on Cloud File Sharing Environment , 2015, 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conference on Embedded Software and Systems.

[7]  Kwang In Kim,et al.  Learning-based approach for license plate recognition , 2000, Neural Networks for Signal Processing X. Proceedings of the 2000 IEEE Signal Processing Society Workshop (Cat. No.00TH8501).

[8]  Changping Liu,et al.  A hybrid License Plate Extraction Method Based On Edge Statistics and Morphology , 2004, ICPR.

[9]  Humberto de Jesús Ochoa Domínguez,et al.  License Plate Recognition Using a Novel Fuzzy Multilayer Neural Network , .

[10]  Kai Wang,et al.  End-to-end scene text recognition , 2011, 2011 International Conference on Computer Vision.

[11]  Marzuki Khalid,et al.  Comparison of Feature Extractors in License Plate Recognition , 2007, First Asia International Conference on Modelling & Simulation (AMS'07).

[12]  Subramaniam Ganesan,et al.  An efficient implementation of the Hough transform for detecting vehicle license plates using DSP'S , 1995, Proceedings Real-Time Technology and Applications Symposium.

[13]  Paul Rad,et al.  Low-latency software defined network for high performance clouds , 2015, 2015 10th System of Systems Engineering Conference (SoSE).

[14]  Simon M. Lucas,et al.  ICDAR 2003 robust reading competitions , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[15]  Volkmar Frinken,et al.  Visual Saliency Models for Text Detection in Real World , 2014, PloS one.

[16]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Matti Pietikäinen,et al.  Adaptive document image binarization , 2000, Pattern Recognit..

[18]  Chunhua Shen,et al.  Reading Car License Plates Using Deep Convolutional Neural Networks and LSTMs , 2016, ArXiv.

[19]  Wael Badawy,et al.  Automatic License Plate Recognition (ALPR): A State-of-the-Art Review , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Anthony T. Chronopoulos,et al.  Benchmarking Bare Metal Cloud Servers for HPC Applications , 2015, 2015 IEEE International Conference on Cloud Computing in Emerging Markets (CCEM).

[21]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[22]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[23]  Xiang Zhang,et al.  Character-level Convolutional Networks for Text Classification , 2015, NIPS.

[24]  Y. Mitsukura,et al.  License plate detection system by using threshold function and improved template matching method , 2004, IEEE Annual Meeting of the Fuzzy Information, 2004. Processing NAFIPS '04..

[25]  Ye Zhang,et al.  Mathematical Morphology Methodology for Extraction of Vehicle Number Plates , 2008 .

[26]  Hitoshi Saji,et al.  Extraction and tracking of the license plate using Hough transform and voted block matching , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[27]  Andrew Zisserman,et al.  Deep Features for Text Spotting , 2014, ECCV.

[28]  Ching-Tang Hsieh,et al.  Wavelet Transform Based License Plate Detection for Cluttered Scene , 2004 .

[29]  Ye Zhang,et al.  Vehicle number plate recognition using mathematical morphology and neural networks , 2008 .

[30]  Gee-Sern Hsu,et al.  Application-Oriented License Plate Recognition , 2013, IEEE Transactions on Vehicular Technology.

[31]  Tao Wang,et al.  End-to-end text recognition with convolutional neural networks , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[32]  Shijian Lu,et al.  Accurate Scene Text Recognition Based on Recurrent Neural Network , 2014, ACCV.

[33]  Manik Varma,et al.  Character Recognition in Natural Images , 2009, VISAPP.

[34]  S Draghici,et al.  A NEURAL NETWORK BASED ARTIFICIAL VISION SYSTEM FOR LICENSE PLATE RECOGNITION , 1997 .

[35]  Sorin Draghici,et al.  A Neural Network Based Artificial Vision System for Licence Plate Recognition , 1997, Int. J. Neural Syst..

[36]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[37]  Bai Hongliang,et al.  A hybrid license plate extraction method based on edge statistics and morphology , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[38]  Pan He,et al.  Reading Scene Text in Deep Convolutional Sequences , 2015, AAAI.

[39]  Yi Zhang,et al.  A License Plate Character Segmentation Method Based on Character Contour and Template Matching , 2013 .

[40]  Sos S. Agaian,et al.  Secure image processing inside cloud file sharing environment using lightweight containers , 2015, 2015 IEEE International Conference on Imaging Systems and Techniques (IST).

[41]  J.M. Armingol,et al.  Real-time drowsiness detection system for an intelligent vehicle , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[42]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .