Optical character recognition on heterogeneous SoC for HD automatic number plate recognition system

Automatic number plate recognition (ANPR) systems are becoming vital for safety and security purposes. Typical ANPR systems are based on three stages: number plate localization (NPL), character segmentation (CS), and optical character recognition (OCR). Recently, high definition (HD) cameras have been used to improve their recognition rates. In this paper, four algorithms are proposed for the OCR stage of a real-time HD ANPR system. The proposed algorithms are based on feature extraction (vector crossing, zoning, combined zoning, and vector crossing) and template matching techniques. All proposed algorithms have been implemented using MATLAB as a proof of concept and the best one has been selected for hardware implementation using a heterogeneous system on chip (SoC) platform. The selected platform is the Xilinx Zynq-7000 All Programmable SoC, which consists of an ARM processor and programmable logic. Obtained hardware implementation results have shown that the proposed system can recognize one character in 0.63 ms, with an accuracy of 99.5% while utilizing around 6% of the programmable logic resources. In addition, the use of the heterogenous SoC consumes 36 W which is equivalent to saving around 80% of the energy consumed by the PC used in this work, whereas it is smaller in size by 95%.

[1]  Yafang Xue,et al.  Optical Character Recognition , 2022 .

[2]  Alireza Ahmadyfard,et al.  An edge-based color-aided method for license plate detection , 2009, Image Vis. Comput..

[3]  Ali Ziya Alkar,et al.  Efficient Embedded Neural-Network-Based License Plate Recognition System , 2008, IEEE Transactions on Vehicular Technology.

[4]  Line Eikvil Optical Character Recognition , 1993 .

[5]  Abbes Amira,et al.  HD Qatari ANPR system , 2016, 2016 International Conference on Industrial Informatics and Computer Systems (CIICS).

[6]  Yongdong Zhang,et al.  Effective Uyghur Language Text Detection in Complex Background Images for Traffic Prompt Identification , 2018, IEEE Transactions on Intelligent Transportation Systems.

[7]  Mohammad Eshghi,et al.  Design and implementation of a new Persian digits OCR algorithm on FPGA chips , 2005, 2005 13th European Signal Processing Conference.

[8]  Xiaojun Zhai,et al.  Real-time optical character recognition on field programmable gate array for automatic number plate recognition system , 2013, IET Circuits Devices Syst..

[9]  Vijey Thayananthan,et al.  Saudi License Plate Recognition System Using Artificial Neural Network Classifier , 2017, 2017 International Conference on Computer and Applications (ICCA).

[10]  Abbes Amira,et al.  HD number plate localization and character segmentation on the Zynq heterogeneous SoC , 2018, Journal of Real-Time Image Processing.

[11]  Jean-Yves Ramel,et al.  Word spotting in historical documents using primitive codebook and dynamic programming , 2015, Image Vis. Comput..

[12]  Horst Bischof,et al.  Real-Time License Plate Recognition on an Embedded DSP-Platform , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Tomasz Kryjak,et al.  Real-time hardware–software embedded vision system for ITS smart camera implemented in Zynq SoC , 2018, Journal of Real-Time Image Processing.

[14]  Stavros J. Perantonis,et al.  A Complete Optical Character Recognition Methodology for Historical Documents , 2008, 2008 The Eighth IAPR International Workshop on Document Analysis Systems.

[15]  Reza Azad,et al.  Real-Time and Efficient Method for Accuracy Enhancement of Edge Based License Plate Recognition System , 2014, ArXiv.

[16]  Dana Kassymkhanova,et al.  Majority voting approach and fuzzy logic rules in license plate recognition process , 2014, 2014 IEEE 8th International Conference on Application of Information and Communication Technologies (AICT).

[17]  Xiaojun Zhai,et al.  Automatic number plate recognition system on an ARM-DSP and FPGA heterogeneous SoC platforms , 2013, 2013 IEEE Hot Chips 25 Symposium (HCS).

[18]  Xiaojun Zhai,et al.  Improved number plate character segmentation algorithm and its efficient FPGA implementation , 2012, Journal of Real-Time Image Processing.

[19]  E. A. Edirisinghe,et al.  Real-time automatic license plate recognition for CCTV forensic applications , 2013, Journal of Real-Time Image Processing.

[20]  Roberto Muscedere,et al.  An efficient FPGA implementation of Optical Character Recognition for License Plate Recognition , 2017, 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE).

[21]  Reza Azad,et al.  A novel and robust method for automatic license plate recognition system based on pattern recognition , 2013 .