Predicted Anchor Region Proposal with Balanced Feature Pyramid for License Plate Detection in Traffic Scene Images

License plate detection is a key problem in intelligent transportation systems. Recently, many deep learning-based networks have been proposed and achieved incredible success in general object detection, such as faster R-CNN, SSD, and R-FCN. However, directly applying these deep general object detection networks on license plate detection without modifying may not achieve good enough performance. This paper proposes a novel deep learning-based framework for license plate detection in traffic scene images based on predicted anchor region proposal and balanced feature pyramid. In the proposed framework, ResNet-34 architecture is first adopted for generating the base convolution feature maps. A balanced feature pyramid generation module is then used to generate balanced feature pyramid, of which each feature level obtains equal information from other feature levels. Furthermore, this paper designs a multiscale region proposal network with a novel predicted location anchor scheme to generate high-quality proposals. Finally, a detection network which includes a region of interest pooling layer and fully connected layers is adopted to further classify and regress the coordinates of detected license plates. Experimental results on public datasets show that the proposed approach achieves better detection performance compared with other state-of-the-art methods on license plate detection.

[1]  Jing Zhao,et al.  A Robust License Plate Detection and Character Recognition Algorithm Based on a Combined Feature Extraction Model and BPNN , 2018, Journal of Advanced Transportation.

[2]  Meng Zhao,et al.  License Plate Detection with Shallow and Deep CNNs in Complex Environments , 2018, Complex..

[3]  Palaiahnakote Shivakumara,et al.  Riesz Fractional Based Model for Enhancing License Plate Detection and Recognition , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Liusheng Huang,et al.  Towards End-to-End License Plate Detection and Recognition: A Large Dataset and Baseline , 2018, ECCV.

[5]  Qi Tian,et al.  Principal Visual Word Discovery for Automatic License Plate Detection , 2012, IEEE Transactions on Image Processing.

[6]  Orhan Bulan,et al.  Segmentation- and Annotation-Free License Plate Recognition With Deep Localization and Failure Identification , 2017, IEEE Transactions on Intelligent Transportation Systems.

[7]  Gee-Sern Hsu,et al.  Application-Oriented License Plate Recognition , 2013, IEEE Transactions on Vehicular Technology.

[8]  Mahmood Fathy,et al.  Ieee Transactions on Intelligent Transportation Systems 1 an Iranian License Plate Recognition System Based on Color Features , 2022 .

[9]  Hyung Il Koo,et al.  Deep-learning-based license plate detection method using vehicle region extraction , 2017 .

[10]  Jian Yao,et al.  Multi-Oriented and Scale-Invariant License Plate Detection Based on Convolutional Neural Networks , 2019, Sensors.

[11]  Lianwen Jin,et al.  A New CNN-Based Method for Multi-Directional Car License Plate Detection , 2018, IEEE Transactions on Intelligent Transportation Systems.

[12]  Bo Li,et al.  Component-Based License Plate Detection Using Conditional Random Field Model , 2013, IEEE Transactions on Intelligent Transportation Systems.

[13]  Yanjie Yao,et al.  Vehicle License Plate Recognition Based on Extremal Regions and Restricted Boltzmann Machines , 2016, IEEE Transactions on Intelligent Transportation Systems.

[14]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Chunhua Shen,et al.  Toward End-to-End Car License Plate Detection and Recognition With Deep Neural Networks , 2019, IEEE Transactions on Intelligent Transportation Systems.

[16]  Nikos Komodakis,et al.  A Robust and Efficient Approach to License Plate Detection , 2017, IEEE Transactions on Image Processing.