Roadside Traffic Sign Detection Based on Faster R-CNN

This paper presents an improved traffic sign detection method based on Faster R-CNN with dataset augmentation and subcategory detection scheme. Firstly, we extract natural scene frames from given videos and determine 20 categories of traffic signs. Secondly, we extend the image dataset and extract regions of interest, then manually annotate all categories. Thirdly, we train the Faster R-CNN model based on TensorFlow, then test the model and obtain the following evaluation indexes: the mean average precision is 99.07%, the recall rate is 99.66%, and the precision rate is 97.54%. Finally, we add the subcategory detection scheme to determine traffic light states, and we get the following evaluation indexes: the mean average precision is 99.50\%, the recall rate is 100%, and the precision rate is 94.40\%. Our experiments prove the robustness and accuracy for both traffic sign detection and subcategory detection of traffic light.

[1]  Wenyu Liu,et al.  Traffic sign detection and recognition using fully convolutional network guided proposals , 2016, Neurocomputing.

[2]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2015, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Canyong Wang,et al.  Research and Application of Traffic Sign Detection and Recognition Based on Deep Learning , 2018, 2018 International Conference on Robots & Intelligent System (ICRIS).

[4]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[5]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[6]  Abhinav Gupta,et al.  A-Fast-RCNN: Hard Positive Generation via Adversary for Object Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Kang Kim,et al.  Simultaneous Traffic Sign Detection and Boundary Estimation Using Convolutional Neural Network , 2018, IEEE Transactions on Intelligent Transportation Systems.

[10]  Hidehiko Akatsuka,et al.  Road Signposts Recognition System , 1987 .

[11]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[12]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  Zengfu Wang,et al.  Real-Time Traffic Sign Recognition Based on Efficient CNNs in the Wild , 2019, IEEE Transactions on Intelligent Transportation Systems.

[15]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[16]  Jie Cao,et al.  Application of deep learning and unmanned aerial vehicle technology in traffic flow monitoring , 2017, 2017 International Conference on Machine Learning and Cybernetics (ICMLC).