An Efficient Small Traffic Sign Detection Method Based on YOLOv3

In recent years, target detection framework based on deep learning has made brilliant achievements. However, real-life traffic sign detection remains a great challenge for most of the state-of-the-art object detection methods. The existing deep learning models are inadequate to effectively extract the features of small traffic signs from large images in real-world conditions. In this paper, we address the small traffic sign detection challenge by proposing a novel small traffic sign detection method based on a highly efficient end-to-end deep network model. The proposed method features fast speed and high precision as it attaches three key insights to the established You Only Look Once (YOLOv3) architecture and other correlated algorithms. Besides, network pruning is appropriately introduced to minimize network redundancy and model size while keeping a competitive detection accuracy. Furtherly, four scale prediction branches are also adopted to significantly enrich the feature maps of multi-scales prediction. In our method, we adjust the loss function to balance the contribution of error source to the total loss. The effectiveness, and robustness of the network is further proved with experiments on Tsinghua-Tencent 100 K traffic sign dataset. The experimental results indicate that our proposed method has achieved better accuracy than that of the original YOLOv3 model. Compared with the schemes in relevant literatures our proposed method not only emerges performance superiors in detection recall and accuracy, but also achieves 1.9–2.7x improvement in detection speed.

[1]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[2]  Arun Kumar Sangaiah,et al.  Deep detection network for real-life traffic sign in vehicular networks , 2018, Comput. Networks.

[3]  Min Chen,et al.  Detecting Small Signs from Large Images , 2017, 2017 IEEE International Conference on Information Reuse and Integration (IRI).

[4]  Zhiqiang Que,et al.  An efficient convolutional neural network for small traffic sign detection , 2019, J. Syst. Archit..

[5]  Fuchun Sun,et al.  Traffic sign recognition using group sparse coding , 2014, Inf. Sci..

[6]  Myoungho Sunwoo,et al.  Multiple exposure images based traffic light recognition , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[7]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Yunchao Wei,et al.  Perceptual Generative Adversarial Networks for Small Object Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Tae-Hyun Oh,et al.  Co-domain Embedding using Deep Quadruplet Networks for Unseen Traffic Sign Recognition , 2017, AAAI.

[10]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Feng Tian,et al.  MR-CNN: A Multi-Scale Region-Based Convolutional Neural Network for Small Traffic Sign Recognition , 2019, IEEE Access.

[12]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Qichao Zhang,et al.  Multi-task learning for dangerous object detection in autonomous driving , 2017, Inf. Sci..

[14]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[15]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[16]  Yizhou Yu,et al.  Traffic Sign Detection Using a Multi-Scale Recurrent Attention Network , 2019, IEEE Transactions on Intelligent Transportation Systems.

[17]  Aref Meddeb,et al.  Spatially Enhanced Bags of Visual Words Representation to Improve Traffic Signs Recognition , 2018, J. Signal Process. Syst..

[18]  Anupam Shukla,et al.  A Novel Genetically Optimized Convolutional Neural Network for Traffic Sign Recognition: A New Benchmark on Belgium and Chinese Traffic Sign Datasets , 2019, Neural Processing Letters.

[19]  Peter Hall,et al.  Traffic signal detection and classification in street views using an attention model , 2018, Computational Visual Media.

[20]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Baoli Li,et al.  Traffic-Sign Detection and Classification in the Wild , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Xie Bangquan,et al.  Real-Time Embedded Traffic Sign Recognition Using Efficient Convolutional Neural Network , 2019, IEEE Access.

[23]  Fawzi Nashashibi,et al.  Real time visual traffic lights recognition based on Spot Light Detection and adaptive traffic lights templates , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[24]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[25]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[26]  Francisco López-Ferreras,et al.  Road-Sign Detection and Recognition Based on Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[27]  Fernando A. Mujica,et al.  An Empirical Evaluation of Deep Learning on Highway Driving , 2015, ArXiv.

[28]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.