Deconvolution Feature Fusion for traffic signs detection in 5G driven unmanned vehicle

Abstract Real-time and accurate recognition of distant traffic signs in a wide visual range is one of the key technologies in 5G driven unmanned vehicles. Most earlier studies focused on improving accurately of short rang traffic signs detection in manned driving assistance system, while little attention has been paid to distant range traffic signs recognition in the unmanned vehicle. At the same time, it is difficult to detect long-distance traffic signs due to their small size. This paper is oriented to the 5G driven unmanned vehicle scene, proposes a novel framework of Deconvolution Feature Fusion based on the backbone of YOLOv3 (DFF-YOLOv3) to enhance the accuracy of distant traffic signs recognition in a wide visual range for unmanned driving. The proposed framework has combined the deep and shallow feature maps to form a fusion module with a wider range and higher accuracy of distant information in a fixed monocular camera. Specifically, the deep feature map is up-sampled by deconvolution and then merged with the shallow feature map. The convolution module is used to learn the feature, and then through the dimensionality reduction of the convolutional layer to form a deconvolution feature fusion module, which finally replaces the original prediction layer to detect the target. Experimental results are provided to validate the framework, which can improve the recognition accuracy of distant traffic signs without reducing the entire visual range in unmanned vehicles. The result shows that the mean accuracy prediction (mAP) of the proposed DFF-YOLOv3 on distant traffic signs is 74.8%, which is higher than other classic detection algorithms.

[1]  Francisco Assis da Silva,et al.  Real-Time Traffic Sign Detection and Recognition using CNN , 2020, IEEE Latin America Transactions.

[2]  Huibing Zhang,et al.  Real-Time Detection Method for Small Traffic Signs Based on Yolov3 , 2020, IEEE Access.

[3]  Liu Wei,et al.  Traffic sign detection and recognition via transfer learning , 2018, 2018 Chinese Control And Decision Conference (CCDC).

[4]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[5]  Fasheng Zhou,et al.  Intelligent secure mobile edge computing for beyond 5G wireless networks , 2021, Phys. Commun..

[6]  Lisheng Fan,et al.  Efficient and flexible management for industrial Internet of Things: A federated learning approach , 2021, Comput. Networks.

[7]  Lisha Cui,et al.  MDSSD: multi-scale deconvolutional single shot detector for small objects , 2018, Science China Information Sciences.

[8]  Wang Cong,et al.  A traffic sign detection algorithm based on deep convolutional neural network , 2016, 2016 IEEE International Conference on Signal and Image Processing (ICSIP).

[9]  Zengfu Wang,et al.  Real-Time Traffic Sign Recognition Based on Efficient CNNs in the Wild , 2019, IEEE Transactions on Intelligent Transportation Systems.

[10]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Lin Xu,et al.  Detecting Small Chinese Traffic Signs via Improved YOLOv3 Method , 2021 .

[12]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  George K. Karagiannidis,et al.  Dynamic Offloading for Multiuser Muti-CAP MEC Networks: A Deep Reinforcement Learning Approach , 2021, IEEE Transactions on Vehicular Technology.

[14]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  George K. Karagiannidis,et al.  Learning-Based Signal Detection for MIMO Systems With Unknown Noise Statistics , 2021, IEEE Transactions on Communications.

[16]  Toshiaki Fujii,et al.  Traffic Sign Recognition with Invariance to Lighting in Dual-Focal Active Camera System , 2012, IEICE Trans. Inf. Syst..

[17]  He Yang,et al.  Multi-scale traffic sign detection model with attention , 2020 .

[18]  Zhiqiang Que,et al.  An efficient convolutional neural network for small traffic sign detection , 2019, J. Syst. Archit..

[19]  Meina Song,et al.  FAMN: Feature Aggregation Multipath Network for Small Traffic Sign Detection , 2019, IEEE Access.

[20]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Md. Kamrul Hasan,et al.  Automatic Traffic Sign Detection and Recognition Using SegU-Net and a Modified Tversky Loss Function With L1-Constraint , 2020, IEEE Transactions on Intelligent Transportation Systems.

[22]  Jing Fan,et al.  Localized Traffic Sign Detection with Multi-scale Deconvolution Networks , 2018, 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC).

[23]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[24]  Victor C. M. Leung,et al.  Edge Network-Assisted Real-Time Object Detection Framework for Autonomous Driving , 2020, ArXiv.

[25]  Wei Liu,et al.  DSSD : Deconvolutional Single Shot Detector , 2017, ArXiv.

[26]  Arun Kumar Sangaiah,et al.  Deep detection network for real-life traffic sign in vehicular networks , 2018, Comput. Networks.

[27]  Faming Shao,et al.  Improved Faster R-CNN Traffic Sign Detection Based on a Second Region of Interest and Highly Possible Regions Proposal Network , 2019, Sensors.

[28]  Haixia Pan,et al.  Speed sign recognition in complex scenarios based on deep cascade networks , 2020 .

[29]  Yizhou Yu,et al.  Traffic Sign Detection Using a Multi-Scale Recurrent Attention Network , 2019, IEEE Transactions on Intelligent Transportation Systems.

[30]  Rui Zhang,et al.  Vehicle Detection and Ranging Using Two Different Focal Length Cameras , 2020, J. Sensors.

[31]  Abir Bhattacharyya,et al.  Real-time Sign Detection and Recognition for Self-driving Mini Rovers based on Template Matching and Hierarchical Decision Structure , 2020, ICAART.

[32]  Fusheng Zhu,et al.  An adaptive deep learning-based UAV receiver design for coded MIMO with correlated noise , 2021, Phys. Commun..

[33]  Yang Xu,et al.  SAR Ship Target Detection for SSDv2 under Complex Backgrounds , 2020, 2020 International Conference on Computer Vision, Image and Deep Learning (CVIDL).

[34]  Xue Yuan,et al.  TIRNet: Object detection in thermal infrared images for autonomous driving , 2020, Applied Intelligence.

[35]  Baoli Li,et al.  Traffic-Sign Detection and Classification in the Wild , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Zhaogong Zhang,et al.  Research on Occlusion Relationship Recognition Based on Distance Measurement of Moving Objects in Video , 2019, ICVIP.

[37]  Guofa Li,et al.  Detection of Road Objects With Small Appearance in Images for Autonomous Driving in Various Traffic Situations Using a Deep Learning Based Approach , 2020, IEEE Access.

[38]  Feng Xiao,et al.  Improved Traffic Sign Detection and Recognition Algorithm for Intelligent Vehicles , 2019, Sensors.

[39]  Yu Zhang,et al.  Real-time small traffic sign detection with revised faster-RCNN , 2018, Multimedia Tools and Applications.

[40]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[41]  Long Chen,et al.  DenseLightNet: A Light-Weight Vehicle Detection Network for Autonomous Driving , 2020, IEEE Transactions on Industrial Electronics.

[42]  Lianli Gao,et al.  Traffic sign detection and recognition based on pyramidal convolutional networks , 2019, Neural Computing and Applications.

[43]  Qi Wang,et al.  VSSA-NET: Vertical Spatial Sequence Attention Network for Traffic Sign Detection , 2019, IEEE Transactions on Image Processing.

[44]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.