Vehicle Object Detection Based on RGB-Camera and Radar Sensor Fusion

Object detection has always played a major role in the field of computer vision. With the development of faster region-based convolutional neural network (faster-RCNN), single shot multi-box detector (SSD), You Only Look Once (Yolo) and other deep learning networks, 2D object detection has been developed well developed. However, in some key areas, such as driverless vehicles and artificial intelligence robots, cannot meet the requirements of tasks just by detecting two dimensional (2D) objects. So we need to get the three dimensional (3D) position of the object. In 3D object detection, it is difficult to obtain object position information only by red-green-blue (RGB) image. There are some methods to get the 3D position of the target through the point cloud data set. Therefore, this paper proposes a deep learning network, which can combine both color image information and point cloud geometry information, while using MobileNet V3 as the backbone network greatly enhances the operation speed. The region proposal networks (RPN) layer in faster-RCNN is migrated to the network. After testing, the method proposed by us improves obviously in speed and recognition accuracy compared with the previous methods.

[1]  Yin Zhou,et al.  VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[2]  Jiaolong Xu,et al.  Multiview random forest of local experts combining RGB and LIDAR data for pedestrian detection , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[3]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[4]  Quoc V. Le,et al.  Searching for MobileNetV3 , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[5]  Stefan Leutenegger,et al.  SemanticFusion: Dense 3D semantic mapping with convolutional neural networks , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Sanja Fidler,et al.  Monocular 3D Object Detection for Autonomous Driving , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Christopher Leckie,et al.  Network Energy Consumption Assessment of Conventional Mobile Services and Over-the-Top Instant Messaging Applications , 2016, IEEE Journal on Selected Areas in Communications.

[8]  Ming Yan,et al.  Characterizing Mobility and Service Pattern of Mobile Users Based on Wireless Data Analysis , 2018, 2018 International Joint Conference on Information, Media and Engineering (ICIME).

[9]  Matthias Nießner,et al.  3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation , 2018, ECCV.

[10]  Laurens van der Maaten,et al.  3D Semantic Segmentation with Submanifold Sparse Convolutional Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[11]  Ming Yan,et al.  PECS: Towards personalized edge caching for future service-centric networks , 2019, China Communications.

[12]  Jinbo Liu,et al.  The Application of Improved Spherical Harmonics Expansion-Based Multilevel Fast Multipole Algorithm in the Solution of Volume-Surface Integral Equation , 2018 .

[13]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[14]  Ji Wan,et al.  Multi-view 3D Object Detection Network for Autonomous Driving , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Long Quan,et al.  MVSNet: Depth Inference for Unstructured Multi-view Stereo , 2018, ECCV.

[16]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Tian Xia,et al.  Vehicle Detection from 3D Lidar Using Fully Convolutional Network , 2016, Robotics: Science and Systems.

[18]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Ming Yan,et al.  Assessing the Energy Consumption of Proactive Mobile Edge Caching in Wireless Networks , 2019, IEEE Access.