Front Vehicle Detection Algorithm for Smart Car Based on Improved SSD Model

Vehicle detection is an indispensable part of environmental perception technology for smart cars. Aiming at the issues that conventional vehicle detection can be easily restricted by environmental conditions and cannot have accuracy and real-time performance, this article proposes a front vehicle detection algorithm for smart car based on improved SSD model. Single shot multibox detector (SSD) is one of the current mainstream object detection frameworks based on deep learning. This work first briefly introduces the SSD network model and analyzes and summarizes its problems and shortcomings in vehicle detection. Then, targeted improvements are performed to the SSD network model, including major advancements to the basic structure of the SSD model, the use of weighted mask in network training, and enhancement to the loss function. Finally, vehicle detection experiments are carried out on the basis of the KITTI vision benchmark suite and self-made vehicle dataset to observe the algorithm performance in different complicated environments and weather conditions. The test results based on the KITTI dataset show that the mAP value reaches 92.18%, and the average processing time per frame is 15 ms. Compared with the existing deep learning-based detection methods, the proposed algorithm can obtain accuracy and real-time performance simultaneously. Meanwhile, the algorithm has excellent robustness and environmental adaptability for complicated traffic environments and anti-jamming capabilities for bad weather conditions. These factors are of great significance to ensure the accurate and efficient operation of smart cars in real traffic scenarios and are beneficial to vastly reduce the incidence of traffic accidents and fully protect people’s lives and property.

[1]  Xuan Zhao,et al.  Front vehicle detection based on multi-sensor fusion for autonomous vehicle , 2020, J. Intell. Fuzzy Syst..

[2]  Lanhang Ye,et al.  Evaluating the impact of connected and autonomous vehicles on traffic safety , 2019, Physica A: Statistical Mechanics and its Applications.

[3]  Chun Liu,et al.  A Traffic Surveillance Multi-Scale Vehicle Detection Object Method Base on Encoder-Decoder , 2020, IEEE Access.

[4]  Wei Sun,et al.  A Real-Time Detection Framework for On-Tree Mango Based on SSD Network , 2018, ICIRA.

[5]  Euntai Kim,et al.  Autonomous vehicle detection system using visible and infrared camera , 2012, 2012 12th International Conference on Control, Automation and Systems.

[6]  Peng He,et al.  Study on Detection of Preceding Vehicles Based on Computer Vision , 2013 .

[7]  Jiong Yang,et al.  PointPillars: Fast Encoders for Object Detection From Point Clouds , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Wei Liu,et al.  Towards accurate tiny vehicle detection in complex scenes , 2019, Neurocomputing.

[9]  Qian Zhang,et al.  An Improved YOLOv2 for Vehicle Detection , 2018, Sensors.

[10]  M. Aswin,et al.  A Novel Approach for Night-Time Vehicle Detection in Real-Time Scenario , 2018 .

[11]  Euntai Kim,et al.  A Novel On-Road Vehicle Detection Method Using $\pi$HOG , 2015, IEEE Transactions on Intelligent Transportation Systems.

[12]  Jun Liu,et al.  Detecting and Counting the Moving Vehicles Using Mask R-CNN , 2019, 2019 IEEE 8th Data Driven Control and Learning Systems Conference (DDCLS).

[13]  Hoanh Nguyen,et al.  Improving Faster R-CNN Framework for Fast Vehicle Detection , 2019, Mathematical Problems in Engineering.

[14]  Shilei Sun,et al.  Vehicle detection from high-resolution aerial images using spatial pyramid pooling-based deep convolutional neural networks , 2016, Multimedia Tools and Applications.

[15]  Zhiling Wang,et al.  Novel approach for vehicle detection in dynamic environment based on monocular vision , 2014, 2014 IEEE International Conference on Mechatronics and Automation.

[16]  Abdelbaki El Belrhiti El Alaoui,et al.  Moving Vehicle Detection Using Haar-like, LBP and a Machine Learning Adaboost Algorithm , 2018, 2018 IEEE International Conference on Image Processing, Applications and Systems (IPAS).

[17]  Chung-Lin Huang,et al.  Vehicle detection using simplified fast R-CNN , 2018, 2018 International Workshop on Advanced Image Technology (IWAIT).

[18]  Wang Xiaoyong,et al.  Real-time on-road vehicle detection algorithm based on monocular vision , 2012, Proceedings of 2012 2nd International Conference on Computer Science and Network Technology.

[19]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .

[20]  Ye Zhang,et al.  A Fast Forward Vehicle Detection Method by Multiple Vision Clues Fusion , 2014 .

[21]  Henry Leung,et al.  Overview of Environment Perception for Intelligent Vehicles , 2017, IEEE Transactions on Intelligent Transportation Systems.

[22]  Yunhong Wang,et al.  Receptive Field Block Net for Accurate and Fast Object Detection , 2017, ECCV.

[23]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Jing Zhang,et al.  Improving the performance of vehicle detection system in bad weathers , 2016, 2016 IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC).

[25]  Firas Alrawi,et al.  Analysis of the Relationship Between Traffic Accidents with Human and Physical Factors in Iraq , 2019, Advances in Intelligent Systems and Computing.

[26]  Haozhe Cong,et al.  Road traffic accident severity analysis: A census-based study in China. , 2019, Journal of safety research.

[27]  Yang Song,et al.  Macro-level traffic safety analysis in Shanghai, China. , 2019, Accident; analysis and prevention.

[28]  Wei Lin,et al.  Embedded System Real-Time Vehicle Detection based on Improved YOLO Network , 2019, 2019 IEEE 3rd Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC).

[29]  Thomas Bräunl,et al.  Symmetry-based monocular vehicle detection system , 2011, Machine Vision and Applications.

[30]  Qu Shiru,et al.  Research on multi-feature front vehicle detection algorithm based on video image , 2016, 2016 Chinese Control and Decision Conference (CCDC).

[31]  Rogério Schmidt Feris,et al.  A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection , 2016, ECCV.

[32]  Yi Zhou,et al.  Enhanced Object Detection With Deep Convolutional Neural Networks for Advanced Driving Assistance , 2020, IEEE Transactions on Intelligent Transportation Systems.

[33]  Dr. Swet Chandan,et al.  Real-Time Vehicle and Pedestrian Detection Through SSD in Indian Traffic Conditions , 2018, 2018 International Conference on Computing, Power and Communication Technologies (GUCON).

[34]  Daniel Göhring,et al.  Online vehicle detection using deep neural networks and lidar based preselected image patches , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[35]  Lan Fang,et al.  Laser Radar Application in Vehicle Detection Under Traffic Environment , 2019, Recent Trends in Intelligent Computing, Communication and Devices.

[36]  Ye Yu Car Ownership Growth Pattern of County-Level Regions in Jiangsu, China , 2019, CICTP 2019.

[37]  Jungme Park,et al.  Comparison of HOG, LBP and Haar-Like Features for On-Road Vehicle Detection , 2018, 2018 IEEE International Conference on Electro/Information Technology (EIT).

[38]  Zhang Yunzhou,et al.  Real-time vehicle detection in highway based on improved Adaboost and image segmentation , 2015, 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[39]  Xing Li,et al.  A Multi-Feature Fusion Method for Forward Vehicle Detection with Single Camera , 2013 .

[40]  Keshav Bimbraw,et al.  Autonomous cars: Past, present and future a review of the developments in the last century, the present scenario and the expected future of autonomous vehicle technology , 2015, 2015 12th International Conference on Informatics in Control, Automation and Robotics (ICINCO).

[41]  Tobias Langner,et al.  Online vehicle detection using Haar-like, LBP and HOG feature based image classifiers with stereo vision preselection , 2017, 2017 IEEE Intelligent Vehicles Symposium (IV).

[42]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[43]  Xuerui Dai,et al.  HybridNet: A fast vehicle detection system for autonomous driving , 2019, Signal Process. Image Commun..