Front-Vehicle Detection in Video Images Based on Temporal and Spatial Characteristics

Assisted driving and unmanned driving have been areas of focus for both industry and academia. Front-vehicle detection technology, a key component of both types of driving, has also attracted great interest from researchers. In this paper, to achieve front-vehicle detection in unmanned or assisted driving, a vision-based, efficient, and fast front-vehicle detection method based on the spatial and temporal characteristics of the front vehicle is proposed. First, a method to extract the motion vector of the front vehicle is put forward based on Oriented FAST and Rotated BRIEF (ORB) and the spatial position constraint. Then, by analyzing the differences between the motion vectors of the vehicle and those of the background, feature points of the vehicle are extracted. Finally, a feature-point clustering method based on a combination of temporal and spatial characteristics are applied to realize front-vehicle detection. The effectiveness of the proposed algorithm is verified using a large number of videos.

[1]  Zeng Zhi.  Lane Detection and Car Tracking on the Highway , 2003 .

[2]  Ze Liu,et al.  Vehicle Detection by Fusing Part Model Learning and Semantic Scene Information for Complex Urban Surveillance , 2018, Sensors.

[3]  Liu Zhi-qiang.  Approach to front vehicle detection and tracking based on multiple features , 2011 .

[4]  Monique Thonnat,et al.  Active and intelligent sensing of road obstacles: Application to the European Eureka-PROMETHEUS project , 1993, 1993 (4th) International Conference on Computer Vision.

[5]  Yongjin Jeong,et al.  Front collision warning based on vehicle detection using CNN , 2016, 2016 International SoC Design Conference (ISOCC).

[6]  Huang Jin.  Preceding car detection and tracking based on the monocular vision , 2005 .

[7]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[8]  Hongbin Zha,et al.  Probabilistic Inference for Occluded and Multiview On-road Vehicle Detection , 2016, IEEE Transactions on Intelligent Transportation Systems.

[9]  Wang Wei-li.  A Vehicle Overtake Accessorial Navigation System Based on Monocular Vision , 2008 .

[10]  Mennatullah Siam,et al.  Robust autonomous visual detection and tracking of moving targets in UAV imagery , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[11]  Tardi Tjahjadi,et al.  Shadow-Based Vehicle Detection in Urban Traffic , 2017, Sensors.

[12]  Dongbin Zhao,et al.  Deep Reinforcement Learning With Visual Attention for Vehicle Classification , 2017, IEEE Transactions on Cognitive and Developmental Systems.

[13]  Qu Shiru,et al.  Research on multi-feature front vehicle detection algorithm based on video image , 2016, 2016 Chinese Control and Decision Conference (CCDC).

[14]  Wu Wei.  An Improved Multi-scale Retinex Infrared Image Enhancement Algorithm , 2011 .

[15]  Deng-Yuan Huang,et al.  Front Vehicle Detection and Distance Estimation Using Single-Lens Video Camera , 2015, 2015 Third International Conference on Robot, Vision and Signal Processing (RVSP).

[16]  Ernst Dieter Dickmanns.  VISION FOR GROUND VEHICLES: HISTORY AND PROSPECTS , 2002 .

[17]  Wang Zuo-chengb,et al.  Adaptive Canny edge detection algorithm , 2010 .

[18]  Tom Drummond,et al.  Faster and Better: A Machine Learning Approach to Corner Detection , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Ye Li,et al.  Vehicle detection based on And-Or Graph and Hybrid Image Templates for complex urban traffic conditions , 2015 .

[20]  Andrey A. Filchenkov,et al.  Application of deep learning to the problem of vehicle detection in UAV images , 2016, 2016 XIX IEEE International Conference on Soft Computing and Measurements (SCM).

[21]  Jintao Li,et al.  Vehicle Detection Algorithm Based on Multiple-model Fusion , 2018 .

[22]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[23]  Yingfeng Cai,et al.  A Vehicle Recognition Algorithm Based on Deep Transfer Learning with a Multiple Feature Subspace Distribution , 2018, Sensors.